Bengali.AI

A community research initiative working towards democratizing AI research for Bengali by crowdsourcing datasets and launching research competitions.

A research community of 7000+ researchers from around the world. Striving towards the same goal: Development of language tech of Bengali. Bangla/Bengali (বাংলা) has a rich heritage of literature that dates back to almost a thousand years. Even with a huge number of native speakers, Bengali is lagging behind in language tech due to lack of curated large datasets. From government services to education, from agriculture to healthcare, Bengali language tech research would make lives easier for everyone.

Email  /  Twitter  /  Github  /  Community Group  /  Facebook

We are currently more interested in computer vision, speech and NLP based research. In parallel our teams work on Linguistic theory, language documentation, meme research and much more!

Jointly largest open-sourced Bengali ASR dataset as well as first Bengali Out-of-Distribution Speech Recognition benchmarking dataset. 25,000+ people contributed in the development of this dataset.

The first multidomain large Bengali Document Layout Analysis Dataset: BaDLAD. This dataset contains 33,695 human annotated document samples from six domains - i) books and magazines ii) public domain govt. documents iii) liberation war documents iv) new newspapers v) historical newspapers and vi) property deeds. 700K polygon annotations from image captured documents in the wild.

The first Opensourced complete OCR pipeline for Bengali. We provide 2 synthetic datasets for word recognition and one hand annotated complete document deconstruction dataset BCD3 with 228 domain diversified samples. We benchmark our models on the BCD3 dataset and opensource the datasets and the models+system for further research. We will keep updating the dataset.

Large Bengali grammatical error detection and correction project. Involves a novel linguist validated dataset with 100k+ sentence samples with word-level anntoatation. Hosted a Kaggle competition in 2023 to crowdsource solutions.

The first opensourced and publicly available sign language data collection tool. The commonvoice for sign languages.

A benchmark datset for multi-target classification of handwritten Bengali Graphemes, with novel implications for all alpha-syllabary languages, e.g., Hindi, Gujrati, and Thai.

The first large scale Multi-Domain Bengali Handwritten Digit Recognition Dataset.

Bengali.AI regularly launches research competitions in collaboration with industry, academia and government collaborators. Currently, a $53,000 Kaggle featured competition is ongoing on Bengali Automatic Speech Recognition. To know more about the competitions, visit the Competitions Page.