BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls
of Large Language Models on Bengali NLP

BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLP

22 September 2023

Mohammed Saidul Islam

Md Tahmid Rahman Laskar

Mir Tafseer Nayeem

Papers citing "BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLP"

16 / 16 papers shown

Title
Performance Evaluation of Large Language Models in Bangla Consumer Health Query Summarization Ajwad Abrar Farzana Tabassum Sabbir Ahmed LM&MA ELM AI4MH 41 0 0 08 May 2025
CoT-RAG: Integrating Chain of Thought and Retrieval-Augmented Generation to Enhance Reasoning in Large Language Models Feiyang Li Peng Fang Zhan Shi Arijit Khan Fang Wang D. Feng Weihao Wang Xin Zhang Yongjian Cui ReLM LRM 43 0 0 18 Apr 2025
TituLLMs: A Family of Bangla LLMs with Comprehensive Benchmarking Shahriar Kabir Nahin R. N. Nandi Sagor Sarker Quazi Sarwar Muhtaseem Md. Kowsher Apu Chandraw Shill Md Ibrahim Mehadi Hasan Menon Tareq Al Muntasir Firoj Alam 66 0 0 24 Feb 2025
BeliN: A Novel Corpus for Bengali Religious News Headline Generation using Contextual Feature Fusion Md Osama Ashim Dey Kawsar Ahmed Muhammad Ashad Kabir 42 0 0 03 Jan 2025
Better to Ask in English: Evaluation of Large Language Models on English, Low-resource and Cross-Lingual Settings Krishno Dey Prerona Tarannum Md. Arid Hasan Imran Razzak Usman Naseem 32 3 0 17 Oct 2024
ConVerSum: A Contrastive Learning based Approach for Data-Scarce Solution of Cross-Lingual Summarization Beyond Direct Equivalents Sanzana Karim Lora Rifat Shahriyar 16 0 0 17 Aug 2024
Do Large Language Models Speak All Languages Equally? A Comparative Study in Low-Resource Settings Md. Arid Hasan Prerona Tarannum Krishno Dey Imran Razzak Usman Naseem 29 4 0 05 Aug 2024
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations Md Tahmid Rahman Laskar Sawsan Alqahtani M Saiful Bari Mizanur Rahman Mohammad Abdullah Matin Khan ... Chee Wei Tan Md. Rizwan Parvez Enamul Hoque Shafiq R. Joty Jimmy Huang ELM ALM 25 25 0 04 Jul 2024
Too Late to Train, Too Early To Use? A Study on Necessity and Viability of Low-Resource Bengali LLMs Tamzeed Mahfuz Satak Kumar Dey Ruwad Naswan Hasnaen Adil Khondker Salman Sayeed Haz Sameen Shahgir 29 0 0 29 Jun 2024
Decoding the Diversity: A Review of the Indic AI Research Landscape Sankalp KJ Vinija Jain S. Bhaduri Tamoghna Roy Aman Chadha 47 5 0 13 Jun 2024
Unraveling the Dominance of Large Language Models Over Transformer Models for Bangla Natural Language Inference: A Comprehensive Study Fatema Tuj Johora Faria Mukaffi Bin Moin Asif Iftekher Fahim Pronay Debnath Faisal Muhammad Shah 26 2 0 05 May 2024
Harnessing Large Language Models Over Transformer Models for Detecting Bengali Depressive Social Media Text: A Comprehensive Study Ahmadul Karim Chowdhury Saidur Rahman Sujon Md. Shirajus Salekin Shafi Tasin Ahmmad Sifat Ahmed Khan Md. Hasib Faisal Muhammad Shah AI4MH 32 9 0 14 Jan 2024
Task Contamination: Language Models May Not Be Few-Shot Anymore Changmao Li Jeffrey Flanigan 92 87 0 26 Dec 2023
BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla Abhik Bhattacharjee Tahmid Hasan Wasi Uddin Ahmad Rifat Shahriyar AIMat LM&MA 16 28 0 23 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 303 11,730 0 04 Mar 2022
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 243 1,791 0 17 Sep 2019