TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages

10 March 2020

Papers citing "TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages"

50 / 400 papers shown

Title
Multilingual Sentence-Level Semantic Search using Meta-Distillation Learning Meryem M'hamdi Jonathan May Franck Dernoncourt Trung Bui Seunghyun Yoon FedML 21 1 0 15 Sep 2023
BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Models Wei Qi Leong Jian Gang Ngui Yosephine Susanto Hamsawardhini Rengarajan Kengatharaiyer Sarveswaran William-Chandra Tjhi 21 9 0 12 Sep 2023
AGent: A Novel Pipeline for Automatically Creating Unanswerable Questions Son Quoc Tran Gia-Huy Do Phong Nguyen-Thuan Do Matt Kretchmar Xinya Du 21 0 0 10 Sep 2023
FIAT: Fusing learning paradigms with Instruction-Accelerated Tuning Xinyi Wang John Wieting J. Clark CLL ALM 24 1 0 09 Sep 2023
HAE-RAE Bench: Evaluation of Korean Knowledge in Language Models Guijin Son Hanwool Albert Lee Suwan Kim Huiseo Kim Jaecheol Lee Je Won Yeom Jihyu Jung Jung Woo Kim Songseong Kim RALM ELM 26 20 0 06 Sep 2023
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants Lucas Bandarkar Davis Liang Benjamin Muller Mikel Artetxe Satya Narayan Shukla Don Husa Naman Goyal Abhinandan Krishnan Luke Zettlemoyer Madian Khabsa 28 128 0 31 Aug 2023
Measuring Spurious Correlation in Classification: 'Clever Hans' in Translationese Angana Borah Daria Pylypenko C. España-Bonet Josef van Genabith 20 4 0 25 Aug 2023
Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning Jiasheng Ye Zaixiang Zheng Yu Bao Lihua Qian Quanquan Gu DiffM 52 14 0 23 Aug 2023
Instruction Tuning for Large Language Models: A Survey Shengyu Zhang Linfeng Dong Xiaoya Li Sen Zhang Xiaofei Sun ... Jiwei Li Runyi Hu Tianwei Zhang Fei Wu Guoyin Wang LM&MA 21 532 0 21 Aug 2023
Single-Sentence Reader: A Novel Approach for Addressing Answer Position Bias Son Quoc Tran Matt Kretchmar 11 0 0 08 Aug 2023
HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attribution Ehsan Kamalloo A. Jafari Xinyu Crystina Zhang Nandan Thakur Jimmy J. Lin 18 41 0 31 Jul 2023
MegaWika: Millions of reports and their sources across 50 diverse languages Samuel Barham Orion Weller Michelle Yuan Kenton W. Murray M. Yarmohammadi ... Alexander Martin Anqi Liu Aaron Steven White Jordan L. Boyd-Graber Benjamin Van Durme SyDa 26 4 0 13 Jul 2023
A Comprehensive Overview of Large Language Models Humza Naveed Asad Ullah Khan Shi Qiu Muhammad Saqib Saeed Anwar Muhammad Usman Naveed Akhtar Nick Barnes Ajmal Saeed Mian OffRL 46 523 0 12 Jul 2023
PolyLM: An Open Source Polyglot Large Language Model Xiangpeng Wei Hao-Ran Wei Huan Lin Tianhao Li Pei Zhang ... Yu Bowen Dayiheng Liu Baosong Yang Fei Huang Jun Xie LRM 32 55 0 12 Jul 2023
Benchmarking Large Language Model Capabilities for Conditional Generation Joshua Maynez Priyanka Agrawal Sebastian Gehrmann ELM LM&MA 25 28 0 29 Jun 2023
Democratizing LLMs for Low-Resource Languages by Leveraging their English Dominant Abilities with Linguistically-Diverse Prompts Xuan-Phi Nguyen Sharifah Mahani Aljunied Shafiq R. Joty Lidong Bing 18 32 0 20 Jun 2023
Soft Language Clustering for Multilingual Model Pre-training Jiali Zeng Yu Jiang Yongjing Yin Yingqi Jing Fandong Meng Binghuai Lin Yunbo Cao Jie Zhou 20 4 0 13 Jun 2023
How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources Yizhong Wang Hamish Ivison Pradeep Dasigi Jack Hessel Tushar Khot ... David Wadden Kelsey MacMillan Noah A. Smith Iz Beltagy Hannaneh Hajishirzi ALM ELM 11 367 0 07 Jun 2023
Model Spider: Learning to Rank Pre-Trained Models Efficiently Yi-Kai Zhang Ting Huang Yao-Xiang Ding De-Chuan Zhan Han-Jia Ye 19 23 0 06 Jun 2023
Cross-Lingual Transfer with Target Language-Ready Task Adapters Marinela Parović Alan Ansell Ivan Vulić Anna Korhonen 18 8 0 05 Jun 2023
Pre-Trained Language-Meaning Models for Multilingual Parsing and Generation Chunliu Wang Huiyuan Lai Malvina Nissim Johan Bos 17 13 0 31 May 2023
Why Does Zero-Shot Cross-Lingual Generation Fail? An Explanation and a Solution Tianjian Li Kenton W. Murray 29 23 0 27 May 2023
Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint Averaging Fabian David Schmidt Ivan Vulić Goran Glavavs 13 8 0 26 May 2023
Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages Shivanshu Gupta Yoshitomo Matsubara Ankita N. Chadha Alessandro Moschitti 14 2 0 25 May 2023
Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language Models Geewook Kim Hodong Lee D. Kim Haeji Jung S. Park Yoon Kim Sangdoo Yun Taeho Kil Bado Lee Seunghyun Park VLM 35 4 0 24 May 2023
LAraBench: Benchmarking Arabic AI with Large Language Models Ahmed Abdelali Hamdy Mubarak Shammur A. Chowdhury Maram Hasanain Basel Mousi ... Yousseif Elshahawy Ahmed M. Ali Nadir Durrani Natasa Milic-Frayling Firoj Alam ELM LM&MA 16 19 0 24 May 2023
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer Akari Asai Sneha Kudugunta Xinyan Velocity Yu Terra Blevins Hila Gonen Machel Reid Yulia Tsvetkov Sebastian Ruder Hannaneh Hajishirzi 31 54 0 24 May 2023
GlobalBench: A Benchmark for Global Progress in Natural Language Processing Yueqi Song Catherine Cui Simran Khanuja Pengfei Liu Fahim Faisal ... Alham Fikri Aji Samuel Cahyawijaya Yulia Tsvetkov Antonios Anastasopoulos Graham Neubig 17 7 0 24 May 2023
Evaluating and Modeling Attribution for Cross-Lingual Question Answering Benjamin Muller John Wieting J. Clark Tom Kwiatkowski Sebastian Ruder Livio Baldini Soares Roee Aharoni Jonathan Herzig Xinyi Wang HILM 19 16 0 23 May 2023
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations Jonas Pfeiffer Francesco Piccinno Massimo Nicosia Xinyi Wang Machel Reid Sebastian Ruder VLM LRM 34 27 0 23 May 2023
$μ$ PLAN: Summarizing using a Content Plan as Cross-Lingual Bridge Fantine Huot Joshua Maynez Chris Alberti Reinald Kim Amplayo Priyanka Agrawal Constanza Fierro Shashi Narayan Mirella Lapata 15 7 0 23 May 2023
mPMR: A Multilingual Pre-trained Machine Reader at Scale Weiwen Xu Xin Li Wai Lam Lidong Bing LRM 30 5 0 23 May 2023
Continually Improving Extractive QA via Human Feedback Ge Gao Hung-Ting Chen Yoav Artzi Eunsol Choi 24 12 0 21 May 2023
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages Sebastian Ruder J. Clark Alexander Gutkin Mihir Kale Min Ma ... Dan Garrette R. Ingle Melvin Johnson Dmitry Panteleev Partha P. Talukdar ELM 22 38 0 19 May 2023
Cross-Lingual Supervision improves Large Language Models Pre-training Andrea Schioppa Xavier Garcia Orhan Firat LRM 15 12 0 19 May 2023
mLongT5: A Multilingual and Efficient Text-To-Text Transformer for Longer Sequences David C. Uthus Santiago Ontañón Joshua Ainslie Mandy Guo VLM 25 10 0 18 May 2023
PaLM 2 Technical Report Rohan Anil Andrew M. Dai Orhan Firat Melvin Johnson Dmitry Lepikhin ... Ce Zheng Wei Zhou Denny Zhou Slav Petrov Yonghui Wu ReLM LRM 58 1,138 0 17 May 2023
Towards More Robust NLP System Evaluation: Handling Missing Scores in Benchmarks Anas Himmi Ekhine Irurozki Nathan Noiry Stéphan Clémençon Pierre Colombo 26 5 0 17 May 2023
xPQA: Cross-Lingual Product Question Answering across 12 Languages Xiaoyu Shen Akari Asai Bill Byrne Adria de Gispert 22 7 0 16 May 2023
AMTSS: An Adaptive Multi-Teacher Single-Student Knowledge Distillation Framework For Multilingual Language Inference Qianglong Chen Feng Ji Feng-Lin Li Guohai Xu Ming Yan Ji Zhang Yin Zhang 15 0 0 13 May 2023
AfriQA: Cross-lingual Open-Retrieval Question Answering for African Languages Odunayo Ogundepo T. Gwadabe Clara E. Rivera J. Clark Sebastian Ruder ... Neo Putini Ndumiso Mngoma Priscilla Amuok R. Iro Sonia Adhiambo34 33 13 0 11 May 2023
What is the best recipe for character-level encoder-only modelling? Kris Cao 32 2 0 09 May 2023
PAXQA: Generating Cross-lingual Question Answering Examples at Training Scale Bryan Li Chris Callison-Burch 21 6 0 24 Apr 2023
UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretraining Hyung Won Chung Noah Constant Xavier Garcia Adam Roberts Yi Tay Sharan Narang Orhan Firat 21 49 0 18 Apr 2023
VECO 2.0: Cross-lingual Language Model Pre-training with Multi-granularity Contrastive Learning Zhen-Ru Zhang Chuanqi Tan Songfang Huang Fei Huang VLM 24 5 0 17 Apr 2023
Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinations Jungo Kasai Y. Kasai Keisuke Sakaguchi Yutaro Yamada Dragomir R. Radev LM&MA ELM 22 101 0 31 Mar 2023
MEGA: Multilingual Evaluation of Generative AI Kabir Ahuja Harshita Diddee Rishav Hada Millicent Ochieng Krithika Ramesh ... T. Ganu Sameer Segal Maxamed Axmed Kalika Bali Sunayana Sitaram LM&MA LRM ELM 19 264 0 22 Mar 2023
Neural Architecture Search for Effective Teacher-Student Knowledge Transfer in Language Models Aashka Trivedi Takuma Udagawa Michele Merler Rameswar Panda Yousef El-Kurdi Bishwaranjan Bhattacharjee 22 6 0 16 Mar 2023
Revealing Weaknesses of Vietnamese Language Models Through Unanswerable Questions in Machine Reading Comprehension Son Quoc Tran Phong Nguyen-Thuan Do Kiet Van Nguyen N. Nguyen 37 0 0 16 Mar 2023
AmQA: Amharic Question Answering Dataset Tilahun Abedissa Ricardo Usbeck Yaregal Assabie 22 1 0 06 Mar 2023