MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering

30 July 2020

Papers citing "MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering"

50 / 100 papers shown

Title
Evaluating and Modeling Attribution for Cross-Lingual Question Answering Benjamin Muller John Wieting J. Clark Tom Kwiatkowski Sebastian Ruder Livio Baldini Soares Roee Aharoni Jonathan Herzig Xinyi Wang HILM 19 16 0 23 May 2023
VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language Models Dao Xuan-Quy Le Ngoc-Bich Vo The-Duy Phan Xuan-Dung Ngo Bac-Bien Nguyen Van-Tien Nguyen Thi-My-Thanh Nguyen Hong-Phuoc 19 16 0 20 May 2023
xPQA: Cross-Lingual Product Question Answering across 12 Languages Xiaoyu Shen Akari Asai Bill Byrne Adria de Gispert 22 7 0 16 May 2023
Document Understanding Dataset and Evaluation (DUDE) Jordy Van Landeghem Rubèn Pérez Tito Łukasz Borchmann Michal Pietruszka Pawel Józiak ... Bertrand Ackaert Ernest Valveny Matthew Blaschko Sien Moens Tomasz Stanislawek VGen 22 52 0 15 May 2023
Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting Haoyang Huang Tianyi Tang Dongdong Zhang Wayne Xin Zhao Ting Song Yan Xia Furu Wei LRM 27 152 0 11 May 2023
AfriQA: Cross-lingual Open-Retrieval Question Answering for African Languages Odunayo Ogundepo T. Gwadabe Clara E. Rivera J. Clark Sebastian Ruder ... Neo Putini Ndumiso Mngoma Priscilla Amuok R. Iro Sonia Adhiambo34 33 13 0 11 May 2023
MAUPQA: Massive Automatically-created Polish Question Answering Dataset Piotr Rybak 26 12 0 09 May 2023
PAXQA: Generating Cross-lingual Question Answering Examples at Training Scale Bryan Li Chris Callison-Burch 21 6 0 24 Apr 2023
ScandEval: A Benchmark for Scandinavian Natural Language Processing Dan Saattrup Nielsen ELM 18 14 0 03 Apr 2023
Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinations Jungo Kasai Y. Kasai Keisuke Sakaguchi Yutaro Yamada Dragomir R. Radev LM&MA ELM 22 101 0 31 Mar 2023
Can ChatGPT Replace Traditional KBQA Models? An In-depth Analysis of the Question Answering Performance of the GPT LLM Family Yiming Tan Dehai Min Y. Li Wenbo Li Nan Hu Yongrui Chen Guilin Qi AI4MH ELM 47 93 0 14 Mar 2023
Cross-Lingual Question Answering over Knowledge Base as Reading Comprehension Chen Zhang Yuxuan Lai Yansong Feng Xingyu Shen Haowei Du Dongyan Zhao 13 3 0 26 Feb 2023
Complex QA and language models hybrid architectures, Survey Xavier Daull P. Bellot Emmanuel Bruno Vincent Martin Elisabeth Murisasco ELM 26 15 0 17 Feb 2023
PrimeQA: The Prime Repository for State-of-the-Art Multilingual Question Answering Research and Development Avirup Sil Jaydeep Sen Bhavani Iyer M. Franz Kshitij P. Fadnis ... Yulong Li Md Arafat Sultan Riyaz Ahmad Bhat Radu Florian Salim Roukos 15 4 0 23 Jan 2023
Average Is Not Enough: Caveats of Multilingual Evaluation Matúš Pikuliak Marián Simko 6 3 0 03 Jan 2023
ORCA: A Challenging Benchmark for Arabic Language Understanding AbdelRahim Elmadany El Moatez Billah Nagoudi Muhammad Abdul-Mageed ELM 11 40 0 21 Dec 2022
Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval John Wieting J. Clark William W. Cohen Graham Neubig Taylor Berg-Kirkpatrick 8 6 0 21 Dec 2022
Towards leveraging latent knowledge and Dialogue context for real-world conversational question answering Shaomu Tan Denis Paperno RALM 21 0 0 17 Dec 2022
PolQA: Polish Question Answering Dataset Piotr Rybak Piotr Przybyła M. Ogrodniczuk 20 6 0 17 Dec 2022
TyDiP: A Dataset for Politeness Classification in Nine Typologically Diverse Languages A. Srinivasan Eunsol Choi 21 14 0 29 Nov 2022
Spectral Probing Max Müller-Eberstein Rob van der Goot Barbara Plank 6 2 0 21 Oct 2022
Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languages Xinyu Crystina Zhang Nandan Thakur Odunayo Ogundepo Ehsan Kamalloo David Alfonso-Hermelo Xiaoguang Li Qun Liu Mehdi Rezagholizadeh Jimmy J. Lin 16 53 0 18 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 106 92 0 06 Oct 2022
RealTime QA: What's the Answer Right Now? Jungo Kasai Keisuke Sakaguchi Yoichi Takahashi Ronan Le Bras Akari Asai Xinyan Velocity Yu Dragomir R. Radev Noah A. Smith Yejin Choi Kentaro Inui KELM 27 165 0 27 Jul 2022
MIA 2022 Shared Task Submission: Leveraging Entity Representations, Dense-Sparse Hybrids, and Fusion-in-Decoder for Cross-Lingual Question Answering Zhucheng Tu Sarguna Padmanabhan VLM RALM 14 3 0 05 Jul 2022
MIA 2022 Shared Task: Evaluating Cross-lingual Open-Retrieval Question Answering for 16 Diverse Languages Akari Asai Shayne Longpre Jungo Kasai Chia-Hsuan Lee Rui Zhang Junjie Hu Ikuya Yamada J. Clark Eunsol Choi LRM 17 14 0 02 Jul 2022
ZusammenQA: Data Augmentation with Specialized Models for Cross-lingual Open-retrieval Question Answering System Chia-Chien Hung Tommaso Green Robert Litschko Tornike Tsereteli Sotaro Takeshita Marco Bombieri Goran Glavavs Simone Paolo Ponzetto RALM LRM 11 2 0 30 May 2022
Evaluation of Transfer Learning for Polish with a Text-to-Text Model Aleksandra Chrabrowa Lukasz Dragan Karol Grzegorczyk D. Kajtoch Mikołaj Koszowski Robert Mroczkowski Piotr Rybak 29 18 0 18 May 2022
WikiOmnia: generative QA corpus on the whole Russian Wikipedia D. Pisarevskaya Tatiana Shavrina 16 2 0 17 Apr 2022
Resources for Turkish Natural Language Processing: A critical survey Çağrı Çöltekin A. Seza Doğruöz Özlem Çetinoğlu 6 14 0 11 Apr 2022
A Survey on non-English Question Answering Dataset Andrea Chandra Affandy Fahrizain Ibrahim Simon Willyanto Laufried 16 10 0 27 Dec 2021
Unsupervised Dense Information Retrieval with Contrastive Learning Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin Edouard Grave RALM 24 807 0 16 Dec 2021
Evaluating Pretrained Transformer Models for Entity Linking in Task-Oriented Dialog Sai Muralidhar Jayanthi Varsha Embar Karthik Raghunathan 15 6 0 15 Dec 2021
Learning Cross-Lingual IR from an English Retriever Yulong Li M. Franz Md Arafat Sultan Bhavani Iyer Young-Suk Lee Avirup Sil VLM 9 28 0 15 Dec 2021
Semantic Search as Extractive Paraphrase Span Detection Jenna Kanerva Hanna Kitti Li-Hsin Chang Teemu Vahtola Mathias Creutz Filip Ginter 19 2 0 09 Dec 2021
Cross-language Information Retrieval P. Galuscáková Douglas W. Oard Suraj Nair 13 0 0 10 Nov 2021
Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation Benjamin Muller Luca Soldaini Rik Koncel-Kedziorski Eric Lind Alessandro Moschitti LRM 14 7 0 14 Oct 2021
SD-QA: Spoken Dialectal Question Answering for the Real World Fahim Faisal Sharlina Keshava ibn Alam Antonios Anastasopoulos 98 29 0 24 Sep 2021
Investigating Post-pretraining Representation Alignment for Cross-Lingual Question Answering Fahim Faisal Antonios Anastasopoulos 29 4 0 24 Sep 2021
Mr. TyDi: A Multi-lingual Benchmark for Dense Retrieval Xinyu Crystina Zhang Xueguang Ma Peng Shi Jimmy J. Lin 12 110 0 19 Aug 2021
MTG: A Benchmark Suite for Multilingual Text Generation Yiran Chen Zhenqiao Song Xianze Wu Danqing Wang Jingjing Xu Jiaze Chen Hao Zhou Lei Li LRM VLM 30 22 0 13 Aug 2021
QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension Anna Rogers Matt Gardner Isabelle Augenstein 27 163 0 27 Jul 2021
One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval Akari Asai Xinyan Velocity Yu Jungo Kasai Hannaneh Hajishirzi RALM LRM 11 70 0 26 Jul 2021
Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models Nora Kassner Philipp Dufter Hinrich Schütze 21 132 0 01 Feb 2021
English Machine Reading Comprehension Datasets: A Survey Daria Dzendzik Carl Vogel Jennifer Foster RALM AIMat 25 49 0 25 Jan 2021
Pivot Through English: Reliably Answering Multilingual Questions without Document Retrieval Ivan Montero Shayne Longpre Ni Lao Andrew J. Frank Christopher DuBois LRM 19 5 0 28 Dec 2020
ParsiNLU: A Suite of Language Understanding Challenges for Persian Daniel Khashabi Arman Cohan Siamak Shakeri Pedram Hosseini Pouya Pezeshkpour ... Niloofar Safi Samghabadi Mahsa Shafaei Saber Sheybani Ali Tazarv Yadollah Yaghoobzadeh 13 39 0 11 Dec 2020
EXAMS: A Multi-Subject High School Examinations Dataset for Cross-Lingual and Multilingual Question Answering Momchil Hardalov Todor Mihaylov Dimitrina Zlatkova Yoan Dinkov Ivan Koychev Preslav Nakov AI4Ed ELM 31 50 0 05 Nov 2020
XOR QA: Cross-lingual Open-Retrieval Question Answering Akari Asai Jungo Kasai J. Clark Kenton Lee Eunsol Choi Hannaneh Hajishirzi 14 145 0 22 Oct 2020
MLQA: Evaluating Cross-lingual Extractive Question Answering Patrick Lewis Barlas Oğuz Ruty Rinott Sebastian Riedel Holger Schwenk ELM 244 491 0 16 Oct 2019