KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers

Annual Meeting of the Association for Computational Linguistics (ACL), 2021

22 June 2021

Papers citing "KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers"

27 / 77 papers shown

Title
MAGNIFICo: Evaluating the In-Context Learning Ability of Large Language Models to Generalize to Novel InterpretationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Arkil Patel S. Bhattamishra Siva Reddy Dzmitry Bahdanau 199 7 0 18 Oct 2023
Selective Demonstrations for Cross-domain Text-to-SQLConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Shuaichen Chang Eric Fosler-Lussier 200 30 0 10 Oct 2023
SEED: Domain-Specific Data Curation With Large Language Models Zui Chen Lei Cao Samuel Madden Tim Kraska Zeyuan Shang Ju Fan Nan Tang Zihui Gu Chunwei Liu Michael Cafarella 230 12 0 01 Oct 2023
Text-to-SQL Empowered by Large Language Models: A Benchmark EvaluationProceedings of the VLDB Endowment (PVLDB), 2023 Dawei Gao Haibin Wang Yaliang Li Xiuyu Sun Yichen Qian Bolin Ding Jingren Zhou AI4TS 462 447 0 29 Aug 2023
Adapt and Decompose: Efficient Generalization of Text-to-SQL via Domain Adapted Least-To-Most Prompting Aseem Arora Shabbirhussain Bhaisaheb Harshit Nigam Manasi Patwardhan Lovekesh Vig Gautam M. Shroff 170 13 0 01 Aug 2023
InterCode: Standardizing and Benchmarking Interactive Coding with Execution FeedbackNeural Information Processing Systems (NeurIPS), 2023 John Yang Akshara Prabhakar Karthik Narasimhan Shunyu Yao 390 158 0 26 Jun 2023
Interleaving Pre-Trained Language Models and Large Language Models for Zero-Shot NL2SQL Generation Zihui Gu Ju Fan Nan Tang Songyue Zhang Yuxin Zhang Zui Chen Lei Cao Guoliang Li Sam Madden Xiaoyong Du 184 30 0 15 Jun 2023
ScienceBenchmark: A Complex Real-World Benchmark for Evaluating Natural Language to SQL SystemsProceedings of the VLDB Endowment (PVLDB), 2023 Yi Zhang Jan Deriu George Katsogiannis-Meimarakis Catherine Kosten Georgia Koutrika Kurt Stockinger 173 46 0 07 Jun 2023
UNITE: A Unified Benchmark for Text-to-SQL Evaluation Wuwei Lan Zhiguo Wang Anuj Chauhan Henghui Zhu Alexander Hanbo Li ... Jiarong Jiang Stephen M. Ash Vittorio Castelli Patrick Ng Bing Xiang ELM LMTD 192 17 0 25 May 2023
Skill-Based Few-Shot Selection for In-Context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Shengnan An Bo Zhou Zeqi Lin Qiang Fu B. Chen Nanning Zheng Weizhu Chen Jian-Guang Lou 311 42 0 23 May 2023
Error Detection for Text-to-SQL Semantic ParsingConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Shijie Chen Ziru Chen Huan Sun Yu-Chuan Su 215 12 0 23 May 2023
MultiTabQA: Generating Tabular Answers for Multi-Table Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Vaishali Pal Andrew Yates Evangelos Kanoulas Maarten de Rijke LMTD 234 38 0 22 May 2023
Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLsNeural Information Processing Systems (NeurIPS), 2023 Jinyang Li Binyuan Hui Ge Qu Jiaxi Yang Binhua Li ... Guoliang Li Kevin C. C. Chang Fei Huang Reynold Cheng Yongbin Li LMTD 356 649 0 04 May 2023
From Words to Code: Harnessing Data for Program Synthesis from Natural Language Anirudh Khatry Joyce Cahoon Jordan Henkel Shaleen Deep Venkatesh Emani ... Vu Le Mohammad Raza Sherry Shi Mukul Singh A. Tiwari 202 16 0 02 May 2023
Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL RobustnessInternational Conference on Learning Representations (ICLR), 2023 Shuaichen Chang Jun Wang Mingwen Dong Lin Pan Henghui Zhu ... William Yang Wang Zhiguo Wang Vittorio Castelli Patrick Ng Bing Xiang OOD 269 50 0 21 Jan 2023
EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health RecordsNeural Information Processing Systems (NeurIPS), 2023 Gyubok Lee Hyeonji Hwang Seongsu Bae Yeonsu Kwon W. Shin Seongjun Yang Minjoon Seo Jong-Yeup Kim Edward Choi 232 38 0 16 Jan 2023
Structured Case-based Reasoning for Inference-time Adaptation of Text-to-SQL parsersAAAI Conference on Artificial Intelligence (AAAI), 2023 Abhijeet Awasthi Soumen Chakrabarti Sunita Sarawagi 201 5 0 10 Jan 2023
Natural Language to Code Generation in Interactive Data Science NotebooksAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Pengcheng Yin Wen-Ding Li Kefan Xiao Abhishek Rao Yeming Wen ... Paige Bailey Michele Catasta Henryk Michalewski Oleksandr Polozov Charles Sutton 190 90 0 19 Dec 2022
Diverse Parallel Data Synthesis for Cross-Database Adaptation of Text-to-SQL ParsersConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Abhijeet Awasthi Ashutosh Sathe Sunita Sarawagi 187 8 0 29 Oct 2022
XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic ParsingConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Peng Shi Rui Zhang Richard He Bai Jimmy J. Lin RALM 179 54 0 25 Oct 2022
Searching for Better Database Queries in the Outputs of Semantic ParsersFindings (Findings), 2022 A. Osokin Irina Saparina R. B. Yarullin 126 0 0 13 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and reviewNature Machine Intelligence (Nat. Mach. Intell.), 2022 Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Robert Bamler Zhijing Jin 512 128 0 06 Oct 2022
WildQA: In-the-Wild Video Question AnsweringInternational Conference on Computational Linguistics (COLING), 2022 Santiago Castro Naihao Deng Pingxuan Huang Mihai Burzo Amélie Reymond 274 9 0 14 Sep 2022
Knowledge Base Question Answering: A Semantic Parsing PerspectiveConference on Automated Knowledge Base Construction (AKBC), 2022 Yu Gu Vardaan Pahuja Gong Cheng Yu-Chuan Su 311 31 0 12 Sep 2022
Recent Advances in Text-to-SQL: A Survey of What We Have and What We ExpectInternational Conference on Computational Linguistics (COLING), 2022 Naihao Deng Yulong Chen Yue Zhang 172 68 0 22 Aug 2022
Weakly Supervised Text-to-SQL Parsing through Question Decomposition Tomer Wolfson Daniel Deutch Jonathan Berant ReLM 218 22 0 12 Dec 2021
Meta-learning via Language Model In-context Tuning Yanda Chen Ruiqi Zhong Sheng Zha George Karypis He He 466 188 0 15 Oct 2021