KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers

Annual Meeting of the Association for Computational Linguistics (ACL), 2021

22 June 2021

Papers citing "KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers"

50 / 77 papers shown

Title
PublicAgent: Multi-Agent Design Principles From an LLM-Based Open Data Analysis Framework Sina Montazeri Yunhe Feng Kewei Sha LLMAG AI4TS 97 0 0 04 Nov 2025
SQLSpace: A Representation Space for Text-to-SQL to Discover and Mitigate Robustness GapsConference on Empirical Methods in Natural Language Processing (EMNLP), 2025 Neha Srikanth Victor S. Bursztyn Puneet Mathur Ani Nenkova AI4TS 80 0 0 31 Oct 2025
From Questions to Queries: An AI-powered Multi-Agent Framework for Spatial Text-to-SQL Ali Khosravi Kazazi Zhenlong Li M. Lessani Guido Cervone 72 0 0 23 Oct 2025
HES-SQL: Hybrid Reasoning for Efficient Text-to-SQL with Structural Skeleton Guidance Suming Qiu Jing Li Z. Zhou J. Huang Linyuan Qiu Zhijie Sun LRM 56 0 0 10 Oct 2025
Table Question Answering in the Era of Large Language Models: A Comprehensive Survey of Tasks, Methods, and Evaluation Wei Zhou Bolei Ma Annemarie Friedrich Mohsen Mesgar LMTD ELM 121 0 0 08 Oct 2025
BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation for Large Language Models via Lens of Dynamic Interactions Nan Huo Xiaohan Xu Jinyang Li Per Jacobsson Shipei Lin ... Hongyu Liu Chenhao Ma Fatma Ozcan Yannis Papakonstantinou Reynold Cheng LMTD VLM 216 3 0 06 Oct 2025
Exploring Database Normalization Effects on SQL Generation Ryosuke Kohita 68 0 0 02 Oct 2025
Retrieval and Augmentation of Domain Knowledge for Text-to-SQL Semantic Parsing Manasi Patwardhan Ayush Agarwal Shabbirhussain Bhaisaheb Aseem Arora Lovekesh Vig Sunita Sarawagi 76 0 0 01 Oct 2025
RubikSQL: Lifelong Learning Agentic Knowledge Base as an Industrial NL2SQL System Z. Chen Han Li Xinhao Zhang Xiaoyu Chen Chunyin Dong ... Jinxu Li S. Wang Dousheng Zhao Sanhai Gao Guangyi Liu 84 0 0 25 Aug 2025
Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challenges Xiaofeng Wu Alan Ritter Wei Xu LMTD 173 4 0 31 Jul 2025
Text-to-SQL for Enterprise Data Analytics Albert Chen Manas Bundele Gaurav Ahlawat Patrick Stetz Zhitao Wang ... Alexey Ilin Iuliia Melnychuk Chelsea Chueh Joyan Sil Xiaofeng Wang 96 2 0 18 Jul 2025
FinStat2SQL: A Text2SQL Pipeline for Financial Statement Analysis Quang Hung Nguyen Phuong Anh Trinh Phan Quoc Hung Mai Tuan Phong Trinh 83 1 0 29 Jun 2025
Text2VectorSQL: Towards a Unified Interface for Vector Search and SQL Queries Zhengren Wang D. Yao Bozhou Li Dongsheng Ma Bo Li Zhiyu Li Feiyu Xiong Bin Cui Linpeng Tang W. Zhang 66 0 0 29 Jun 2025
MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmark Junjie Xing Yeye He Mengyu Zhou Haoyu Dong Shi Han Lingjiao Chen Dongmei Zhang S. Chaudhuri H. V. Jagadish LMTD ELM LRM 155 3 0 05 Jun 2025
BiomedSQL: Text-to-SQL for Scientific Reasoning on Biomedical Knowledge Bases Mathew J. Koretsky Maya Willey Adi Asija Owen Bianchi Chelsea X. Alvarado ... Nicole Kuznetsov Sungwon Kim M. Nalls Daniel Khashabi F. Faghri 169 1 0 23 May 2025
JOLT-SQL: Joint Loss Tuning of Text-to-SQL with Confusion-aware Noisy Schema Sampling Jinwang Song Hongying Zan Kunli Zhang Lingling Mu Yingjie Han Haobo Hua Min Peng 235 0 0 20 May 2025
Benchmarking AI Models in Software Engineering: A Review, Search Tool, and Unified Approach for Elevating Benchmark Quality Roham Koohestani Philippe de Bekker Begüm Koç Maliheh Izadi VLM 458 0 0 07 Mar 2025
Text-to-SQL Domain Adaptation via Human-LLM Collaborative Data AnnotationInternational Conference on Intelligent User Interfaces (IUI), 2025 Yuan Tian Daniel Lee Fei Wu Tung Mai Kun Qian Siddhartha Sahai Tianyi Zhang Yunyao Li SyDa 476 5 0 21 Feb 2025
MultiTEND: A Multilingual Benchmark for Natural Language to NoSQL Query TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Zhiqian Qin Wailing Ng Jinwei Lu Yuanwei Song Shuaimin Li Chen Zhang 229 1 0 16 Feb 2025
Is Long Context All You Need? Leveraging LLM's Extended Context for NL2SQLProceedings of the VLDB Endowment (PVLDB), 2025 Yeounoh Chung Gaurav Tarlok Kakkar Yu Gan Brenton Milne Fatma Ozcan RALM 559 15 0 21 Jan 2025
How Should We Build A Benchmark? Revisiting 274 Code-Related Benchmarks For LLMs Jialun Cao Yuk-Kit Chan Zixuan Ling Wenxuan Wang Shuqing Li ... Pinjia He Shuai Wang Zibin Zheng Michael R. Lyu Shing-Chi Cheung ALM 565 9 0 18 Jan 2025
Confidence Estimation for Error Detection in Text-to-SQL SystemsAAAI Conference on Artificial Intelligence (AAAI), 2025 Oleg Somov Elena Tutubalina 210 9 0 17 Jan 2025
CEGI: Measuring the trade-off between efficiency and carbon emissions for SLMs and VLMs Abhas Kumar Kapil Pathak Rajesh Kavuru Prabhakar Srinivasan 199 0 0 03 Dec 2024
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL WorkflowsInternational Conference on Learning Representations (ICLR), 2024 Fangyu Lei Jixuan Chen Yuxiao Ye Ruisheng Cao Dongchan Shin ... Caiming Xiong Ruoxi Sun Qian Liu Sida I. Wang Tao Yu LMTD 347 114 0 12 Nov 2024
PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable QueriesNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Mingwen Dong Nischal Ashok Kumar Yiqun Hu Anuj Chauhan Chung-Wei Hang ... Wuwei Lan Henghui Zhu Jiarong Jiang Patrick Ng Zhiguo Wang 200 10 0 14 Oct 2024
From Natural Language to SQL: Review of LLM-based Text-to-SQL Systems Ali Mohammadjafari Anthony Maida Raju N. Gottumukkala AI4TS 352 26 0 01 Oct 2024
DAC: Decomposed Automation Correction for Text-to-SQL Dingzirui Wang Longxu Dou Xuanliang Zhang Qingfu Zhu Wanxiang Che 269 5 0 16 Aug 2024
A Survey on Employing Large Language Models for Text-to-SQL Tasks Liang Shi Zhengju Tang Nan Zhang Xiaotong Zhang Zhi Yang 584 72 0 21 Jul 2024
SQLfuse: Enhancing Text-to-SQL Performance through Comprehensive LLM Synergy Tingkai Zhang Chaoyu Chen Cong Liao Jun Wang Xudong Zhao Hang Yu Jianchao Wang Jianguo Li Wenhui Shi 134 9 0 19 Jul 2024
AMBROSIA: A Benchmark for Parsing Ambiguous Questions into Database Queries Irina Saparina Mirella Lapata 155 29 0 27 Jun 2024
AnnotatedTables: A Large Tabular Dataset with Language Model Annotations Yaojie Hu Ilias Fountalis Jin Tian N. Vasiloglou LMTD 157 7 0 24 Jun 2024
BookSQL: A Large Scale Text-to-SQL Dataset for Accounting Domain Rahul Kumar Amar Raja Dibbu Shrutendra Harsola Vignesh T. Subrahmaniam Ashutosh Modi 151 14 0 12 Jun 2024
Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQL Zijin Hong Zheng Yuan Qinggang Zhang Hao Chen Hao-Heng Chen Feiran Huang Xiao Huang 620 131 0 12 Jun 2024
StatBot.Swiss: Bilingual Open Data Exploration in Natural Language Farhad Nooralahzadeh Yi Zhang Ellery Smith Sabine Maennel Cyril Matthey-Doret Raphaël de Fondville Kurt Stockinger 145 7 0 05 Jun 2024
KU-DMIS at EHRSQL 2024:Generating SQL query via question templatization in EHR Hajung Kim Chanhwi Kim Hoonick Lee Kyochul Jang Jiwoo Lee Kyungjae Lee Gangwoo Kim Jaewoo Kang 224 1 0 22 May 2024
Towards Unbiased Evaluation of Detecting Unanswerable Questions in EHRSQL Yongjin Yang Sihyeon Kim Sangmook Kim Gyubok Lee Se-Young Yun Edward Choi 162 3 0 29 Apr 2024
Is Table Retrieval a Solved Problem? Exploring Join-Aware Multi-Table Retrieval Peter Baile Chen Yi Zhang Dan Roth LMTD 302 30 1 15 Apr 2024
TrustSQL: Benchmarking Text-to-SQL Reliability with Penalty-Based Scoring Gyubok Lee Woosog Chay Seonhee Cho Edward Choi LMTD 336 8 0 23 Mar 2024
Benchmarking the Text-to-SQL Capability of Large Language Models: A Comprehensive Evaluation Bin Zhang Yuxiao Ye Guoqing Du Xiaoru Hu Zhishuai Li Sun Yang Chi Harold Liu Rui Zhao Ziyue Li Hangyu Mao LMTD 280 55 0 05 Mar 2024
Archer: A Human-Labeled Text-to-SQL Dataset with Arithmetic, Commonsense and Hypothetical Reasoning Danna Zheng Mirella Lapata Jeff Z. Pan RALM 227 13 0 19 Feb 2024
Understanding the Effects of Noise in Text-to-SQL: An Examination of the BIRD-Bench Benchmark Niklas Wretblad Fredrik Gordh Riseby Rahul Biswas Amin Ahmadi Oskar Holmström 238 18 0 19 Feb 2024
Improving Demonstration Diversity by Human-Free Fusing for Text-to-SQL Dingzirui Wang Longxu Dou Xuanliang Zhang Qingfu Zhu Wanxiang Che 244 13 0 16 Feb 2024
Improving Generalization in Semantic Parsing by Increasing Natural Language Variation Irina Saparina Mirella Lapata 127 5 0 13 Feb 2024
Evaluating the Data Model Robustness of Text-to-SQL Systems Based on Real User Queries Jonathan Fürst Catherine Kosten Farhad Nooralahzadeh Yi Zhang Kurt Stockinger LMTD 159 13 0 13 Feb 2024
A Survey of Table Reasoning with Large Language Models Xuanliang Zhang Dingzirui Wang Longxu Dou Qingfu Zhu Wanxiang Che LMTD LRM 279 21 0 13 Feb 2024
FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis Chao Zhang Yuren Mao Yijiang Fan Yu Mi Yunjun Gao Lu Chen Dongfang Lou Jinshu Lin 268 54 0 19 Jan 2024
LLM-SQL-Solver: Can LLMs Determine SQL Equivalence? Fuheng Zhao Lawrence Lim Ishtiyaque Ahmad D. Agrawal A. El Abbadi Amr El Abbadi 399 19 0 16 Dec 2023
A Benchmark to Understand the Role of Knowledge Graphs on Large Language Model's Accuracy for Question Answering on Enterprise SQL Databases Juan Sequeda D. Allemang Bryon Jacob 130 44 0 13 Nov 2023
$R^3$ -NL2GQL: A Model Coordination and Knowledge Graph Alignment Approach for NL2GQLConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Yuhang Zhou Yu He Siyu Tian Yuchen Ni Zhangyue Yin ... Chuanjun Ji Sen Liu Xipeng Qiu Guangnan Ye Hongfeng Chai 143 8 0 03 Nov 2023
Benchmarking and Improving Text-to-SQL Generation under Ambiguity Adithya Bhaskar Tushar Tomar Ashutosh Sathe Sunita Sarawagi 243 38 0 20 Oct 2023

All Papers

KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers

Papers citing "KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers"