Confidence Modeling for Neural Semantic Parsing

11 May 2018

Papers citing "Confidence Modeling for Neural Semantic Parsing"

50 / 51 papers shown

Title
Learning to Insert [PAUSE] Tokens for Better ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Eunki Kim Sangryul Kim James Thorne LRM 305 3 0 04 Jun 2025
Calibrating LLMs for Text-to-SQL Parsing by Leveraging Sub-clause Frequencies Terrance Liu Shuyi Wang Daniel Preotiuc-Pietro Yash Chandarana Chirag Gupta 258 2 0 27 May 2025
Uncertainty Quantification in Retrieval Augmented Question Answering Laura Perez-Beltrachini Mirella Lapata RALM 507 4 0 25 Feb 2025
Confidence Estimation for Error Detection in Text-to-SQL SystemsAAAI Conference on Artificial Intelligence (AAAI), 2025 Oleg Somov Elena Tutubalina 282 10 0 17 Jan 2025
Understanding the Effect of Algorithm Transparency of Model Explanations in Text-to-SQL Semantic Parsing Daking Rai Rydia R. Weiland Kayla Margaret Gabriella Herrera Tyler H. Shaw Ziyu Yao 308 2 0 05 Oct 2024
Defining and Evaluating Decision and Composite Risk in Language Models Applied to Natural Language Inference Ke Shen Mayank Kejriwal 196 2 0 04 Aug 2024
Handling Ontology Gaps in Semantic Parsing Andrea Bacciu Marco Damonte Marco Basaldella Emilio Monti 181 2 0 27 Jun 2024
Equipping Transformer with Random-Access Reading for Long-Context Understanding Chenghao Yang Zi Yang Nan Hua 164 1 0 21 May 2024
Interpreting Predictive Probabilities: Model Confidence or Human Label Variation? Joris Baan Raquel Fernández Barbara Plank Wilker Aziz 312 16 0 25 Feb 2024
Towards Trustworthy Reranking: A Simple yet Effective Abstention Mechanism Hippolyte Gisserot-Boukhlef Manuel Faysse Emmanuel Malherbe C´eline Hudelot Pierre Colombo 419 5 0 20 Feb 2024
Uncertainty-aware Language Modeling for Selective Question Answering Qi Yang Shreya Ravikumar F. Schmitt-Ulms S. Lolla Ege Demir ... Sadhana Lolla Elaheh Ahmadi Daniela Rus Alexander Amini Alejandro Perez 106 11 0 26 Nov 2023
Predicting generalization performance with correctness discriminatorsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Yuekun Yao Alexander Koller 364 1 0 15 Nov 2023
A Formalism and Approach for Improving Robustness of Large Language Models Using Risk-Adjusted Confidence Scores Ke Shen Mayank Kejriwal 195 2 0 05 Oct 2023
Selectively Answering Ambiguous QuestionsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Jeremy R. Cole Michael J.Q. Zhang D. Gillick Julian Martin Eisenschlos Bhuwan Dhingra Jacob Eisenstein UQLM 437 48 0 24 May 2023
Uncertainty-Aware Bootstrap Learning for Joint Extraction on Distantly-Supervised DataAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Yufei Li Xiao Yu Yanchi Liu Haifeng Chen Cong Liu UQCV SSL 177 10 0 05 May 2023
R-U-SURE? Uncertainty-Aware Code Suggestions By Maximizing Utility Across Random User IntentsInternational Conference on Machine Learning (ICML), 2023 Daniel D. Johnson Daniel Tarlow Christian J. Walder 167 10 0 01 Mar 2023
Learning to Reject with a Fixed Predictor: Application to DecontextualizationInternational Conference on Learning Representations (ICLR), 2023 Christopher Mohri D. Andor Eunsol Choi Michael Collins BDL 167 29 0 22 Jan 2023
Know What I don't Know: Handling Ambiguous and Unanswerable Questions for Text-to-SQL Bin Wang Yan Gao Zhoujun Li Jian-Guang Lou 238 10 0 17 Dec 2022
Calibrated Interpretation: Confidence Estimation in Semantic ParsingTransactions of the Association for Computational Linguistics (TACL), 2022 Elias Stengel-Eskin Benjamin Van Durme UQLM 406 34 0 14 Nov 2022
Eeny, meeny, miny, moe. How to choose data for morphological inflectionConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 S. Muradoglu Mans Hulden 149 15 0 26 Oct 2022
Confidence-Guided Learning Process for Continuous Classification of Time SeriesInternational Conference on Information and Knowledge Management (CIKM), 2022 Chenxi Sun Moxian Song D. Cai B. Zhang linda Qiao Hongyan Li 121 6 0 14 Aug 2022
Training Naturalized Semantic Parsers with Very Little DataInternational Joint Conference on Artificial Intelligence (IJCAI), 2022 Subendhu Rongali Konstantine Arkoudas M. Rubino Wael Hamza 233 12 0 29 Apr 2022
Reliable Visual Question Answering: Abstain Rather Than Answer IncorrectlyEuropean Conference on Computer Vision (ECCV), 2022 Spencer Whitehead Suzanne Petryk Vedaad Shakib Joseph E. Gonzalez Trevor Darrell Anna Rohrbach Marcus Rohrbach 345 73 0 28 Apr 2022
Calibration of Machine Reading Systems at ScaleFindings (Findings), 2022 Shehzaad Dhuliawala Leonard Adolphs Rajarshi Das Mrinmaya Sachan 291 12 0 20 Mar 2022
Pay More Attention to History: A Context Modelling Strategy for Conversational Text-to-SQL Yuntao Li Hanchun Zhang Yutian Li Sirui Wang Wei Wu Yan Zhang 244 8 0 16 Dec 2021
A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applications Xinlei Zhou Han Liu Farhad Pourpanah T. Zeng Xizhao Wang UQCV UD 302 73 0 03 Nov 2021
The Case for Claim Difficulty Assessment in Automatic Fact Checking Prakhar Singh Anubrata Das Junjie Li Matthew Lease 143 10 0 20 Sep 2021
Uncertainty-Aware Balancing for Multilingual and Multi-Domain Neural Machine Translation TrainingConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 Minghao Wu Yitong Li Meng Zhang Liangyou Li Gholamreza Haffari Qun Liu 192 25 0 06 Sep 2021
Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering Siddharth Karamcheti Ranjay Krishna Li Fei-Fei Christopher D. Manning 227 96 0 06 Jul 2021
Knowing More About Questions Can Help: Improving Calibration in Question AnsweringFindings (Findings), 2021 Shujian Zhang Chengyue Gong Eunsol Choi UQLM 237 62 0 02 Jun 2021
Toward Code Generation: A Survey and Lessons from Semantic Parsing Celine Lee Justin Emile Gottschlich Dan Roth Intel Labs 3DV 139 18 0 26 Apr 2021
How Can We Know When Language Models Know? On the Calibration of Language Models for Question AnsweringTransactions of the Association for Computational Linguistics (TACL), 2020 Zhengbao Jiang Jun Araki Haibo Ding Graham Neubig UQCV 389 507 0 02 Dec 2020
Data Troubles in Sentence Level Confidence Estimation for Machine Translation Ciprian Chelba Junpei Zhou Yuezhang Li Li Hideto Kazawa J. Klingner Mengmeng Niu 138 5 0 26 Oct 2020
Modeling Token-level Uncertainty to Learn Unknown Concepts in SLU via Calibrated Dirichlet Prior RNN Yilin Shen Wenhu Chen Hongxia Jin UQCV BDL 146 5 0 16 Oct 2020
Self-Paced Learning for Neural Machine TranslationConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Boyi Deng Baosong Yang Yang Li Yikai Zhou Lidia S. Chao Haibo Zhang Boxing Chen 210 51 0 09 Oct 2020
Photon: A Robust Cross-Domain Text-to-SQL SystemAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Jichuan Zeng Xi Lin Caiming Xiong R. Socher Michael R. Lyu Irwin King Guosheng Lin 181 55 0 30 Jul 2020
Selective Question Answering under Domain Shift Amita Kamath Robin Jia Abigail Z. Jacobs OOD 230 242 0 16 Jun 2020
Unsupervised Quality Estimation for Neural Machine Translation M. Fomicheva Shuo Sun Lisa Yankovskaya Frédéric Blain Francisco Guzmán Mark Fishel Nikolaos Aletras Vishrav Chaudhary Lucia Specia UQLM 291 248 0 21 May 2020
Estimating predictive uncertainty for rumour verification models E. Kochkina Maria Liakata 117 18 0 14 May 2020
Learning to Detect Unacceptable Machine Translations for Downstream Tasks Meng Zhang Xin Jiang Yang Liu Qun Liu 96 0 0 08 May 2020
An Imitation Game for Learning Semantic Parsers from User InteractionConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Ziyu Yao Yiqi Tang Anuj Kumar Huan Sun Yu-Chuan Su 328 36 0 02 May 2020
Calibrating Structured Output Predictors for Natural Language ProcessingAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Abhyuday N. Jagannatha Hong-ye Yu 334 30 0 09 Apr 2020
SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge BasesAAAI Conference on Artificial Intelligence (AAAI), 2020 Yawei Sun Lingling Zhang Gong Cheng Yuzhong Qu 165 134 0 31 Mar 2020
From Natural Language Instructions to Complex Processes: Issues in Chaining Trigger Action Rules Nobuhiro Ito Yu Suzuki Akiko Aizawa AI4CE 147 7 0 08 Jan 2020
Deep Bayesian Active Learning for Multiple Correct Outputs Khaled Jedoui Ranjay Krishna Michael S. Bernstein Li Fei-Fei BDL OOD UQCV 265 14 0 02 Dec 2019
Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case StudyConference on Empirical Methods in Natural Language Processing (EMNLP), 2019 Ziyu Yao Yu-Chuan Su Huan Sun Anuj Kumar 166 84 0 11 Oct 2019
Improving Back-Translation with Uncertainty-based Confidence EstimationConference on Empirical Methods in Natural Language Processing (EMNLP), 2019 Shuo Wang Yang Liu Chao Wang Huanbo Luan Maosong Sun UQLM 207 83 0 31 Aug 2019
Controlling Risk of Web Question AnsweringAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2019 Lixin Su Jiafeng Guo Yixing Fan Yanyan Lan Xueqi Cheng 167 9 0 24 May 2019
Robust Spoken Language Understanding via Paraphrasing Avik Ray Yilin Shen Hongxia Jin 221 13 0 17 Sep 2018
Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning Ziyu Yao Xiujun Li Jianfeng Gao Brian M. Sadler Huan Sun 215 36 0 21 Aug 2018