Confidence Modeling for Neural Semantic Parsing

11 May 2018

Papers citing "Confidence Modeling for Neural Semantic Parsing"

50 / 51 papers shown

Title
Uncertainty Quantification in Retrieval Augmented Question Answering Laura Perez-Beltrachini Mirella Lapata RALM 43 0 0 25 Feb 2025
Confidence Estimation for Error Detection in Text-to-SQL Systems Oleg Somov Elena Tutubalina 43 1 0 17 Jan 2025
Understanding the Effect of Algorithm Transparency of Model Explanations in Text-to-SQL Semantic Parsing Daking Rai Rydia R. Weiland Kayla Margaret Gabriella Herrera Tyler H. Shaw Ziyu Yao 31 1 0 05 Oct 2024
Defining and Evaluating Decision and Composite Risk in Language Models Applied to Natural Language Inference Ke Shen M. Kejriwal 29 0 0 04 Aug 2024
Handling Ontology Gaps in Semantic Parsing Andrea Bacciu Marco Damonte Marco Basaldella Emilio Monti 25 1 0 27 Jun 2024
Equipping Transformer with Random-Access Reading for Long-Context Understanding Chenghao Yang Zi Yang Nan Hua 32 1 0 21 May 2024
Interpreting Predictive Probabilities: Model Confidence or Human Label Variation? Joris Baan Raquel Fernández Barbara Plank Wilker Aziz 43 10 0 25 Feb 2024
Towards Trustworthy Reranking: A Simple yet Effective Abstention Mechanism Hippolyte Gisserot-Boukhlef Manuel Faysse Emmanuel Malherbe C´eline Hudelot Pierre Colombo 32 2 0 20 Feb 2024
Uncertainty-aware Language Modeling for Selective Question Answering Qi Yang Shreya Ravikumar F. Schmitt-Ulms S. Lolla Ege Demir ... Sadhana Lolla Elaheh Ahmadi Daniela Rus Alexander Amini Alejandro Perez 14 7 0 26 Nov 2023
Predicting generalization performance with correctness discriminators Yuekun Yao Alexander Koller 27 0 0 15 Nov 2023
A Formalism and Approach for Improving Robustness of Large Language Models Using Risk-Adjusted Confidence Scores Ke Shen M. Kejriwal 14 2 0 05 Oct 2023
Selectively Answering Ambiguous Questions Jeremy R. Cole Michael J.Q. Zhang D. Gillick Julian Martin Eisenschlos Bhuwan Dhingra Jacob Eisenstein UQLM 18 26 0 24 May 2023
Uncertainty-Aware Bootstrap Learning for Joint Extraction on Distantly-Supervised Data Yufei Li Xiao Yu Yanchi Liu Haifeng Chen Cong Liu UQCV SSL 8 6 0 05 May 2023
R-U-SURE? Uncertainty-Aware Code Suggestions By Maximizing Utility Across Random User Intents Daniel D. Johnson Daniel Tarlow Christian J. Walder 21 6 0 01 Mar 2023
Learning to Reject with a Fixed Predictor: Application to Decontextualization Christopher Mohri D. Andor Eunsol Choi Michael Collins BDL 28 22 0 22 Jan 2023
Know What I don't Know: Handling Ambiguous and Unanswerable Questions for Text-to-SQL Bin Wang Yan Gao Zhoujun Li Jian-Guang Lou 16 6 0 17 Dec 2022
Calibrated Interpretation: Confidence Estimation in Semantic Parsing Elias Stengel-Eskin Benjamin Van Durme UQLM 37 24 0 14 Nov 2022
Eeny, meeny, miny, moe. How to choose data for morphological inflection S. Muradoglu Mans Hulden 13 12 0 26 Oct 2022
Confidence-Guided Learning Process for Continuous Classification of Time Series Chenxi Sun Moxian Song D. Cai B. Zhang linda Qiao Hongyan Li 14 6 0 14 Aug 2022
Training Naturalized Semantic Parsers with Very Little Data Subendhu Rongali Konstantine Arkoudas M. Rubino Wael Hamza 11 11 0 29 Apr 2022
Reliable Visual Question Answering: Abstain Rather Than Answer Incorrectly Spencer Whitehead Suzanne Petryk Vedaad Shakib Joseph E. Gonzalez Trevor Darrell Anna Rohrbach Marcus Rohrbach 26 54 0 28 Apr 2022
Calibration of Machine Reading Systems at Scale S. Dhuliawala Leonard Adolphs Rajarshi Das Mrinmaya Sachan 14 11 0 20 Mar 2022
Pay More Attention to History: A Context Modelling Strategy for Conversational Text-to-SQL Yuntao Li Hanchun Zhang Yutian Li Sirui Wang Wei Yu Wu Yan Zhang 19 8 0 16 Dec 2021
A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applications Xinlei Zhou Han Liu Farhad Pourpanah T. Zeng Xizhao Wang UQCV UD 19 58 0 03 Nov 2021
The Case for Claim Difficulty Assessment in Automatic Fact Checking Prakhar Singh Anubrata Das J. Li Matthew Lease 24 9 0 20 Sep 2021
Uncertainty-Aware Balancing for Multilingual and Multi-Domain Neural Machine Translation Training Minghao Wu Yitong Li Meng Zhang Liangyou Li Gholamreza Haffari Qun Liu 10 21 0 06 Sep 2021
Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering Siddharth Karamcheti Ranjay Krishna Li Fei-Fei Christopher D. Manning 26 88 0 06 Jul 2021
Knowing More About Questions Can Help: Improving Calibration in Question Answering Shujian Zhang Chengyue Gong Eunsol Choi UQLM 25 58 0 02 Jun 2021
Toward Code Generation: A Survey and Lessons from Semantic Parsing Celine Lee Justin Emile Gottschlich Dan Roth Intel Labs 3DV 15 15 0 26 Apr 2021
How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering Zhengbao Jiang Jun Araki Haibo Ding Graham Neubig UQCV 12 409 0 02 Dec 2020
Data Troubles in Sentence Level Confidence Estimation for Machine Translation Ciprian Chelba Junpei Zhou Yuezhang Li Li Hideto Kazawa J. Klingner Mengmeng Niu 13 4 0 26 Oct 2020
Modeling Token-level Uncertainty to Learn Unknown Concepts in SLU via Calibrated Dirichlet Prior RNN Yilin Shen Wenhu Chen Hongxia Jin UQCV BDL 6 5 0 16 Oct 2020
Self-Paced Learning for Neural Machine Translation Yu Wan Baosong Yang Derek F. Wong Yikai Zhou Lidia S. Chao Haibo Zhang Boxing Chen 56 49 0 09 Oct 2020
Photon: A Robust Cross-Domain Text-to-SQL System Jichuan Zeng Xi Victoria Lin Caiming Xiong R. Socher M. Lyu Irwin King S. Hoi 23 52 0 30 Jul 2020
Selective Question Answering under Domain Shift Amita Kamath Robin Jia Percy Liang OOD 6 206 0 16 Jun 2020
Unsupervised Quality Estimation for Neural Machine Translation M. Fomicheva Shuo Sun Lisa Yankovskaya Frédéric Blain Francisco Guzmán Mark Fishel Nikolaos Aletras Vishrav Chaudhary Lucia Specia UQLM 4 181 0 21 May 2020
Estimating predictive uncertainty for rumour verification models E. Kochkina Maria Liakata 15 18 0 14 May 2020
Learning to Detect Unacceptable Machine Translations for Downstream Tasks Meng Zhang Xin Jiang Yang Liu Qun Liu 6 0 0 08 May 2020
An Imitation Game for Learning Semantic Parsers from User Interaction Ziyu Yao Yiqi Tang Wen-tau Yih Huan Sun Yu-Chuan Su 20 34 0 02 May 2020
Calibrating Structured Output Predictors for Natural Language Processing Abhyuday N. Jagannatha Hong-ye Yu 15 28 0 09 Apr 2020
SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Bases Yawei Sun Lingling Zhang Gong Cheng Yuzhong Qu 14 112 0 31 Mar 2020
From Natural Language Instructions to Complex Processes: Issues in Chaining Trigger Action Rules Nobuhiro Ito Yu Suzuki Akiko Aizawa AI4CE 12 7 0 08 Jan 2020
Deep Bayesian Active Learning for Multiple Correct Outputs Khaled Jedoui Ranjay Krishna Michael S. Bernstein Li Fei-Fei BDL OOD UQCV 16 14 0 02 Dec 2019
Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Study Ziyu Yao Yu-Chuan Su Huan Sun Wen-tau Yih 15 77 0 11 Oct 2019
Improving Back-Translation with Uncertainty-based Confidence Estimation Shuo Wang Yang Liu Chao Wang Huanbo Luan Maosong Sun UQLM 24 81 0 31 Aug 2019
Controlling Risk of Web Question Answering Lixin Su J. Guo Yixing Fan Yanyan Lan Xueqi Cheng 11 9 0 24 May 2019
Robust Spoken Language Understanding via Paraphrasing Avik Ray Yilin Shen Hongxia Jin 9 13 0 17 Sep 2018
Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning Ziyu Yao Xiujun Li Jianfeng Gao Brian M. Sadler Huan Sun 6 32 0 21 Aug 2018
Question Generation from SQL Queries Improves Neural Semantic Parsing Daya Guo Yibo Sun Duyu Tang Nan Duan Jian Yin Hong Chi James Cao Peng Chen M. Zhou 16 55 0 20 Aug 2018
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,923 0 17 Aug 2015