Quantifying Uncertainties in Natural Language Processing Tasks

AAAI Conference on Artificial Intelligence (AAAI), 2018

18 November 2018

Papers citing "Quantifying Uncertainties in Natural Language Processing Tasks"

50 / 85 papers shown

Title
HACK: Hallucinations Along Certainty and Knowledge Axes Adi Simhi Jonathan Herzig Itay Itzhak Dana Arad Zorik Gekhman Roi Reichart Fazl Barez Gabriel Stanovsky Idan Szpektor Yonatan Belinkov 100 0 0 28 Oct 2025
Multi-Modal Fact-Verification Framework for Reducing Hallucinations in Large Language Models Piyushkumar Patel HILM 132 0 0 26 Oct 2025
Confidence Calibration in Large Language Model-Based Entity Matching Iris Kamsteeg Juan Cardenas-Cartagena Floris van Beers Gineke ten Holt Tsegaye Misikir Tashu Matias Valdenegro-Toro 60 0 0 23 Sep 2025
Are you sure? Measuring models bias in content moderation through uncertainty Alessandra Urbinati Mirko Lai Simona Frenda M. Stranisci 144 0 0 21 Sep 2025
It's Not the Target, It's the Background: Rethinking Infrared Small Target Detection via Deep Patch-Free Low-Rank RepresentationsIEEE Transactions on Geoscience and Remote Sensing (IEEE TGRS), 2025 Guoyi Zhang Guangsheng Xu Siyang Chen Han Wang Xiaohu Zhang 441 0 0 12 Jun 2025
Herd Behavior: Investigating Peer Influence in LLM-based Multi-Agent Systems Y. Cho Sharath Chandra Guntuku Lyle Ungar 118 4 0 27 May 2025
Monocle: Hybrid Local-Global In-Context Evaluation for Long-Text Generation with Uncertainty-Based Active Learning Xiaorong Wang Ting Yang Zhu Zhang Kaiyan Zhang Zihan Zhou Liner Yang Zhiyuan Liu Maosong Sun 215 0 0 26 May 2025
Grammars of Formal Uncertainty: When to Trust LLMs in Automated Reasoning Tasks Debargha Ganguly Vikash Singh Sreehari Sankar Biyao Zhang Xuecen Zhang Srinivasan Iyengar Xiaotian Han Amit Sharma Shivkumar Kalyanaraman Vipin Chaudhary 259 2 0 26 May 2025
Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review Toghrul Abbasli Kentaroh Toyoda Yuan Wang Leon Witt Muhammad Asif Ali Yukai Miao Dan Li Qingsong Wei UQCV 583 2 0 25 Apr 2025
Your Model is Overconfident, and Other Lies We Tell OurselvesAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Timothee Mickus Aman Sinha Ananda Sreenidhi 191 0 0 03 Mar 2025
AdaptiveLog: An Adaptive Log Analysis Framework with the Collaboration of Large and Small Language ModelACM Transactions on Software Engineering and Methodology (TOSEM), 2025 Lipeng Ma Weidong Yang Yixuan Li Ben Fei Mingjie Zhou Shuhao Li Sihang Jiang Bo Xu Yanghua Xiao 110 6 0 19 Jan 2025
Enhancing Trust in Large Language Models with Uncertainty-Aware Fine-Tuning R. Krishnan Piyush Khanna Omesh Tickoo HILM 252 5 0 03 Dec 2024
Addressing Uncertainty in LLMs to Enhance Reliability in Generative AI R. Kaur Colin Samplawski Adam Cobb Anirban Roy Brian Matejek ... Daniel Elenius Alexander M. Berenbeim John A. Pavlik Nathaniel D. Bastian Susmit Jha 300 11 0 04 Nov 2024
Rethinking the Uncertainty: A Critical Review and Analysis in the Era of Large Language Models Mohammad Beigi Sijia Wang Ying Shen Zihao Lin Adithya Kulkarni ... Ming Jin Jin-Hee Cho Dawei Zhou Chang-Tien Lu Lifu Huang 236 3 0 26 Oct 2024
A Survey of Uncertainty Estimation in LLMs: Theory Meets Practice Hsiu-Yuan Huang Yutong Yang Zhaoxi Zhang Sanwoo Lee Yunfang Wu 299 34 0 20 Oct 2024
Uncertainty-aware Human Mobility Modeling and Anomaly Detection Haomin Wen Shurui Cao Z. Rasheed Khurram Hassan-Shafique Leman Akoglu 277 0 0 02 Oct 2024
TrustNavGPT: Modeling Uncertainty to Improve Trustworthiness of Audio-Guided LLM-Based Robot NavigationIEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2024 Xingpeng Sun Yiran Zhang Xindi Tang Amrit Singh Bedi Aniket Bera 214 12 0 03 Aug 2024
Domain-specific or Uncertainty-aware models: Does it really make a difference for biomedical text classification? Aman Sinha Timothee Mickus Marianne Clausel Mathieu Constant X. Coubez 193 1 0 17 Jul 2024
Uncertainty is Fragile: Manipulating Uncertainty in Large Language Models Qingcheng Zeng Haoyang Ling Qinkai Yu Zhenting Wang Qingfeng Lan ... Felix Juefei Xu Kaize Ding Fan Yang Ruixiang Tang Yongfeng Zhang AAML 362 14 0 15 Jul 2024
Are Data Augmentation Methods in Named Entity Recognition Applicable for Uncertainty Estimation? Wataru Hashimoto Hidetaka Kamigaito Taro Watanabe 246 5 0 02 Jul 2024
Uncertainty Quantification in Table Structure Recognition Kehinde E. Ajayi Leizhen Zhang Yi He Jian Wu LMTD 114 2 0 01 Jul 2024
Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similarities Alexander Nikitin Jannik Kossen Yarin Gal Pekka Marttinen UQCV 354 86 0 30 May 2024
Conformal Prediction for Natural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL), 2024 Margarida M. Campos António Farinhas Chrysoula Zerva Mário A. T. Figueiredo André F. T. Martins AI4CE 386 36 0 03 May 2024
Uncertainty-boosted Robust Video Activity Anticipation Zhaobo Qi Shuhui Wang Weigang Zhang Qingming Huang 260 10 0 29 Apr 2024
From Robustness to Improved Generalization and Calibration in Pre-trained Language Models Josip Jukić Jan Snajder 301 2 0 31 Mar 2024
Self-Evaluation of Large Language Model based on Glass-box Features Hui Huang Yingqi Qu Jing Liu Muyun Yang Tiejun Zhao 88 4 0 07 Mar 2024
Safe Task Planning for Language-Instructed Multi-Robot Systems using Conformal Prediction Jun Wang Guocheng He Y. Kantaros 264 19 0 23 Feb 2024
Beyond Simple Averaging: Improving NLP Ensemble Performance with Topological-Data-Analysis-Based Weighting P. Proskura Alexey Zaytsev 252 1 0 22 Feb 2024
MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs Yavuz Faruk Bakman D. Yaldiz Baturalp Buyukates Chenyang Tao Dimitrios Dimitriadis A. Avestimehr 195 37 0 19 Feb 2024
Uncertainty Quantification for In-Context Learning of Large Language Models Chen Ling Xujiang Zhao Xuchao Zhang Wei Cheng Yanchi Liu ... Katsushi Matsuda Jie Ji Guangji Bai Bo Pan Haifeng Chen 206 31 0 15 Feb 2024
Consistent Joint Decision-Making with Heterogeneous Learning ModelsFindings (Findings), 2024 Hossein Rajaby Faghihi Parisa Kordjamshidi 250 2 0 06 Feb 2024
Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requests Brielen Madureira David Schlangen 128 3 0 30 Jan 2024
Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive TasksConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Po-Nien Kung Fan Yin Di Wu Kai-Wei Chang Nanyun Peng 223 58 0 01 Nov 2023
Software Entity Recognition with Noise-Robust LearningInternational Conference on Automated Software Engineering (ASE), 2023 Nguyen Tai Yifeng Di J. Lee Muhao Chen Tianyi Zhang 126 7 0 21 Aug 2023
Prompt2Gaussia: Uncertain Prompt-learning for Script Event Prediction Shiyao Cui Xin Cong Shuaiyi Nie Xuebin Wang Tingwen Liu Jinqiao Shi 122 1 0 04 Aug 2023
Robots That Ask For Help: Uncertainty Alignment for Large Language Model PlannersConference on Robot Learning (CoRL), 2023 Allen Z. Ren Anushri Dixit Alexandra Bodrova Sumeet Singh Stephen Tu ... Jacob Varley Zhenjia Xu Dorsa Sadigh Andy Zeng Anirudha Majumdar LM&Ro 421 295 0 04 Jul 2023
Hyperbolic Active Learning for Semantic Segmentation under Domain ShiftInternational Conference on Machine Learning (ICML), 2023 Luca Franco Paolo Mandica Konstantinos Kallidromitis Devin Guillory Yu-Teng Li Trevor Darrell Fabio Galasso 225 14 0 19 Jun 2023
CLARA: Classifying and Disambiguating User Commands for Reliable Interactive Robotic AgentsIEEE Robotics and Automation Letters (RA-L), 2023 Jeongeun Park Seungwon Lim Joonhyung Lee Sangbeom Park Minsuk Chang Youngjae Yu Sungjoon Choi LM&Ro 331 34 0 17 Jun 2023
A Bayesian approach to uncertainty in word embedding bias estimationComputational Linguistics (CL), 2023 Alicja Dobrzeniecka R. Urbaniak 85 2 0 15 Jun 2023
Efficient Uncertainty Quantification and Reduction for Over-Parameterized Neural NetworksNeural Information Processing Systems (NeurIPS), 2023 Ziyi Huang Henry Lam Haofeng Zhang UQCV 224 9 0 09 Jun 2023
CAVEN: An Embodied Conversational Agent for Efficient Audio-Visual Navigation in Noisy EnvironmentsAAAI Conference on Artificial Intelligence (AAAI), 2023 Xiulong Liu Sudipta Paul Moitreya Chatterjee A. Cherian 175 11 0 06 Jun 2023
CUE: An Uncertainty Interpretation Framework for Text Classifiers Built on Pre-Trained Language ModelsConference on Uncertainty in Artificial Intelligence (UAI), 2023 Jiazheng Li ZHAOYUE SUN Bin Liang Lin Gui Yulan He 192 2 0 06 Jun 2023
Uncertainty in Natural Language Processing: Sources, Quantification, and Applications Mengting Hu Zhen Zhang Shiwan Zhao Shiyu Huang Bingzhe Wu BDL 210 52 0 05 Jun 2023
Uncertainty-Aware Bootstrap Learning for Joint Extraction on Distantly-Supervised DataAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Yufei Li Xiao Yu Yanchi Liu Haifeng Chen Cong Liu UQCV SSL 161 10 0 05 May 2023
Reliable Gradient-free and Likelihood-free Prompt TuningFindings (Findings), 2023 Maohao Shen S. Ghosh P. Sattigeri Subhro Das Yuheng Bu G. Wornell VLM 251 15 0 30 Apr 2023
On Uncertainty Calibration and Selective Generation in Probabilistic Neural Summarization: A Benchmark StudyConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Polina Zablotskaia Du Phan Joshua Maynez Shashi Narayan Jie Jessie Ren J. Liu UQLM UQCV 253 24 0 17 Apr 2023
Toward Reliable Human Pose Forecasting with UncertaintyIEEE Robotics and Automation Letters (RA-L), 2023 Saeed Saadatnejad Mehrshad Mirmohammadi Matin Daghyani Parham Saremi Yashar Zoroofchi Benisi Amir Alimohammadi Zahra Tehraninasab Taylor Mordan Alexandre Alahi 147 12 0 13 Apr 2023
Uncertainty-aware deep learning for digital twin-driven monitoring: Application to fault detection in power lines L. Das B. Gjorgiev G. Sansavini AI4CE 188 3 0 20 Mar 2023
Bag of Tricks for In-Distribution Calibration of Pretrained TransformersFindings (Findings), 2023 Jaeyoung Kim Dongbin Na Sungchul Choi Sungbin Lim VLM 156 7 0 13 Feb 2023
Understanding Difficulty-based Sample Weighting with a Universal Difficulty Measure Xiaoling Zhou Ou Wu Weiyao Zhu Ziyang Liang 138 7 0 12 Jan 2023