v1v2 (latest)

Prototypical Calibration for Few-shot Learning of Language Models

International Conference on Learning Representations (ICLR), 2022

20 May 2022

Papers citing "Prototypical Calibration for Few-shot Learning of Language Models"

49 / 49 papers shown

Title
Measuring Scalar Constructs in Social Science with LLMs Hauke Licht Rupak Sarkar Patrick Y. Wu Pranav Goel Niklas Stoehr Elliott Ash Alexander Miserlis Hoyle 194 3 0 03 Sep 2025
Exposing and Mitigating Calibration Biases and Demographic Unfairness in MLLM Few-Shot In-Context Learning for Medical Image ClassificationInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2025 Xing Shen Justin Szeto Mingyang Li Hengguan Huang Tal Arbel 209 1 0 29 Jun 2025
Boosting In-Context Learning in LLMs Through the Lens of Classical Supervised Learning Korel Gundem Juncheng Dong Dennis Zhang Vahid Tarokh Zhengling Qi 166 0 0 22 May 2025
Mechanistic Fine-tuning for In-context Learning Hakaze Cho Peng Luo Mariko Kato Rin Kaenbyou Naoya Inoue 333 0 0 20 May 2025
Incentivizing Truthful Language Models via Peer Elicitation Games Baiting Chen Tong Zhu Jiale Han Lexin Li Gang Li Xiaowu Dai 336 1 0 19 May 2025
Restoring Calibration for Aligned Large Language Models: A Calibration-Aware Fine-Tuning Approach Jiancong Xiao Bojian Hou Zhanliang Wang Ruochen Jin Q. Long Weijie Su Li Shen 421 13 0 04 May 2025
MateICL: Mitigating Attention Dispersion in Large-Scale In-Context Learning Murtadha Ahmed Wenbo Liu yunfeng 197 0 0 02 May 2025
Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review Toghrul Abbasli Kentaroh Toyoda Yuan Wang Leon Witt Muhammad Asif Ali Yukai Miao Dan Li Qingsong Wei UQCV 587 2 0 25 Apr 2025
Considering Length Diversity in Retrieval-Augmented SummarizationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2025 Juseon-Do Jaesung Hwang Jingun Kwon Hidetaka Kamigaito Manabu Okumura 172 1 0 12 Mar 2025
Efficient Many-Shot In-Context Learning with Dynamic Block-Sparse AttentionAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Emily Xiao Chin-Jou Li Yilin Zhang Graham Neubig Amanda Bertsch BDL 266 2 0 11 Mar 2025
Aligning Black-box Language Models with Human JudgmentsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2025 Gerrit J. J. van den Burg Gen Suzuki Wei Liu Murat Sensoy ALM 247 2 0 07 Feb 2025
VLN-Game: Vision-Language Equilibrium Search for Zero-Shot Semantic Navigation Bangguo Yu Yuzhen Liu Lei Han Hamidreza Kasaei Tingguang Li M. Cao LM&Ro 309 8 0 18 Nov 2024
Confidence Calibration of Classifiers with Many ClassesNeural Information Processing Systems (NeurIPS), 2024 Adrien LeCoz Stéphane Herbin Faouzi Adjed UQCV 299 7 0 05 Nov 2024
Shortcut Learning in In-Context Learning: A Survey Rui Song Yingji Li Fausto Giunchiglia Fausto Giunchiglia Hao Xu 346 3 0 04 Nov 2024
Task Calibration: Calibrating Large Language Models on Inference Tasks Yingjie Li Yun Luo Xiaotian Xie Yue Zhang LRM 218 0 0 24 Oct 2024
Mitigating Copy Bias in In-Context Learning through Neuron Pruning Ameen Ali Lior Wolf Ivan Titov 155 6 0 02 Oct 2024
Enhancing In-Context Learning via Implicit Demonstration Augmentation Xiaoling Zhou Wei Ye Yidong Wang Chaoya Jiang Zhemg Lee Rui Xie Shikun Zhang 225 11 0 27 Jun 2024
Token-based Decision Criteria Are Suboptimal in In-context Learning Hakaze Cho Yoshihiro Sakai Mariko Kato Kenshiro Tanaka Akira Ishii Naoya Inoue 463 6 0 24 Jun 2024
Text Grafting: Near-Distribution Weak Supervision for Minority Classes in Text Classification Letian Peng Yi Gu Chengyu Dong Zihan Wang Jingbo Shang 179 1 0 17 Jun 2024
UniBias: Unveiling and Mitigating LLM Bias through Internal Attention and FFN Manipulation Hanzhang Zhou Zijian Feng Zixiao Zhu Junlang Qian Kezhi Mao 256 23 0 31 May 2024
COBias and Debias: Balancing Class Accuracies for Language Models in Inference Time via Nonlinear Integer Programming Ruixi Lin Yang You 386 1 0 13 May 2024
Beyond Performance: Quantifying and Mitigating Label Bias in LLMsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Philipp Benz Maitreya Patel 345 25 0 04 May 2024
In-Context Learning with Long-Context Models: An In-Depth Exploration Amanda Bertsch Maor Ivgi Uri Alon Jonathan Berant Matthew R. Gormley Matthew R. Gormley Graham Neubig ReLM AIMat 558 112 0 30 Apr 2024
Naive Bayes-based Context Extension for Large Language Models Jianlin Su Murtadha Ahmed Wenbo Luo Abhishek Rao Denny Zhou Hyeontaek Lim 162 8 0 26 Mar 2024
Long-Context Language Modeling with Parallel Context Encoding Howard Yen Tianyu Gao Danqi Chen 250 77 0 26 Feb 2024
Thermometer: Towards Universal Calibration for Large Language Models Maohao Shen Subhro Das Kristjan Greenewald P. Sattigeri Greg Wornell Soumya Ghosh 246 22 0 20 Feb 2024
Prompt-Based Bias Calibration for Better Zero/Few-Shot Learning of Language Models Kang He Yinghan Long Kaushik Roy 278 8 0 15 Feb 2024
Enhancing In-context Learning via Linear Probe CalibrationInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2024 Momin Abbas Yi Zhou Parikshit Ram Nathalie Baracaldo Horst Samulowitz Theodoros Salonidis Tianyi Chen 220 17 0 22 Jan 2024
Leveraging Biases in Large Language Models: "bias-kNN'' for Effective Few-Shot Learning Yong Zhang Hanzhang Li Zhitao Li Ning Cheng Ming Li Jing Xiao Jianzong Wang 216 3 0 18 Jan 2024
Promptly Predicting Structures: The Return of InferenceNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Maitrey Mehta Valentina Pyatkin Vivek Srikumar 321 6 0 12 Jan 2024
Mind Your Format: Towards Consistent Evaluation of In-Context Learning ImprovementsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Anton Voronov Lena Wolf Max Ryabinin 289 72 0 12 Jan 2024
A Study on the Calibration of In-context Learning Hanlin Zhang Yi-Fan Zhang Yaodong Yu Dhruv Madeka Dean Phillips Foster Eric Xing Hima Lakkaraju Sham Kakade 530 22 0 07 Dec 2023
A Survey of Confidence Estimation and Calibration in Large Language ModelsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2023 Fauzan Farooqui Fengyu Cai Yuxia Wang Heinz Koeppl Preslav Nakov Iryna Gurevych UQCV 433 154 0 14 Nov 2023
Gen-Z: Generative Zero-Shot Text Classification with Contextualized Label DescriptionsInternational Conference on Learning Representations (ICLR), 2023 Sachin Kumar Chan Young Park Yulia Tsvetkov VLM 171 5 0 13 Nov 2023
Improving Input-label Mapping with Demonstration Replay for In-context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Zhuocheng Gong Jiahao Liu Qifan Wang Jingang Wang Xunliang Cai Dongyan Zhao Rui Yan 159 2 0 30 Oct 2023
Generative Calibration for In-context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Zhongtao Jiang Yuanzhe Zhang Cao Liu Jun Zhao Kang Liu 362 21 0 16 Oct 2023
The Consensus Game: Language Model Generation via Equilibrium Search Athul Paul Jacob Songlin Yang Gabriele Farina Jacob Andreas 227 32 0 13 Oct 2023
Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt EngineeringInternational Conference on Learning Representations (ICLR), 2023 Han Zhou Xingchen Wan Lev Proleev Diana Mincu Jilin Chen Katherine A. Heller Subhrajit Roy UQLM 325 77 0 29 Sep 2023
Unsupervised Contrast-Consistent Ranking with Language ModelsConference of the European Chapter of the Association for Computational Linguistics (EACL), 2023 Niklas Stoehr Pengxiang Cheng Jing Wang Daniel Preoţiuc-Pietro Rajarshi Bhowmik ALM 181 14 0 13 Sep 2023
Matching Table Metadata with Business Glossaries Using Large Language Models Elita Lobo Oktie Hassanzadeh Nhan Pham Nandana Mihindukulasooriya D. Subramanian Horst Samulowitz 123 4 0 08 Sep 2023
Calibration in Deep Learning: A Survey of the State-of-the-Art Cheng Wang UQCV 476 71 0 02 Aug 2023
Universal Self-Adaptive PromptingConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Xingchen Wan Ruoxi Sun Hootan Nakhost H. Dai Julian Martin Eisenschlos Sercan O. Arik Tomas Pfister LRM 182 13 0 24 May 2023
A Benchmark on Extremely Weakly Supervised Text Classification: Reconcile Seed Matching and Prompting ApproachesAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Zihan Wang Tianle Wang Dheeraj Mekala Jingbo Shang VLM 146 9 0 22 May 2023
Pre-Training to Learn in ContextAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Yuxian Gu Li Dong Furu Wei Shiyu Huang CLIP LRM ReLM 324 53 0 16 May 2023
Parallel Context Windows for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Nir Ratner Yoav Levine Yonatan Belinkov Ori Ram Inbal Magar Omri Abend Ehud D. Karpas Amnon Shashua Kevin Leyton-Brown Y. Shoham RALM 324 86 0 21 Dec 2022
Decoder Tuning: Efficient Language Understanding as DecodingAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Ganqu Cui Wentao Li Ning Ding Longtao Huang Zhiyuan Liu Maosong Sun 181 7 0 16 Dec 2022
Structured Prompting: Scaling In-Context Learning to 1,000 Examples Y. Hao Yutao Sun Li Dong Zhixiong Han Yuxian Gu Furu Wei LRM 164 92 0 13 Dec 2022
Complementary Explanations for Effective In-Context LearningAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Xi Ye Srini Iyer Asli Celikyilmaz Ves Stoyanov Greg Durrett Ramakanth Pasunuru ReLM LRM 222 111 0 25 Nov 2022
On the Relation between Sensitivity and Accuracy in In-context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Yanda Chen Chen Zhao Zhou Yu Kathleen McKeown He He 379 90 0 16 Sep 2022