Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations

Annual Meeting of the Association for Computational Linguistics (ACL), 2023

22 May 2023

Papers citing "Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations"

41 / 41 papers shown

Title
Large Language Models Develop Novel Social Biases Through Adaptive Exploration Addison J. Wu Ryan Liu Xuechunzi Bai Thomas Griffiths 92 0 0 08 Nov 2025
Rethinking the Chain-of-Thought: The Roles of In-Context Learning and Pre-trained PriorsInternational Conference on Intelligent Computing (ICIC), 2025 Hao Yang Zhiyu Yang Y. Zhang Shanyi Zhu Lin Yang BDL LRM AI4CE 75 0 0 01 Sep 2025
REALM: Recursive Relevance Modeling for LLM-based Document Re-Ranking Pinhuan Wang Zhiqiu Xia Chunhua Liao Feiyi Wang Hang Liu 107 2 0 25 Aug 2025
Understanding Human Limits in Pattern Recognition: A Computational Model of Sequential Reasoning in Rock, Paper, Scissors Logan Cross Erik Brockbank Tobias Gerstenberg Judith E. Fan Daniel L. K. Yamins Nick Haber 77 0 0 25 Jul 2025
Evaluating and Improving Robustness in Large Language Models: A Survey and Future Directions Kun Zhang Le Wu Kui Yu Guangyi Lv Dacao Zhang AAML ELM 258 1 0 08 Jun 2025
What Makes a Good Natural Language Prompt?Annual Meeting of the Association for Computational Linguistics (ACL), 2025 Do Xuan Long Duy Dinh Ngoc-Hai Nguyen Kenji Kawaguchi Nancy F. Chen Shafiq Joty Min-Yen Kan 162 6 0 07 Jun 2025
Boosting In-Context Learning in LLMs Through the Lens of Classical Supervised Learning Korel Gundem Juncheng Dong Dennis Zhang Vahid Tarokh Zhengling Qi 142 0 0 22 May 2025
Scaling sparse feature circuit finding for in-context learning Dmitrii Kharlapenko Shivalika Singh Fazl Barez Arthur Conmy Neel Nanda 220 3 0 18 Apr 2025
The Greatest Good Benchmark: Measuring LLMs' Alignment with Utilitarian Moral Dilemmas Giovanni Franco Gabriel Marraffini Andrés Cotton Noe Fabian Hsueh Axel Fridman Juan Wisznia Luciano Del Corro 154 5 0 25 Mar 2025
Advancing Multimodal In-Context Learning in Large Vision-Language Models with Task-aware Demonstrations Yanshu Li 336 3 0 05 Mar 2025
Foundation Models at Work: Fine-Tuning for Fairness in Algorithmic Hiring Buse Sibel Korkmaz Rahul Nair Elizabeth M. Daly Evangelos Anagnostopoulos Christos Varytimidis Antonio del Rio Chanona 151 0 0 13 Jan 2025
Shortcut Learning in In-Context Learning: A Survey Rui Song Yingji Li Fausto Giunchiglia Fausto Giunchiglia Hao Xu 322 3 0 04 Nov 2024
Inference and Verbalization Functions During In-Context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Junyi Tao Xiaoyin Chen Nelson F. Liu LRM ReLM 241 1 0 12 Oct 2024
Density estimation with LLMs: a geometric investigation of in-context learning trajectoriesInternational Conference on Learning Representations (ICLR), 2024 Toni J. B. Liu Nicolas Boullé Raphaël Sarfati Christopher Earls 209 2 0 07 Oct 2024
MAVEN-Fact: A Large-scale Event Factuality Detection Dataset Chunyang Li Hao Peng Xiaozhi Wang Yunjia Qi Lei Hou Bin Xu Juanzi Li HILM 218 5 0 22 Jul 2024
Unveiling Selection Biases: Exploring Order and Token Sensitivity in Large Language Models Sheng-Lun Wei Cheng-Kuang Wu Hen-Hsen Huang Hsin-Hsi Chen 144 21 0 05 Jun 2024
ACCORD: Closing the Commonsense Measurability Gap François Roewer-Després Jinyue Feng Zining Zhu Frank Rudzicz LRM 316 0 0 04 Jun 2024
Beyond Performance: Quantifying and Mitigating Label Bias in LLMsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Philipp Benz Maitreya Patel 293 23 0 04 May 2024
RealCompo: Balancing Realism and Compositionality Improves Text-to-Image Diffusion Models Xinchen Zhang Ling Yang Yaqi Cai Zhaochen Yu Kai-Ni Wang ... Ye Tian Minkai Xu Yong Tang Yujiu Yang Tengjiao Wang DiffM 199 14 0 20 Feb 2024
Experimental Contexts Can Facilitate Robust Semantic Property Inference in Language Models, but InconsistentlyConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Kanishka Misra Allyson Ettinger Kyle Mahowald 210 5 0 12 Jan 2024
Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Shuai Zhao Meihuizi Jia Anh Tuan Luu Fengjun Pan Jinming Wen AAML 370 67 0 11 Jan 2024
Comparable Demonstrations are Important in In-Context Learning: A Novel Perspective on Demonstration SelectionIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 Caoyun Fan Jidong Tian Yitian Li Hao He Yaohui Jin 166 5 0 12 Dec 2023
User Modeling in the Era of Large Language Models: Current Research and Future Directions Zhaoxuan Tan Meng Jiang 263 19 0 11 Dec 2023
Positional Information Matters for Invariant In-Context Learning: A Case Study of Simple Function Classes Yongqiang Chen Binghui Xie Kaiwen Zhou Bo Han Yatao Bian James Cheng 238 3 0 30 Nov 2023
Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable TasksInternational Conference on Machine Learning (ICML), 2023 Rahul Ramesh Ekdeep Singh Lubana Mikail Khona Robert P. Dick Hidenori Tanaka CoGe 249 13 0 21 Nov 2023
Test-time Backdoor Mitigation for Black-Box Large Language Models with Defensive DemonstrationsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2023 Wenjie Mo Lyne Tchapmi Qin Liu Zhenghao Hu Jun Yan Chaowei Xiao Muhao Chen Muhao Chen AAML 251 24 0 16 Nov 2023
When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks Hao Peng Xiaozhi Wang Jianhui Chen Weikai Li Yunjia Qi ... Zhili Wu Kaisheng Zeng Bin Xu Lei Hou Juanzi Li 202 40 0 15 Nov 2023
Explore Spurious Correlations at the Concept Level in Language Models for Text ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Yuhang Zhou Paiheng Xu Xiaoyu Liu Bang An Wei Ai Furong Huang LRM 340 44 0 15 Nov 2023
In-context Learning Generalizes, But Not Always Robustly: The Case of SyntaxNorth American Chapter of the Association for Computational Linguistics (NAACL), 2023 Aaron Mueller Albert Webson Jackson Petty Tal Linzen ReLM LRM 200 20 0 13 Nov 2023
Understanding Users' Dissatisfaction with ChatGPT Responses: Types, Resolving Tactics, and the Effect of Knowledge LevelInternational Conference on Intelligent User Interfaces (IUI), 2023 Yoonsu Kim Jueon Lee Seoyoung Kim Jaehyuk Park Juho Kim 235 63 0 13 Nov 2023
Reinforcement Learning Fine-tuning of Language Models is Biased Towards More Extractable Features Diogo Cruz Edoardo Pona Alex Holness-Tofts Elias Schmied Víctor Abia Alonso Charlie Griffin B. Cirstea 137 1 0 07 Nov 2023
The Mystery of In-Context Learning: A Comprehensive Survey on Interpretation and AnalysisConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Yuxiang Zhou Jiazheng Li Yanzheng Xiang Hanqi Yan Lin Gui Yulan He 255 29 0 01 Nov 2023
In-Context Learning Dynamics with Random Binary SequencesInternational Conference on Learning Representations (ICLR), 2023 Eric J. Bigelow Ekdeep Singh Lubana Robert P. Dick Hidenori Tanaka T. Ullman 288 12 0 26 Oct 2023
Generative Calibration for In-context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Zhongtao Jiang Yuanzhe Zhang Cao Liu Jun Zhao Kang Liu 338 21 0 16 Oct 2023
Understanding In-Context Learning from RepetitionsInternational Conference on Learning Representations (ICLR), 2023 Jianhao Yan Jin Xu Chiyu Song Chenming Wu Yafu Li Yue Zhang 248 27 0 30 Sep 2023
Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt EngineeringInternational Conference on Learning Representations (ICLR), 2023 Han Zhou Xingchen Wan Lev Proleev Diana Mincu Jilin Chen Katherine A. Heller Subhrajit Roy UQLM 281 77 0 29 Sep 2023
Large Language Models Are Not Robust Multiple Choice SelectorsInternational Conference on Learning Representations (ICLR), 2023 Chujie Zheng Hao Zhou Fandong Meng Jie Zhou Shiyu Huang 335 349 0 07 Sep 2023
In-Context Learning Learns Label Relationships but Is Not Conventional LearningInternational Conference on Learning Representations (ICLR), 2023 Jannik Kossen Y. Gal Tom Rainforth 478 51 0 23 Jul 2023
Instruction-following Evaluation through Verbalizer Manipulation Shiyang Li Jun Yan Hai Wang Zheng Tang Xiang Ren Vijay Srinivasan Hongxia Jin 188 32 0 20 Jul 2023
In-Context Learning through the Bayesian PrismInternational Conference on Learning Representations (ICLR), 2023 Madhuri Panwar Kabir Ahuja Navin Goyal BDL 230 66 0 08 Jun 2023
A Survey on In-context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Qingxiu Dong Lei Li Damai Dai Ce Zheng Jingyuan Ma ... Zhiyong Wu Baobao Chang Xu Sun Lei Li Zhifang Sui ReLM AIMat 384 818 0 31 Dec 2022