v1v2v3v4 (latest)

Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023

23 May 2023

Lei Li

Jie Zhou

ArXiv (abs)PDF HTML HuggingFace (1 upvotes)

Papers citing "Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning"

50 / 102 papers shown

Title
Genomic Next-Token Predictors are In-Context Learners Nathan Breslow Aayush Mishra Mahler Revsine Michael C. Schatz Anqi Liu Daniel Khashabi 211 0 0 16 Nov 2025
Beyond Plain Demos: A Demo-centric Anchoring Paradigm for In-Context Learning in Alzheimer's Disease Detection Puzhen Su Haoran Yin Yongzhu Miao Jintao Tang Shasha Li Ting Wang 96 0 0 10 Nov 2025
Unveiling Modality Bias: Automated Sample-Specific Analysis for Multimodal Misinformation Benchmarks Hehai Lin Hui Liu S. Cao Jing Li Haoliang Li Wenya Wang 220 0 0 08 Nov 2025
How Do LLMs Use Their Depth? Akshat Gupta Jay Yeung Gopala Anumanchipalli Anna Ivanova 80 0 0 21 Oct 2025
The Mechanistic Emergence of Symbol Grounding in Language Models Shuyu Wu Ziqiao Ma Xiaoxi Luo Yidong Huang Josue Torres-Fonseca Freda Shi Joyce Chai LRM 172 2 0 15 Oct 2025
DSAS: A Universal Plug-and-Play Framework for Attention Optimization in Multi-Document Question Answering Jiakai Li Rongzheng Wang Yizhuo Ma Shuang Liang Guangchun Luo Ke Qin 124 0 0 14 Oct 2025
Fine-Grained Emotion Recognition via In-Context Learning Zhaochun Ren Zhou Yang Chenglong Ye Haizhou Sun Chao Chen Xiaofei Zhu Xiangwen Liao 112 0 0 08 Oct 2025
LongRM: Revealing and Unlocking the Context Boundary of Reward Modeling Zecheng Tang Baibei Ji Quantong Qiu Haitian Wang Xiaobo Liang Juntao Li Min Zhang OffRL LRM 156 1 0 08 Oct 2025
Revisiting Long-context Modeling from Context Denoising Perspective Zecheng Tang Baibei Ji Juntao Li Lijun Wu Haijia Gui Min Zhang 166 0 0 07 Oct 2025
SafeGuider: Robust and Practical Content Safety Control for Text-to-Image Models Peigui Qi Kunsheng Tang Wenbo Zhou Weiming Zhang N. Yu Tianwei Zhang Qing Guo Jie Zhang DiffM 254 1 0 05 Oct 2025
Multimodal Function Vectors for Spatial Relations Shuhao Fu Esther Goldberg Ying Nian Wu Hongjing Lu 81 0 0 02 Oct 2025
Binary Autoencoder for Mechanistic Interpretability of Large Language Models Hakaze Cho Haolin Yang Brian M. Kurkoski Naoya Inoue MQ 196 0 0 25 Sep 2025
On Theoretical Interpretations of Concept-Based In-Context Learning Huaze Tang Tianren Peng Shao-Lun Huang 189 0 0 25 Sep 2025
Embedding Domain Knowledge for Large Language Models via Reinforcement Learning from Augmented Generation Chaojun Nie Jun Zhou G. Wang Shisong Wud Zichen Wang 166 0 0 24 Sep 2025
Interpreting Attention Heads for Image-to-Text Information Flow in Large Vision-Language Models Jinyeong Kim Seil Kang Jiwoo Park Junhyeok Kim Seong Jae Hwang 124 1 0 22 Sep 2025
Semantic Causality-Aware Vision-Based 3D Occupancy Prediction Dubing Chen Huan Zheng Yucheng Zhou Xianfei Li Wenlong Liao Tao He Pai Peng Jianbing Shen 3DPC 116 3 0 10 Sep 2025
Negative Matters: Multi-Granularity Hard-Negative Synthesis and Anchor-Token-Aware Pooling for Enhanced Text EmbeddingsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Tengyu Pan Zhichao Duan Zhenyu Li Bowen Dong Ning Liu Xiuxing Li Jianyong Wang 100 1 0 31 Aug 2025
NEAT: Concept driven Neuron Attribution in LLMs Vivek Hruday Kavuri Gargi Shroff Rahul Mishra 92 0 0 21 Aug 2025
Causality Matters: How Temporal Information Emerges in Video Language Models Yumeng Shi Quanyu Long Yin Wu Wenya Wang 100 1 0 15 Aug 2025
Prompt Tuning for Few-Shot Continual Learning Named Entity Recognition Zhe Ren CLL 68 0 0 10 Aug 2025
BEE-RAG: Balanced Entropy Engineering for Retrieval-Augmented Generation Yuhao Wang Ruiyang Ren Yucheng Wang Jing Liu Wayne Xin Zhao Hua Wu Haifeng Wang 154 0 0 07 Aug 2025
CTR-Sink: Attention Sink for Language Models in Click-Through Rate Prediction Zixuan Li Binzong Geng Jing Xiong Yong He Yuxuan Hu ... Liang Zhang Linjian Mo Chengming Li Chuan Yuan Zhenan Sun 118 0 0 05 Aug 2025
RCP-Merging: Merging Long Chain-of-Thought Models with Domain-Specific Models by Considering Reasoning Capability as Prior Junyao Yang Jianwei Wang Huiping Zhuang Cen Chen Ziqian Zeng MoMe LRM 151 0 0 05 Aug 2025
Multi-Layer Attention is the Amplifier of Demonstration Effectiveness Dingzirui Wang Xuangliang Zhang Keyan Xu Qingfu Zhu Wanxiang Che Yang Deng 150 1 0 01 Aug 2025
A Hybrid Early-Exit Algorithm for Large Language Models Based on Space Alignment Decoding (SPADE) Bowen Zheng Ming Ma Zhongqiao Lin Tianming Yang 147 0 0 23 Jul 2025
Understanding Task Vectors in In-Context Learning: Emergence, Functionality, and Limitations Yuxin Dong Jiachen Jiang Zhihui Zhu Xia Ning 194 3 0 10 Jun 2025
A Generative Adaptive Replay Continual Learning Model for Temporal Knowledge Graph ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Zhiyu Zhang Wei Chen Youfang Lin Huaiyu Wan OffRL CLL 373 1 0 04 Jun 2025
Understanding the learned look-ahead behavior of chess neural networks Diogo Cruz 304 0 0 26 May 2025
Optimization-Inspired Few-Shot Adaptation for Large Language Models Boyan Gao Xin Wang Jianlong Wu David A. Clifton 263 0 0 25 May 2025
From Compression to Expression: A Layerwise Analysis of In-Context Learning Jiachen Jiang Yuxin Dong Jinxin Zhou Zhihui Zhu 181 2 0 22 May 2025
Make LVLMs Focus: Context-Aware Attention Modulation for Better Multimodal In-Context Learning Yanshu Li JianJiang Yang Ziteng Yang Bozheng Li Yi Cao ... Ligong Han Yingjie Victor Chen Songlin Fei Dongfang Liu Ruixiang Tang 263 8 0 21 May 2025
Feature Extraction and Steering for Enhanced Chain-of-Thought Reasoning in Language Models Zihao Li Xu Wang Yuzhe Yang Ziyu Yao Haoyi Xiong Jundong Li LLMSV LRM 606 12 0 21 May 2025
Large Language Models as Computable Approximations to Solomonoff Induction Jun Wan Shansong Liu 230 0 0 21 May 2025
Pierce the Mists, Greet the Sky: Decipher Knowledge Overshadowing via Knowledge Circuit Analysis Haoming Huang Yibo Yan Jiahao Huo Xin Zou Xinfeng Li Kun Wang Xuming Hu 569 1 0 20 May 2025
GMSA: Enhancing Context Compression via Group Merging and Layer Semantic Alignment Jiwei Tang Zhicheng Zhang Shunlong Wu Jingheng Ye Lichen Bai ... Tingwei Lu Jiaqi Chen Lin Hai Hai-Tao Zheng Hong-Gee Kim 257 4 0 18 May 2025
A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models Junjie Ye Jessica Fan Zhaoyu Chen Wenjie Fu Chenyuan Yang ... Tao Gui Qi Zhang Peng Wang Jianping Fan Xuanjing Huang ALM 220 5 0 12 May 2025
Incomplete In-context Learning Wenqiang Wang Yangshijie Zhang 311 0 0 12 May 2025
Page Classification for Print Imaging PipelineColor Imaging: Displaying, Processing, Hardcopy, and Applications (CIC), 2017 Shaoyuan Xu Cheng Lu Mark Shaw Peter Bauer J. Allebach VLM 254 13 0 03 Apr 2025
Contextualize-then-Aggregate: Circuits for In-Context Learning in Gemma-2 2B Aleksandra Bakalova Yana Veitsman Xinting Huang Michael Hahn 298 6 0 31 Mar 2025
WindowKV: Task-Adaptive Group-Wise KV Cache Window Selection for Efficient LLM Inference Youhui Zuo Sibo Wei C. Zhang Zhuorui Liu Sibo Wei Dawei Song VLM 402 1 0 23 Mar 2025
HICD: Hallucination-Inducing via Attention Dispersion for Contrastive Decoding to Mitigate Hallucinations in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Xinyan Jiang Hang Ye Yongxin Zhu Xiaoying Zheng Zikang Chen Jun Gong 419 4 0 17 Mar 2025
Take Off the Training Wheels Progressive In-Context Learning for Effective AlignmentConference on Empirical Methods in Natural Language Processing (EMNLP), 2025 Zhenyu Liu Dongfang Li Xinshuo Hu X. Zhao Yibin Chen Baotian Hu Min Zhang 330 4 0 13 Mar 2025
TestNUC: Enhancing Test-Time Computing Approaches and Scaling through Neighboring Unlabeled Data ConsistencyAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Henry Peng Zou Zhengyao Gu Yue Zhou Yankai Chen Weizhi Zhang Liancheng Fang Yibo Wang Yangning Li Kay Liu Philip S. Yu 390 2 0 26 Feb 2025
LED-Merging: Mitigating Safety-Utility Conflicts in Model Merging with Location-Election-DisjointAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Qianli Ma Dongrui Liu Qian Chen Linfeng Zhang Jing Shao MoMe 972 3 0 24 Feb 2025
RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage Peter Yong Zhong Siyuan Chen Ruiqi Wang McKenna McCall Ben L. Titzer Heather Miller Phillip B. Gibbons LLMAG 364 18 0 17 Feb 2025
Lost in the Passage: Passage-level In-context Learning Does Not Necessarily Need a "Passage" Hao Sun Chenming Tang Gengyang Li Yunfang Wu AIMat 223 1 0 15 Feb 2025
Learning Task Representations from In-Context LearningAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Baturay Saglam Zhuoran Yang Zhuoran Yang Dionysis Kalogerias Amin Karbasi 274 7 0 08 Feb 2025
Mirage in the Eyes: Hallucination Attack on Multi-modal Large Language Models with Only Attention Sink Yining Wang Mi Zhang Junjie Sun Chenyue Wang Min Yang Hui Xue Jialing Tao Ranjie Duan Qingbin Liu 233 6 0 28 Jan 2025
Advancing General Multimodal Capability of Vision-language Models with Pyramid-descent Visual Position EncodingAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Ziyang Chen Mingxiao Li Zhongfu Chen Nan Du Xiaolong Li Yuexian Zou 355 3 0 19 Jan 2025
Controlling Out-of-Domain Gaps in LLMs for Genre Classification and Generated Text DetectionInternational Conference on Computational Linguistics (COLING), 2024 D. Roussinov Serge Sharoff Nadezhda Puchnina 257 2 0 31 Dec 2024