v1v2 (latest)

MetaICL: Learning to Learn In Context

North American Chapter of the Association for Computational Linguistics (NAACL), 2021

29 October 2021

Luke Zettlemoyer

Papers citing "MetaICL: Learning to Learn In Context"

50 / 388 papers shown

Title
A Survey on Mathematical Reasoning and Optimization with Large Language Models Ali Forootani OffRL LRM AI4CE 288 11 0 22 Mar 2025
Understanding the Generalization of In-Context Learning in Transformers: An Empirical StudyInternational Conference on Learning Representations (ICLR), 2025 Xingxuan Zhang Haoran Wang Jiansheng Li Yuan Xue Shikai Guan Renzhe Xu Hao Zou Han Yu Peng Cui 203 5 0 19 Mar 2025
Sample-aware Adaptive Structured Pruning for Large Language ModelsAAAI Conference on Artificial Intelligence (AAAI), 2025 Jun Kong Xinge Ma Jin Wang Xuejie Zhang 215 0 0 08 Mar 2025
ViDoRAG: Visual Document Retrieval-Augmented Generation via Dynamic Iterative Reasoning Agents Qiuchen Wang Ruixue Ding Zehui Chen Weiqi Wu Shihang Wang Pengjun Xie Feng Zhao 287 29 0 25 Feb 2025
Towards Auto-Regressive Next-Token Prediction: In-Context Learning Emerges from GeneralizationInternational Conference on Learning Representations (ICLR), 2025 Zixuan Gong Xiaolin Hu Huayi Tang Yong Liu 332 2 0 24 Feb 2025
On the Robustness of Transformers against Context Hijacking for Linear Classification Tianle Li Chenyang Zhang Xingwu Chen Yuan Cao Difan Zou 385 3 0 24 Feb 2025
Unveiling Reasoning Thresholds in Language Models: Scaling, Fine-Tuning, and Interpretability through Attention Maps Yen-Che Hsiao Abhishek Dutta LRM ReLM ELM 251 1 0 24 Feb 2025
Vector-ICL: In-context Learning with Continuous Vector RepresentationsInternational Conference on Learning Representations (ICLR), 2024 Yufan Zhuang Chandan Singh Liyuan Liu Jingbo Shang Jianfeng Gao 420 10 0 21 Feb 2025
Divergent Thoughts toward One Goal: LLM-based Multi-Agent Collaboration System for Electronic Design AutomationNorth American Chapter of the Association for Computational Linguistics (NAACL), 2025 Haoyuan Wu Haisheng Zheng Zhuolun He Bei Yu 235 8 0 15 Feb 2025
Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training Reza Shirkavand Qi He Qi He Heng-Chiao Huang ALM 535 1 0 05 Feb 2025
Understanding Before Reasoning: Enhancing Chain-of-Thought with Iterative Summarization Pre-Prompting Dong-Hai Zhu Yu-Jie Xiong Jia-Chen Zhang Xi-Jiong Xie Chun-Ming Xia ReLM LRM 199 4 0 08 Jan 2025
Mathematical Language Models: A Survey Wen Liu Hanglei Hu Jie Zhou Yuyang Ding Junsong Li ... Mengliang He Qin Chen Bo Jiang Aimin Zhou Liang He LRM 588 21 0 03 Jan 2025
In-Context Learning with Iterative Demonstration SelectionConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Chengwei Qin Aston Zhang Chong Chen Anirudh Dagar Wenming Ye LRM 438 73 0 31 Dec 2024
Out-of-distribution generalization via composition: a lens through induction heads in TransformersProceedings of the National Academy of Sciences of the United States of America (PNAS), 2024 Jiajun Song Zhuoyan Xu Yiqiao Zhong 336 19 0 31 Dec 2024
Geo-LLaVA: A Large Multi-Modal Model for Solving Geometry Math Problems with Meta In-Context Learning Shihao Xu Yiyang Luo Wei Shi LRM ReLM 249 10 0 12 Dec 2024
Evaluating LLMs Capabilities Towards Understanding Social DynamicsInternational Conference on Advances in Social Networks Analysis and Mining (ASONAM), 2024 Anique Tahir Lu Cheng Manuel Sandoval Yasin N. Silva Deborah L. Hall Huan Liu 287 1 0 20 Nov 2024
Teaching VLMs to Localize Specific Objects from In-context Examples Sivan Doveh Nimrod Shabtay Wei Lin Eli Schwartz Hilde Kuehne ... Leonid Karlinsky James Glass Assaf Arbelle S. Ullman Muhammad Jehanzeb Mirza VLM 428 2 0 20 Nov 2024
ITACLIP: Boosting Training-Free Semantic Segmentation with Image, Text, and Architectural Enhancements M. Arda Aydın Efe Mert Çırpar Elvin Abdinli Gözde B. Ünal Y. Sahin VLM 623 3 0 18 Nov 2024
Improving Grapheme-to-Phoneme Conversion through In-Context Knowledge Retrieval with Large Language ModelsInternational Symposium on Chinese Spoken Language Processing (ISCSLP), 2024 Dongrui Han Mingyu Cui Jiawen Kang Xixin Wu Xunying Liu Helen Meng 193 2 0 12 Nov 2024
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward PassInternational Conference on Learning Representations (ICLR), 2024 Tong Chen Hao Fang Patrick Xia Xiaodong Liu Benjamin Van Durme Luke Zettlemoyer Jianfeng Gao Hao Cheng KELM 312 7 0 08 Nov 2024
Comparative Analysis of Demonstration Selection Algorithms for LLM In-Context Learning Dong Shu Jundong Li 184 3 0 30 Oct 2024
RARe: Retrieval Augmented Retrieval with In-Context Examples Atula Tejaswi Yoonsang Lee Sujay Sanghavi Eunsol Choi RALM LRM 184 2 0 26 Oct 2024
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies Liwen Wang Sheng Chen Linnan Jiang Shu Pan Runze Cai Sen Yang Fei Yang 518 14 0 24 Oct 2024
CorrectionLM: Self-Corrections with SLM for Dialogue State Tracking Chia-Hsuan Lee Hao Cheng Mari Ostendorf LRM 158 0 0 23 Oct 2024
Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient DescentInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2024 Bo Chen Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao Song 440 28 0 15 Oct 2024
ELICIT: LLM Augmentation via External In-Context CapabilityInternational Conference on Learning Representations (ICLR), 2024 Futing Wang Jianhao Yan Yue Zhang Tao Lin 346 5 0 12 Oct 2024
VoxelPrompt: A Vision Agent for End-to-End Medical Image Analysis Andrew Hoopes Neel Dey V. Butoi John Guttag Adrian V. Dalca MedIm LM&MA 381 3 0 10 Oct 2024
Learning to Learn with Contrastive Meta-Objective Shiguang Wu Yaqing Wang Yatao Bian Quanming Yao CLL 564 0 0 08 Oct 2024
PortLLM: Personalizing Evolving Large Language Models with Training-Free and Portable Model PatchesInternational Conference on Learning Representations (ICLR), 2024 Rana Muhammad Shahroz Khan Pingzhi Li Sukwon Yun Zhenyu Wang S. Nirjon Chau-Wai Wong Tianlong Chen KELM 340 3 0 08 Oct 2024
GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models Muhammad Jehanzeb Mirza Mengjie Zhao Zhuoyuan Mao Sivan Doveh Wei Lin ... Yuki Mitsufuji Horst Possegger Rogerio Feris Leonid Karlinsky James Glass VLM 646 3 0 08 Oct 2024
Task Diversity Shortens the ICL Plateau Jaeyeon Kim Sehyun Kwon Joo Young Choi Jongho Park Jaewoong Cho Jason D. Lee Ernest K. Ryu MoMe 350 3 0 07 Oct 2024
Accelerating Inference of Networks in the Frequency DomainACM Multimedia Asia (MMAsia), 2024 Chenqiu Zhao Guanfang Dong Anup Basu 304 50 0 06 Oct 2024
SMILE: Speech Meta In-Context Learning for Low-Resource Language Automatic Speech Recognition Ming-Hao Hsu Kuan Po Huang 325 3 0 16 Sep 2024
AlpaPICO: Extraction of PICO Frames from Clinical Trial Documents Using LLMs Madhusudan Ghosh Shrimon Mukherjee Asmit Ganguly Partha Basuchowdhuri S. Naskar Debasis Ganguly 242 14 0 15 Sep 2024
Prompt Tuning as User Inherent Profile Inference Machine Yusheng Lu Zhaocheng Du Xiangyang Li Pengyue Jia Yejing Wang ... Huifeng Guo Ruiming Tang Zhenhua Dong Yongrui Duan Xiangyu Zhao 168 1 0 13 Aug 2024
Do Large Language Models Have Compositional Ability? An Investigation into Limitations and Scalability Zhuoyan Xu Zhenmei Shi Yingyu Liang CoGe LRM 354 52 0 22 Jul 2024
In-Context Learning Improves Compositional Understanding of Vision-Language Models Matteo Nulli Anesa Ibrahimi Avik Pal Hoshe Lee Ivona Najdenkoska VLM CoGe 160 0 0 22 Jul 2024
Empowering Persian LLMs for Instruction Following: A Novel Dataset and Training Approach Hojjat Mokhtarabadi Ziba Zamani Abbas Maazallahi Hossein Manshaei 236 0 0 15 Jul 2024
Sub-SA: Strengthen In-context Learning via Submodular Selective Annotation Jian Qian Miao Sun Sifan Zhou Ziyu Zhao Ruizhi Hun Patrick Chiang 333 2 0 08 Jul 2024
AI Safety in Generative AI Large Language Models: A Survey Jaymari Chua Yun Yvonna Li Shiyi Yang Chen Wang Lina Yao LM&MA 341 36 0 06 Jul 2024
Stephanie: Step-by-Step Dialogues for Mimicking Human Interactions in Social Conversations Hao Yang Hongyuan Lu Xinhua Zeng Yang Liu Xiang Zhang Haoran Yang Yumeng Zhang Shan Huang Yiran Wei Wai Lam 214 4 0 04 Jul 2024
Why does in-context learning fail sometimes? Evaluating in-context learning on open and closed questions Xiang Li Haoran Tang Siyu Chen Ziwei Wang Ryan Chen Marcin Abram LRM 246 4 0 02 Jul 2024
Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application Chuanpeng Yang Wang Lu Yao Zhu Yidong Wang Qian Chen Chenlong Gao Bingjie Yan Yiqiang Chen ALM KELM 276 69 0 02 Jul 2024
Enhancing In-Context Learning via Implicit Demonstration Augmentation Xiaoling Zhou Wei Ye Yidong Wang Chaoya Jiang Zhemg Lee Rui Xie Shikun Zhang 241 12 0 27 Jun 2024
DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph Zhehao Zhang Jiaao Chen Diyi Yang LRM 215 23 0 25 Jun 2024
Token-based Decision Criteria Are Suboptimal in In-context Learning Hakaze Cho Yoshihiro Sakai Mariko Kato Kenshiro Tanaka Akira Ishii Naoya Inoue 483 6 0 24 Jun 2024
ICLEval: Evaluating In-Context Learning Ability of Large Language Models Wentong Chen Yankai Lin ZhenHao Zhou HongYun Huang Yantao Jia Bo Zhao Ji-Rong Wen ELM 194 8 0 21 Jun 2024
Instruction Pre-Training: Language Models are Supervised Multitask Learners Daixuan Cheng Yuxian Gu Shaohan Huang Junyu Bi Shiyu Huang Furu Wei SyDa 301 54 0 20 Jun 2024
SeCoKD: Aligning Large Language Models for In-Context Learning with Fewer Shots Weixing Wang Haojin Yang Christoph Meinel 236 0 0 20 Jun 2024
Using LLMs to Aid Annotation and Collection of Clinically-Enriched Data in Bipolar Disorder and SchizophreniaWorkshop on Computational Linguistics and Clinical Psychology (CLPsych), 2024 Ankit Aich Avery Quynh Pamela Osseyi Amy Pinkham Philip Harvey Brenda L. Curtis Colin A. Depp Natalie Parde AI4MH 107 5 0 18 Jun 2024