v1v2 (latest)

MetaICL: Learning to Learn In Context

North American Chapter of the Association for Computational Linguistics (NAACL), 2021

29 October 2021

Luke Zettlemoyer

Papers citing "MetaICL: Learning to Learn In Context"

50 / 388 papers shown

Title
ICE-SEARCH: A Language Model-Driven Feature Selection Approach T. Yang Tim Tianyi Yang Fuyuan Lyu Shaoshan Liu Xue Xue Liu 415 7 0 28 Feb 2024
A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems Zihao Yi Jiarui Ouyang Yuwen Liu Yuwen Liu Tianhao Liao Haohao Luo Ying Shen LRM LLMAG 353 147 0 28 Feb 2024
Investigating the Effectiveness of HyperTuning via Gisting Jason Phang 275 1 0 26 Feb 2024
In-Context Learning of a Linear Transformer Block: Benefits of the MLP Component and One-Step GD Initialization Ruiqi Zhang Jingfeng Wu Peter L. Bartlett 300 28 0 22 Feb 2024
Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks Minju Seo Jinheon Baek James Thorne Sung Ju Hwang RALM 234 19 0 21 Feb 2024
The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysis Miaoran Zhang Vagrant Gautam Mingyang Wang Jesujoba Oluwadara Alabi Xiaoyu Shen Dietrich Klakow Marius Mosbach 234 13 0 20 Feb 2024
An Empirical Categorization of Prompting Techniques for Large Language Models: A Practitioner's Guide Oluwole Fagbohun Rachel M. Harrison Anton Dereventsov 269 19 0 18 Feb 2024
Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model Ahmet Üstün Viraat Aryabumi Zheng-Xin Yong Wei-Yin Ko Daniel D'souza ... Shayne Longpre Niklas Muennighoff Marzieh Fadaee Julia Kreutzer Sara Hooker ALM ELM SyDa LRM 245 312 0 12 Feb 2024
Aya Dataset: An Open-Access Collection for Multilingual Instruction TuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Shivalika Singh Freddie Vargus Daniel D'souza Börje F. Karlsson Abinaya Mahendiran ... Max Bartolo Julia Kreutzer Ahmet Üstün Marzieh Fadaee Sara Hooker 391 174 0 09 Feb 2024
NoisyICL: A Little Noise in Model Parameters Calibrates In-context Learning Yufeng Zhao Yoshihiro Sakai Naoya Inoue 282 7 0 08 Feb 2024
In-Context Principle Learning from Mistakes Tianjun Zhang Aman Madaan Luyu Gao Steven Zheng Swaroop Mishra Yiming Yang Niket Tandon Uri Alon KELM ReLM 192 36 0 08 Feb 2024
Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks Jongho Park Jaeseung Park Zheyang Xiong Nayoung Lee Jaewoong Cho Samet Oymak Kangwook Lee Dimitris Papailiopoulos 368 103 0 06 Feb 2024
Point and Instruct: Enabling Precise Image Editing by Unifying Direct Manipulation and Text Instructions Alec Helbling Seongmin Lee Polo Chau 113 1 0 05 Feb 2024
Can MLLMs Perform Text-to-Image In-Context Learning? Yuchen Zeng Wonjun Kang Yicong Chen Hyung Il Koo Kangwook Lee MLLM 247 14 0 02 Feb 2024
What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection Shangbin Feng Herun Wan Ningnan Wang Zhaoxuan Tan Minnan Luo Yulia Tsvetkov AAML DeLMO 420 36 0 01 Feb 2024
Superiority of Multi-Head Attention in In-Context Linear Regression Yingqian Cui Jie Ren Pengfei He Shucheng Zhou Yue Xing 205 21 0 30 Jan 2024
An Information-Theoretic Analysis of In-Context LearningInternational Conference on Machine Learning (ICML), 2024 Hong Jun Jeon Jason D. Lee Qi Lei Benjamin Van Roy 345 34 0 28 Jan 2024
Enhancing In-context Learning via Linear Probe CalibrationInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2024 Momin Abbas Yi Zhou Parikshit Ram Nathalie Baracaldo Horst Samulowitz Theodoros Salonidis Tianyi Chen 228 17 0 22 Jan 2024
PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System SafetyAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Zaibin Zhang Yongting Zhang Lijun Li Hongzhi Gao Lijun Wang Huchuan Lu Feng Zhao Yu Qiao Jing Shao LLMAG 330 71 0 22 Jan 2024
In-context Learning with Retrieved Demonstrations for Language Models: A Survey an Luo Xin Xu Yue Liu Panupong Pasupat Mehran Kazemi RALM 658 78 0 21 Jan 2024
Instructional Fingerprinting of Large Language ModelsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Lyne Tchapmi Fei Wang Mingyu Derek Ma Pang Wei Koh Chaowei Xiao Muhao Chen WaLM 255 54 0 21 Jan 2024
Large Language Models for Scientific Information Extraction: An Empirical Study for Virology Mahsa Shamsabadi Jennifer D'Souza Sören Auer 293 12 0 18 Jan 2024
Large Language Models Are Neurosymbolic ReasonersAAAI Conference on Artificial Intelligence (AAAI), 2024 Meng Fang Shilong Deng Yudi Zhang Zijing Shi Ling-Hao Chen Mykola Pechenizkiy Jun Wang LRM LM&Ro LLMAG 197 38 0 17 Jan 2024
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Zhengxin Zhang Dan Zhao Xupeng Miao Xupeng Miao Qing Li Yong Jiang Zhihao Jia MQ 185 11 0 13 Jan 2024
Mind Your Format: Towards Consistent Evaluation of In-Context Learning ImprovementsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Anton Voronov Lena Wolf Max Ryabinin 313 72 0 12 Jan 2024
Misconfidence-based Demonstration Selection for LLM In-Context Learning Shangqing Xu Chao Zhang 220 22 0 12 Jan 2024
Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Shuai Zhao Meihuizi Jia Anh Tuan Luu Fengjun Pan Jinming Wen AAML 467 69 0 11 Jan 2024
RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust AdaptationInternational Conference on Machine Learning (ICML), 2024 Mahdi Nikdan Soroush Tabesh Elvir Crnčević Dan Alistarh 469 45 0 09 Jan 2024
Beyond Output Matching: Bidirectional Alignment for Enhanced In-Context Learning Chengwei Qin Wenhan Xia Fangkai Jiao Chen Chen Yuchen Hu Bosheng Ding R. Chen Shafiq Joty 347 7 0 28 Dec 2023
Large Language Models are Miscalibrated In-Context Learners Chengzu Li Han Zhou Goran Glavaš Anna Korhonen Ivan Vulić 216 11 0 21 Dec 2023
A Survey of Reasoning with Foundation Models Jiankai Sun Chuanyang Zheng Enze Xie Zhengying Liu Ruihang Chu ... Xipeng Qiu Yi-Chen Guo Hui Xiong Qun Liu Zhenguo Li ReLM LRM AI4CE 573 52 0 17 Dec 2023
Catwalk: A Unified Language Model Evaluation Framework for Many Datasets Dirk Groeneveld Anas Awadalla Iz Beltagy Akshita Bhagia Ian H. Magnusson Hao Peng Oyvind Tafjord Pete Walsh Kyle Richardson Jesse Dodge 257 2 0 15 Dec 2023
ICL Markup: Structuring In-Context Learning using Soft-Token Tags Marc-Etienne Brunet Ashton Anderson R. Zemel 177 6 0 12 Dec 2023
Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs O. Ovadia Menachem Brief Moshik Mishaeli Oren Elisha RALM 373 218 0 10 Dec 2023
Toward Open-ended Embodied Tasks Solving William Wei Wang Dongqi Han Xufang Luo Yifei Shen Charles Ling Boyu Wang Dongsheng Li AI4CE 190 5 0 10 Dec 2023
DeceptPrompt: Exploiting LLM-driven Code Generation via Adversarial Natural Language Instructions Fangzhou Wu Xiaogeng Liu Chaowei Xiao AAML SILM 297 37 0 07 Dec 2023
Hijacking Context in Large Multi-modal Models Joonhyun Jeong MLLM 235 11 0 07 Dec 2023
Compressed Context Memory For Online Language Model Interaction Jang-Hyun Kim Junyoung Yeom Sangdoo Yun Hyun Oh Song KELM 286 27 1 06 Dec 2023
Towards More Unified In-context Visual UnderstandingComputer Vision and Pattern Recognition (CVPR), 2023 Dianmo Sheng DongDong Chen Zhentao Tan Qiankun Liu Qi Chu Jianmin Bao Tao Gong Bin Liu Shengwei Xu Nenghai Yu MLLM VLM 200 13 0 05 Dec 2023
MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-FollowingInternational Conference on Learning Representations (ICLR), 2023 Renze Lou Kai Zhang Jian Xie Yuxuan Sun Janice Ahn Hanzi Xu Yu Su Wenpeng Yin 264 36 0 05 Dec 2023
Improving In-Context Learning in Diffusion Models with Visual Context-Modulated Prompts Tianqi Chen Yongfei Liu Zhendong Wang Jianbo Yuan Quanzeng You Hongxia Yang Mingyuan Zhou VLM 214 6 0 03 Dec 2023
Dolphins: Multimodal Language Model for DrivingEuropean Conference on Computer Vision (ECCV), 2023 Yingzi Ma Yulong Cao Jiachen Sun Marco Pavone Chaowei Xiao MLLM 310 124 0 01 Dec 2023
MM-Narrator: Narrating Long-form Videos with Multimodal In-Context LearningComputer Vision and Pattern Recognition (CVPR), 2023 Chaoyi Zhang Kevin Qinghong Lin Zhengyuan Yang Jianfeng Wang Linjie Li Chung-Ching Lin Zicheng Liu Lijuan Wang VGen 250 48 0 29 Nov 2023
Surpassing GPT-4 Medical Coding with a Two-Stage Approach Zhichao Yang S. S. Batra Joel Stremmel Eran Halperin ELM 273 11 0 22 Nov 2023
Drilling Down into the Discourse Structure with LLMs for Long Document Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Inderjeet Nair Shwetha Somasundaram Apoorv Saxena Koustava Goswami RALM 218 11 0 22 Nov 2023
Visual Analytics for Generative Transformer Models Raymond Li Ruixin Yang Wen Xiao Ahmed AbuRaed Gabriel Murray Giuseppe Carenini 205 3 0 21 Nov 2023
How Far Can We Extract Diverse Perspectives from Large Language Models? Shirley Anugrah Hayati Linghe Wang Dheeraj Rajagopal Luan Tuyen Chau 349 15 0 16 Nov 2023
SQATIN: Supervised Instruction Tuning Meets Question Answering for Improved Dialogue NLU E. Razumovskaia Goran Glavaš Anna Korhonen Ivan Vulić LRM 293 6 0 16 Nov 2023
In-context Learning Generalizes, But Not Always Robustly: The Case of SyntaxNorth American Chapter of the Association for Computational Linguistics (NAACL), 2023 Aaron Mueller Albert Webson Jackson Petty Tal Linzen ReLM LRM 248 20 0 13 Nov 2023
In-Context Learning for MIMO Equalization Using Transformer-Based Sequence Models Matteo Zecchin Kai Yu Osvaldo Simeone 261 21 0 10 Nov 2023

All Papers

MetaICL: Learning to Learn In Context

Papers citing "MetaICL: Learning to Learn In Context"