v1v2 (latest)

MetaICL: Learning to Learn In Context

North American Chapter of the Association for Computational Linguistics (NAACL), 2021

29 October 2021

Luke Zettlemoyer

Papers citing "MetaICL: Learning to Learn In Context"

38 / 388 papers shown

Title
Learning by Distilling Context Charles Burton Snell Dan Klein Ruiqi Zhong ReLM LRM 557 58 0 30 Sep 2022
Bidirectional Language Models Are Also Few-shot LearnersInternational Conference on Learning Representations (ICLR), 2022 Ajay Patel Bryan Li Mohammad Sadegh Rasooli Noah Constant Colin Raffel Chris Callison-Burch LRM 206 68 0 29 Sep 2022
On the Relation between Sensitivity and Accuracy in In-context LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Yanda Chen Chen Zhao Zhou Yu Kathleen McKeown He He 427 91 0 16 Sep 2022
Selective Annotation Makes Language Models Better Few-Shot LearnersInternational Conference on Learning Representations (ICLR), 2022 Hongjin Su Jungo Kasai Chen Henry Wu Weijia Shi Tianlu Wang ... Rui Zhang Mari Ostendorf Luke Zettlemoyer Noah A. Smith Tao Yu 257 299 0 05 Sep 2022
Reducing Retraining by Recycling Parameter-Efficient Prompts Brian Lester Joshua Yurtsever Siamak Shakeri Noah Constant 168 13 0 10 Aug 2022
What Can Transformers Learn In-Context? A Case Study of Simple Function ClassesNeural Information Processing Systems (NeurIPS), 2022 Shivam Garg Dimitris Tsipras Abigail Z. Jacobs Gregory Valiant 605 665 0 01 Aug 2022
Few-shot Adaptation Works with UnpredicTable DataAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Jun Shern Chan Michael Pieler Jonathan Jao Jérémy Scheurer Ethan Perez 458 6 0 01 Aug 2022
BioTABQA: Instruction Learning for Biomedical Table Question AnsweringConference and Labs of the Evaluation Forum (CLEF), 2022 Man Luo S. Saxena Swaroop Mishra Mihir Parmar Chitta Baral LMTD 316 17 0 06 Jul 2022
Making Large Language Models Better Reasoners with Step-Aware VerifierAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Yifei Li Zeqi Lin Shizhuo Zhang Qiang Fu B. Chen Jian-Guang Lou Weizhu Chen ReLM LRM 329 283 0 06 Jun 2022
Automatic Short Math Answer Grading via In-context Meta-learningEducational Data Mining (EDM), 2022 Mengxue Zhang Sami Baral Neil T. Heffernan Andrew Lan AI4Ed AIMat 351 32 0 30 May 2022
kNN-Prompt: Nearest Neighbor Zero-Shot InferenceConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Weijia Shi Julian Michael Suchin Gururangan Luke Zettlemoyer RALM VLM 188 40 0 27 May 2022
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction TuningConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Prakhar Gupta Cathy Jiao Yi-Ting Yeh Shikib Mehri M. Eskénazi Jeffrey P. Bigham ALM 316 54 0 25 May 2022
Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual GenerationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Tu Vu Aditya Barua Brian Lester Daniel Cer Mohit Iyyer Noah Constant CLL 317 71 0 25 May 2022
Know Where You're Going: Meta-Learning for Parameter-Efficient Fine-TuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Mozhdeh Gheini Xuezhe Ma Jonathan May 125 9 0 25 May 2022
ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft PromptsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Akari Asai Mohammadreza Salehi Matthew E. Peters Hannaneh Hajishirzi 377 119 0 24 May 2022
Instruction Induction: From Few Examples to Natural Language Task DescriptionsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Or Honovich Uri Shaham Samuel R. Bowman Omer Levy ELM LRM 452 177 0 22 May 2022
Automated Scoring for Reading Comprehension via In-context BERT TuningInternational Conference on Artificial Intelligence in Education (AIED), 2022 Nigel Fernandez Aritra Ghosh Naiming Liu Zichao Wang Benoît Choffin Richard Baraniuk Andrew Lan 93 29 0 19 May 2022
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context LearningNeural Information Processing Systems (NeurIPS), 2022 Haokun Liu Derek Tam Mohammed Muqeeth Jay Mohta Tenghao Huang Joey Tianyi Zhou Colin Raffel 449 1,148 0 11 May 2022
Towards Unified Prompt Tuning for Few-shot Text ClassificationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Jiadong Wang Chengyu Wang Fuli Luo Chuanqi Tan Minghui Qiu Fei Yang Qiuhui Shi Songfang Huang Ming Gao VLM 120 34 0 11 May 2022
Improving In-Context Few-Shot Learning via Self-Supervised TrainingNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 Mingda Chen Jingfei Du Ramakanth Pasunuru Todor Mihaylov Srini Iyer Ves Stoyanov Zornitsa Kozareva SSL AI4MH 302 76 0 03 May 2022
OPT: Open Pre-trained Transformer Language Models Susan Zhang Stephen Roller Naman Goyal Mikel Artetxe Moya Chen ... Daniel Simig Punit Singh Koura Anjali Sridhar Tianlu Wang Luke Zettlemoyer VLM OSLM AI4CE 839 4,348 0 02 May 2022
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning Ehud D. Karpas Omri Abend Yonatan Belinkov Barak Lenz Opher Lieber ... Erez Schwartz Gal Shachaf Shai Shalev-Shwartz Amnon Shashua Moshe Tenenholtz LLMAG 233 103 0 01 May 2022
On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language ModelNorth American Chapter of the Association for Computational Linguistics (NAACL), 2022 Seongjin Shin Sang-Woo Lee Hwijeen Ahn Sungdong Kim Hyoungseok Kim ... Dong Wang Gichang Lee W. Park Jung-Woo Ha Nako Sung LRM 295 105 0 28 Apr 2022
Standing on the Shoulders of Giant Frozen Language Models Yoav Levine Itay Dalmedigos Ori Ram Yoel Zeldes Daniel Jannai ... Barak Lenz Shai Shalev-Shwartz Amnon Shashua Kevin Leyton-Brown Y. Shoham VLM 216 52 0 21 Apr 2022
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP TasksConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Yizhong Wang Swaroop Mishra Pegah Alipoormolabashi Yeganeh Kordi Amirreza Mirzaei ... Chitta Baral Yejin Choi Noah A. Smith Hannaneh Hajishirzi Daniel Khashabi ELM 623 1,004 0 16 Apr 2022
In-BoXBART: Get Instructions into Biomedical Multi-Task Learning Mihir Parmar Swaroop Mishra Mirali Purohit Man Luo M. H. Murad Chitta Baral 209 23 0 15 Apr 2022
Improving Passage Retrieval with Zero-Shot Question GenerationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Devendra Singh Sachan M. Lewis Mandar Joshi Armen Aghajanyan Anuj Kumar J. Pineau Luke Zettlemoyer OOD LRM 406 204 0 15 Apr 2022
CLUES: A Benchmark for Learning Classifiers using Natural Language ExplanationsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Rakesh R Menon Sayan Ghosh Shashank Srivastava LRM ELM 238 12 0 14 Apr 2022
Evaluating Prompts Across Multiple Choice Tasks In a Zero-Shot Setting Gabriel Orlanski LRM 145 2 0 29 Mar 2022
How Many Data Samples is an Additional Instruction Worth?Findings (Findings), 2022 Ravsehaj Singh Puri Swaroop Mishra Mihir Parmar Chitta Baral 321 20 0 17 Mar 2022
In-Context Learning for Few-Shot Dialogue State TrackingConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Yushi Hu Chia-Hsuan Lee Tianbao Xie Tao Yu Noah A. Smith Mari Ostendorf BDL 316 70 0 16 Mar 2022
Combining Modular Skills in Multitask Learning Edoardo Ponti Alessandro Sordoni Yoshua Bengio Siva Reddy MoE 291 42 0 28 Feb 2022
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Sewon Min Xinxi Lyu Ari Holtzman Mikel Artetxe M. Lewis Hannaneh Hajishirzi Luke Zettlemoyer LLMAG LRM 492 1,802 0 25 Feb 2022
PromptSource: An Integrated Development Environment and Repository for Natural Language PromptsAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Stephen H. Bach Victor Sanh Zheng-Xin Yong Albert Webson Colin Raffel ... Khalid Almubarak Xiangru Tang Dragomir R. Radev Mike Tian-Jian Jiang Alexander M. Rush VLM 611 393 0 02 Feb 2022
Meta-learning via Language Model In-context Tuning Yanda Chen Ruiqi Zhong Sheng Zha George Karypis He He 490 191 0 15 Oct 2021
Context-NER : Contextual Phrase Generation at Scale Himanshu Gupta Shreyas Verma Santosh Mashetty Swaroop Mishra 335 12 0 16 Sep 2021
Finetuned Language Models Are Zero-Shot Learners Jason W. Wei Maarten Bosma Vincent Zhao Kelvin Guu Adams Wei Yu Brian Lester Nan Du Andrew M. Dai Quoc V. Le ALM UQCV 1.4K 4,576 0 03 Sep 2021
Do Prompt-Based Models Really Understand the Meaning of their Prompts? Albert Webson Ellie Pavlick LRM 394 425 0 02 Sep 2021