An Explanation of In-context Learning as Implicit Bayesian Inference

3 November 2021

Papers citing "An Explanation of In-context Learning as Implicit Bayesian Inference"

50 / 531 papers shown

Title
WebGLM: Towards An Efficient Web-Enhanced Question Answering System with Human Preferences Xiao Liu Hanyu Lai Hao Yu Yifan Xu Aohan Zeng Zhengxiao Du Peng-Zhen Zhang Yuxiao Dong Jie Tang 9 93 0 13 Jun 2023
TART: A plug-and-play Transformer module for task-agnostic reasoning Kush S. Bhatia A. Narayan Chris De Sa Christopher Ré LRM ReLM VLM 23 14 0 13 Jun 2023
In-Context Learning through the Bayesian Prism Madhuri Panwar Kabir Ahuja Navin Goyal BDL 25 38 0 08 Jun 2023
Multi-modal Latent Diffusion Mustapha Bounoua Giulio Franzese Pietro Michiardi DiffM 16 12 0 07 Jun 2023
Birth of a Transformer: A Memory Viewpoint A. Bietti Vivien A. Cabannes Diane Bouchacourt Hervé Jégou Léon Bottou 16 80 0 01 Jun 2023
On Masked Pre-training and the Marginal Likelihood Pablo Moreno-Muñoz Pol G. Recasens Søren Hauberg SSL 17 5 0 01 Jun 2023
Transformers learn to implement preconditioned gradient descent for in-context learning Kwangjun Ahn Xiang Cheng Hadi Daneshmand S. Sra ODL 17 147 0 01 Jun 2023
What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization Yufeng Zhang Fengzhuo Zhang Zhuoran Yang Zhaoran Wang BDL 36 62 0 30 May 2023
Contextual Vision Transformers for Robust Representation Learning Yu Bao Theofanis Karaletsos ViT 11 13 0 30 May 2023
Dissecting Chain-of-Thought: Compositionality through In-Context Filtering and Learning Yingcong Li Kartik K. Sreenivasan Angeliki Giannou Dimitris Papailiopoulos Samet Oymak LRM 8 16 0 30 May 2023
ChatGPT-powered Conversational Drug Editing Using Retrieval and Domain Feedback Shengchao Liu Jiong Wang Yijin Yang Chengpeng Wang Ling Liu Hongyu Guo Chaowei Xiao LM&MA KELM AI4MH 26 36 0 29 May 2023
Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Models Yuhui Zhang Michihiro Yasunaga Zhengping Zhou Jeff Z. HaoChen James Y. Zou Percy Liang Serena Yeung 25 7 0 27 May 2023
Im-Promptu: In-Context Composition from Image Prompts Bhishma Dedhia Michael Chang Jake C. Snell Thomas L. Griffiths N. Jha LRM MLLM 22 1 0 26 May 2023
A Mechanism for Sample-Efficient In-Context Learning for Sparse Retrieval Tasks Jacob D. Abernethy Alekh Agarwal T. V. Marinov Manfred K. Warmuth 8 17 0 26 May 2023
A Closer Look at In-Context Learning under Distribution Shifts Kartik Ahuja David Lopez-Paz 24 14 0 26 May 2023
Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspective Guhao Feng Bohang Zhang Yuntian Gu Haotian Ye Di He Liwei Wang LRM 27 210 0 24 May 2023
Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD Examples Abulhair Saparov Richard Yuanzhe Pang Vishakh Padmakumar Nitish Joshi Seyed Mehran Kazemi Najoung Kim He He ELM LRM 16 81 0 24 May 2023
Prompt Evolution for Generative AI: A Classifier-Guided Approach Melvin Wong Yew-Soon Ong Abhishek Gupta K. Bali Caishun Chen 16 14 0 24 May 2023
Self-ICL: Zero-Shot In-Context Learning with Self-Generated Demonstrations Wei-Lin Chen Cheng-Kuang Wu Yun-Nung Chen Hsin-Hsi Chen 8 27 0 24 May 2023
OverPrompt: Enhancing ChatGPT through Efficient In-Context Learning Jiazheng Li Runcong Zhao Yongxin Yang Yulan He Lin Gui 33 8 0 24 May 2023
Adversarial Demonstration Attacks on Large Language Models Jiong Wang Zi-yang Liu Keun Hee Park Zhuojun Jiang Zhaoheng Zheng Zhuofeng Wu Muhao Chen Chaowei Xiao SILM 15 51 0 24 May 2023
In-Context Impersonation Reveals Large Language Models' Strengths and Biases Leonard Salewski Stephan Alaniz Isabel Rio-Torto Eric Schulz Zeynep Akata 22 145 0 24 May 2023
Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners Xiaojuan Tang Zilong Zheng Jiaqi Li Fanxu Meng Song-Chun Zhu Yitao Liang Muhan Zhang ReLM LRM 10 52 0 24 May 2023
Active Learning Principles for In-Context Learning with Large Language Models Katerina Margatina Timo Schick Nikolaos Aletras Jane Dwivedi-Yu 20 39 0 23 May 2023
Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning Lean Wang Lei Li Damai Dai Deli Chen Hao Zhou Fandong Meng Jie Zhou Xu Sun 14 163 0 23 May 2023
Dr.ICL: Demonstration-Retrieved In-context Learning Man Luo Xin Xu Zhuyun Dai Panupong Pasupat Mehran Kazemi Chitta Baral Vaiva Imbrasaite Vincent Zhao RALM 24 48 0 23 May 2023
Concept-aware Training Improves In-context Learning Ability of Language Models Michal Štefánik Marek Kadlcík KELM LRM 25 0 0 23 May 2023
Discrete Prompt Optimization via Constrained Generation for Zero-shot Re-ranker Sukmin Cho Soyeong Jeong Jeongyeon Seo Jong C. Park OffRL 57 23 0 23 May 2023
Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations Chenglei Si Dan Friedman Nitish Joshi Shi Feng Danqi Chen He He 8 42 0 22 May 2023
Iterative Forward Tuning Boosts In-Context Learning in Language Models Jiaxi Yang Binyuan Hui Min Yang Bailin Wang Bowen Li Binhua Li Fei Huang Yongbin Li 25 15 0 22 May 2023
Meta-in-context learning in large language models Julian Coda-Forno Marcel Binz Zeynep Akata M. Botvinick Jane X. Wang Eric Schulz LRM 187 34 0 22 May 2023
Explaining Emergent In-Context Learning as Kernel Regression Chi Han Ziqi Wang H. Zhao Heng Ji LRM 21 11 0 22 May 2023
MolXPT: Wrapping Molecules with Text for Generative Pre-training Zequn Liu Wei Zhang Yingce Xia Lijun Wu Shufang Xie Tao Qin M. Zhang Tie-Yan Liu 16 66 0 18 May 2023
Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learning Dong-Ho Lee Kian Ahrabian Woojeong Jin Fred Morstatter Jay Pujara 17 31 0 17 May 2023
Compress, Then Prompt: Improving Accuracy-Efficiency Trade-off of LLM Inference with Transferable Prompt Zhaozhuo Xu Zirui Liu Beidi Chen Yuxin Tang Jue Wang Kaixiong Zhou Xia Hu Anshumali Shrivastava MQ 24 29 0 17 May 2023
M3KE: A Massive Multi-Level Multi-Subject Knowledge Evaluation Benchmark for Chinese Large Language Models Chuang Liu Renren Jin Yuqi Ren Linhao Yu Tianyu Dong ... Peiyi Zhang Qingqing Lyu Xiaowen Su Qun Liu Deyi Xiong ELM ALM 11 24 0 17 May 2023
What In-Context Learning "Learns" In-Context: Disentangling Task Recognition and Task Learning Jane Pan Tianyu Gao Howard Chen Danqi Chen 28 107 0 16 May 2023
Pre-Training to Learn in Context Yuxian Gu Li Dong Furu Wei Minlie Huang CLIP LRM ReLM 106 37 0 16 May 2023
Small Models are Valuable Plug-ins for Large Language Models Canwen Xu Yichong Xu Shuohang Wang Yang Liu Chenguang Zhu Julian McAuley LLMAG 34 42 0 15 May 2023
Exploring In-Context Learning Capabilities of Foundation Models for Generating Knowledge Graphs from Text H. Khorashadizadeh Nandana Mihindukulasooriya Sanju Tiwari Jinghua Groppe Sven Groppe 11 22 0 15 May 2023
Text Classification via Large Language Models Xiaofei Sun Xiaoya Li Jiwei Li Fei Wu Shangwei Guo Tianwei Zhang Guoyin Wang RALM LRM 32 134 0 15 May 2023
Multilingual LLMs are Better Cross-lingual In-context Learners with Alignment Eshaan Tanwar Subhabrata Dutta Manish Borthakur Tanmoy Chakraborty 10 52 0 10 May 2023
A Taxonomy of Foundation Model based Systems through the Lens of Software Architecture Qinghua Lu Liming Zhu Xiwei Xu Yue Liu Zhenchang Xing Jon Whittle 20 11 0 09 May 2023
CAT: A Contextualized Conceptualization and Instantiation Framework for Commonsense Reasoning Weiqi Wang Tianqing Fang Baixuan Xu Chun Yi Louis Bo Yangqiu Song Lei Chen ReLM LRM 17 34 0 08 May 2023
In-context Learning as Maintaining Coherency: A Study of On-the-fly Machine Translation Using Large Language Models Suzanna Sia Kevin Duh LRM 21 17 0 05 May 2023
AutoML-GPT: Automatic Machine Learning with GPT Shujian Zhang Chengyue Gong Lemeng Wu Xingchao Liu Mi Zhou LLMAG 52 59 0 04 May 2023
Few-shot In-context Learning for Knowledge Base Question Answering Tianle Li Xueguang Ma Alex Zhuang Yu Gu Yu-Chuan Su Wenhu Chen 94 75 0 02 May 2023
Accelerating Neural Self-Improvement via Bootstrapping Kazuki Irie Jürgen Schmidhuber 19 1 0 02 May 2023
In-Context Learning Unlocked for Diffusion Models Zhendong Wang Yifan Jiang Yadong Lu Yelong Shen Pengcheng He Weizhu Chen Zhangyang Wang Mingyuan Zhou VLM DiffM 86 68 0 01 May 2023
Large Language Models are Strong Zero-Shot Retriever Tao Shen Guodong Long Xiubo Geng Chongyang Tao Tianyi Zhou Daxin Jiang RALM KELM 35 33 0 27 Apr 2023