An Explanation of In-context Learning as Implicit Bayesian Inference

3 November 2021

Papers citing "An Explanation of In-context Learning as Implicit Bayesian Inference"

50 / 531 papers shown

Title
Enhancing In-Context Learning Performance with just SVD-Based Weight Pruning: A Theoretical Perspective Xinhao Yao Xiaolin Hu Shenzhi Yang Yong Liu 28 2 0 06 Jun 2024
What Should Embeddings Embed? Autoregressive Models Represent Latent Generating Distributions Liyi Zhang Michael Y. Li Thomas L. Griffiths 35 2 0 06 Jun 2024
Exact Conversion of In-Context Learning to Model Weights in Linearized-Attention Transformers Brian K Chen Tianyang Hu Hui Jin Hwee Kuan Lee Kenji Kawaguchi 38 0 0 05 Jun 2024
On the Intrinsic Self-Correction Capability of LLMs: Uncertainty and Latent Concept Guangliang Liu Haitao Mao Bochuan Cao Zhiyu Xue K. Johnson Jiliang Tang Rongrong Wang LRM 26 9 0 04 Jun 2024
Iteration Head: A Mechanistic Study of Chain-of-Thought Vivien A. Cabannes Charles Arnal Wassim Bouaziz Alice Yang Francois Charton Julia Kempe LRM 27 7 0 04 Jun 2024
Eliciting the Priors of Large Language Models using Iterated In-Context Learning Jian-Qiao Zhu Thomas L. Griffiths BDL 30 2 0 04 Jun 2024
In-Context Learning of Physical Properties: Few-Shot Adaptation to Out-of-Distribution Molecular Graphs Grzegorz Kaszuba Amirhossein D. Naghdi Dario Massa Stefanos Papanikolaou Andrzej Jaszkiewicz Piotr Sankowski AI4CE OODD 35 0 0 03 Jun 2024
Universal In-Context Approximation By Prompting Fully Recurrent Models Aleksandar Petrov Tom A. Lamb Alasdair Paren Philip H. S. Torr Adel Bibi LRM 32 0 0 03 Jun 2024
Latent Logic Tree Extraction for Event Sequence Explanation from LLMs Zitao Song Chao Yang Chaojie Wang Bo An Shuang Li 40 4 0 03 Jun 2024
LOLA: LLM-Assisted Online Learning Algorithm for Content Experiments Zikun Ye Hema Yoganarasimhan Yufeng Zheng 31 2 0 03 Jun 2024
Guiding ChatGPT to Generate Salient Domain Summaries Jun Gao Ziqiang Cao Shaoyao Huang Luozheng Qin Chunhui Ai 34 0 0 03 Jun 2024
Is In-Context Learning in Large Language Models Bayesian? A Martingale Perspective Fabian Falck Ziyu Wang Chris Holmes 58 12 0 02 Jun 2024
Enhancing Jailbreak Attack Against Large Language Models through Silent Tokens Jiahao Yu Haozheng Luo Jerry Yao-Chieh Hu Wenbo Guo Han Liu Xinyu Xing 33 18 0 31 May 2024
From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems Jianliang He Siyu Chen Fengzhuo Zhang Zhuoran Yang LM&Ro LLMAG 40 2 0 30 May 2024
Why Larger Language Models Do In-context Learning Differently? Zhenmei Shi Junyi Wei Zhuoyan Xu Yingyu Liang 37 18 0 30 May 2024
Does learning the right latent variables necessarily improve in-context learning? Sarthak Mittal Eric Elmoznino Léo Gagnon Sangnie Bhardwaj Dhanya Sridhar Guillaume Lajoie 27 4 0 29 May 2024
IM-Context: In-Context Learning for Imbalanced Regression Tasks Ismail Nejjar Faez Ahmed Olga Fink 27 1 0 28 May 2024
Unifying Demonstration Selection and Compression for In-Context Learning Jun Gao Ziqiang Cao Wenjie Li 27 3 0 27 May 2024
On Mesa-Optimization in Autoregressively Trained Transformers: Emergence and Capability Chenyu Zheng Wei Huang Rongzheng Wang Guoqiang Wu Jun Zhu Chongxuan Li 34 1 0 27 May 2024
Automatic Domain Adaptation by Transformers in In-Context Learning Ryuichiro Hataya Kota Matsui Masaaki Imaizumi 32 1 0 27 May 2024
Cost-Effective Online Multi-LLM Selection with Versatile Reward Models Xiangxiang Dai Jin Li Xutong Liu Anqi Yu J. C. Lui 41 5 0 26 May 2024
Evaluating the Adversarial Robustness of Retrieval-Based In-Context Learning for Large Language Models Simon Chi Lok Yu Jie He Pasquale Minervini Jeff Z. Pan 21 0 0 24 May 2024
Off-the-shelf ChatGPT is a Good Few-shot Human Motion Predictor Haoxuan Qu Zhaoyang He Zeyu Hu Yujun Cai Jun Liu 33 1 0 24 May 2024
From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks Jacob Russin Sam Whitman McGrath Danielle J. Williams Lotem Elber-Dorozko AI4CE 61 2 0 24 May 2024
OptLLM: Optimal Assignment of Queries to Large Language Models Yueyue Liu Hongyu Zhang Yuantian Miao Van-Hoang Le Zhiqiang Li 18 2 0 24 May 2024
Towards Better Understanding of In-Context Learning Ability from In-Context Uncertainty Quantification Shang Liu Zhongze Cai Guanting Chen Xiaocheng Li UQCV 38 1 0 24 May 2024
In-context Time Series Predictor Jiecheng Lu Yan Sun Shihao Yang AI4TS 30 4 0 23 May 2024
Understanding the Training and Generalization of Pretrained Transformer for Sequential Decision Making Hanzhao Wang Yu Pan Fupeng Sun Shang Liu K. Talluri Guanting Chen Xiaocheng Li OffRL 50 1 0 23 May 2024
Implicit In-context Learning Zhuowei Li Zihao Xu Ligong Han Yunhe Gao Song Wen Di Liu Hao Wang Dimitris N. Metaxas 38 1 0 23 May 2024
DETAIL: Task DEmonsTration Attribution for Interpretable In-context Learning Zijian Zhou Xiaoqiang Lin Xinyi Xu Alok Prakash Daniela Rus K. H. Low 28 2 0 22 May 2024
Adapting Large Multimodal Models to Distribution Shifts: The Role of In-Context Learning Guanglin Zhou Zhongyi Han Shiming Chen Biwei Huang Liming Zhu Salman Khan Xin Gao Lina Yao VLM 39 2 0 20 May 2024
Data Science Principles for Interpretable and Explainable AI Kris Sankaran FaML 38 0 0 17 May 2024
What is it for a Machine Learning Model to Have a Capability? Jacqueline Harding Nathaniel Sharadin ELM 26 3 0 14 May 2024
PLeak: Prompt Leaking Attacks against Large Language Model Applications Bo Hui Haolin Yuan Neil Gong Philippe Burlina Yinzhi Cao LLMAG AAML SILM 31 33 0 10 May 2024
Towards a Theoretical Understanding of the 'Reversal Curse' via Training Dynamics Hanlin Zhu Baihe Huang Shaolun Zhang Michael I. Jordan Jiantao Jiao Yuandong Tian Stuart Russell LRM AI4CE 47 13 0 07 May 2024
Self-Improving Customer Review Response Generation Based on LLMs Guy Azov Tatiana Pelc Adi Fledel Alon Gila Kamhi 27 0 0 06 May 2024
Enhancing News Summarization with ELearnFit through Efficient In-Context Learning and Efficient Fine-Tuning Che Guan Andrew Chin Puya Vahabi 13 1 0 04 May 2024
PICLe: Eliciting Diverse Behaviors from Large Language Models with Persona In-Context Learning Hyeong Kyu Choi Yixuan Li 59 17 0 03 May 2024
Position: Understanding LLMs Requires More Than Statistical Generalization Patrik Reizinger Szilvia Ujváry Anna Mészáros A. Kerekes Wieland Brendel Ferenc Huszár 31 12 0 03 May 2024
LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Model Yulin Luo Ruichuan An Bocheng Zou Yiming Tang Jiaming Liu Shanghang Zhang 31 14 0 03 May 2024
AppPoet: Large Language Model based Android malware detection via multi-view prompt engineering Wenxiang Zhao Juntao Wu Zhaoyi Meng AAML 17 9 0 29 Apr 2024
Exploring the Robustness of In-Context Learning with Noisy Labels Chen Cheng Xinzhi Yu Haodong Wen Jinsong Sun Guanzhang Yue Yihao Zhang Zeming Wei NoLa 24 6 0 28 Apr 2024
Transformers Can Represent $n$ -gram Language Models Anej Svete Ryan Cotterell 32 17 0 23 Apr 2024
FMint: Bridging Human Designed and Data Pretrained Models for Differential Equation Foundation Model Zezheng Song Jiaxin Yuan Haizhao Yang AI4CE 38 16 0 23 Apr 2024
In-Context Learning State Vector with Inner and Momentum Optimization Dongfang Li Zhenyu Liu Xinshuo Hu Zetian Sun Baotian Hu Min Zhang 24 5 0 17 Apr 2024
Many-Shot In-Context Learning Rishabh Agarwal Avi Singh Lei M. Zhang Bernd Bohnet Luis Rosias ... John D. Co-Reyes Eric Chu Feryal M. P. Behbahani Aleksandra Faust Hugo Larochelle ReLM OffRL BDL 50 96 0 17 Apr 2024
Unveiling the Misuse Potential of Base Large Language Models via In-Context Learning Xiao Wang Tianze Chen Xianjun Yang Qi Zhang Xun Zhao Dahua Lin ELM 39 7 0 16 Apr 2024
Navigating the Landscape of Large Language Models: A Comprehensive Review and Analysis of Paradigms and Fine-Tuning Strategies Benjue Weng LM&MA 30 7 0 13 Apr 2024
Experimental Design for Active Transductive Inference in Large Language Models Subhojyoti Mukherjee Anusha Lalitha Aniket Deshmukh Ge Liu Yifei Ma B. Kveton LRM 35 1 0 12 Apr 2024
Decomposing Label Space, Format and Discrimination: Rethinking How LLMs Respond and Solve Tasks via In-Context Learning Quanyu Long Yin Wu Wenya Wang Sinno Jialin Pan 53 1 0 11 Apr 2024