An Explanation of In-context Learning as Implicit Bayesian Inference

3 November 2021

Papers citing "An Explanation of In-context Learning as Implicit Bayesian Inference"

50 / 531 papers shown

Title
From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples Robert Vacareanu Vlad-Andrei Negru Vasile Suciu Mihai Surdeanu 29 28 0 11 Apr 2024
Finding Visual Task Vectors Alberto Hojel Yutong Bai Trevor Darrell Amir Globerson Amir Bar 60 6 0 08 Apr 2024
Self-Training Large Language Models for Improved Visual Program Synthesis With Visual Reinforcement Zaid Khan B. Vijaykumar S. Schulter Yun Fu Manmohan Chandraker LRM ReLM 26 6 0 06 Apr 2024
How does Multi-Task Training Affect Transformer In-Context Capabilities? Investigations with Function Classes Harmon Bhasin Timothy Ossowski Yiqiao Zhong Junjie Hu 22 0 0 04 Apr 2024
What Can Transformer Learn with Varying Depth? Case Studies on Sequence Learning Tasks Xingwu Chen Difan Zou ViT 24 12 0 02 Apr 2024
Learn "No" to Say "Yes" Better: Improving Vision-Language Models via Negations Jaisidh Singh Ishaan Shrivastava Mayank Vatsa Richa Singh Aparna Bharati VLM CoGe 24 14 0 29 Mar 2024
ChatGPT Rates Natural Language Explanation Quality Like Humans: But on Which Scales? Fan Huang Haewoon Kwak Kunwoo Park Jisun An ALM ELM AI4MH 18 12 0 26 Mar 2024
The Strong Pull of Prior Knowledge in Large Language Models and Its Impact on Emotion Recognition Georgios Chochlakis Alexandros Potamianos Kristina Lerman Shrikanth Narayanan 20 5 0 25 Mar 2024
LLMs Are Few-Shot In-Context Low-Resource Language Learners Samuel Cahyawijaya Holy Lovenia Pascale Fung 38 34 0 25 Mar 2024
$$\textit{LinkPrompt}$: Natural and Universal Adversarial Attacks on Prompt-based Language Models$ $\textit{LinkPrompt}$ : Natural and Universal Adversarial Attacks on Prompt-based Language Models Yue Xu Wenjie Wang SILM AAML 19 2 0 25 Mar 2024
Large Language Models Offer an Alternative to the Traditional Approach of Topic Modelling Yida Mu Chun Dong Kalina Bontcheva Xingyi Song 26 16 0 24 Mar 2024
Can large language models explore in-context? Akshay Krishnamurthy Keegan Harris Dylan J. Foster Cyril Zhang Aleksandrs Slivkins LM&Ro LLMAG LRM 118 22 0 22 Mar 2024
Characteristic AI Agents via Large Language Models Xi Wang Hongliang Dai Shen Gao Piji Li 43 3 0 19 Mar 2024
Towards Understanding the Relationship between In-context Learning and Compositional Generalization Sungjun Han Sebastian Padó CoGe 21 2 0 18 Mar 2024
Rectifying Demonstration Shortcut in In-Context Learning Joonwon Jang Sanghwan Jang Wonbin Kweon Minjin Jeon Hwanjo Yu 16 1 0 14 Mar 2024
Rich Semantic Knowledge Enhanced Large Language Models for Few-shot Chinese Spell Checking Ming Dong Yujing Chen Miao Zhang Hao Sun Tingting He 34 4 0 13 Mar 2024
Mechanics of Next Token Prediction with Self-Attention Yingcong Li Yixiao Huang M. E. Ildiz A. S. Rawat Samet Oymak 16 25 0 12 Mar 2024
Knowledge Graph Large Language Model (KG-LLM) for Link Prediction Dong Shu Tianle Chen Mingyu Jin Chong Zhang Mengnan Du Yongfeng Zhang 24 28 0 12 Mar 2024
Concept-aware Data Construction Improves In-context Learning of Language Models Michal Štefánik Marek Kadlcík Petr Sojka 41 0 0 08 Mar 2024
Where does In-context Translation Happen in Large Language Models Suzanna Sia David Mueller Kevin Duh LRM 33 0 0 07 Mar 2024
On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models Xinpeng Wang Shitong Duan Xiaoyuan Yi Jing Yao Shanlin Zhou Zhihua Wei Peng Zhang Dongkuan Xu Maosong Sun Xing Xie OffRL 33 16 0 07 Mar 2024
Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustment Congzhi Zhang Linhai Zhang Jialong Wu Deyu Zhou Guoqiang Xu CML AI4CE LRM 44 15 0 05 Mar 2024
RoCoIns: Enhancing Robustness of Large Language Models through Code-Style Instructions Yuan Zhang Xiao Wang Zhiheng Xi Han Xia Tao Gui Qi Zhang Xuanjing Huang 26 3 0 26 Feb 2024
The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG) Shenglai Zeng Jiankun Zhang Pengfei He Yue Xing Yiding Liu ... Jie Ren Shuaiqiang Wang Dawei Yin Yi Chang Jiliang Tang SILM 21 67 0 23 Feb 2024
Prompting a Pretrained Transformer Can Be a Universal Approximator Aleksandar Petrov Philip H. S. Torr Adel Bibi 19 11 0 22 Feb 2024
From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers M. E. Ildiz Yixiao Huang Yingcong Li A. S. Rawat Samet Oymak 16 17 0 21 Feb 2024
A Simple but Effective Approach to Improve Structured Language Model Output for Information Extraction Yinghao Li R. Ramprasad Chao Zhang 90 10 0 20 Feb 2024
The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysis Miaoran Zhang Vagrant Gautam Mingyang Wang Jesujoba Oluwadara Alabi Xiaoyu Shen Dietrich Klakow Marius Mosbach 36 8 0 20 Feb 2024
Parallel Structures in Pre-training Data Yield In-Context Learning Yanda Chen Chen Zhao Zhou Yu Kathleen McKeown He He 24 11 0 19 Feb 2024
In-Context Learning Demonstration Selection via Influence Analysis Vinay M.S. Minh-Hao Van Xintao Wu 29 3 0 19 Feb 2024
GNNavi: Navigating the Information Flow in Large Language Models by Graph Neural Network Shuzhou Yuan Ercong Nie Michael Farber Helmut Schmid Hinrich Schütze 35 3 0 18 Feb 2024
Visual In-Context Learning for Large Vision-Language Models Yucheng Zhou Xiang Li Qianning Wang Jianbing Shen MLLM 27 57 0 18 Feb 2024
In-Context Example Ordering Guided by Label Distributions Zhichao Xu Daniel Cohen Bei Wang Vivek Srikumar 22 7 0 18 Feb 2024
TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks Ben Feuer R. Schirrmeister Valeriia Cherepanova Chinmay Hegde Frank Hutter Micah Goldblum Niv Cohen Colin White 40 13 0 17 Feb 2024
The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains Benjamin L. Edelman Ezra Edelman Surbhi Goel Eran Malach Nikolaos Tsilivis BDL 21 39 0 16 Feb 2024
Understanding In-Context Learning with a Pelican Soup Framework Ting-Rui Chiang Dani Yogatama 16 1 0 16 Feb 2024
Uncertainty Quantification for In-Context Learning of Large Language Models Chen Ling Xujiang Zhao Xuchao Zhang Wei Cheng Yanchi Liu ... Katsushi Matsuda Jie Ji Guangji Bai Liang Zhao Haifeng Chen 26 13 0 15 Feb 2024
Rec-GPT4V: Multimodal Recommendation with Large Vision-Language Models Yuqing Liu Yu Wang Lichao Sun Philip S. Yu 12 6 0 13 Feb 2024
Large Language Models as Agents in Two-Player Games Yang Liu Peng Sun Hang Li LLMAG 32 4 0 12 Feb 2024
GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators Yuchen Hu Chen Chen Chao-Han Huck Yang Ruizhe Li Dong Zhang Zhehuai Chen E. Chng 18 20 0 10 Feb 2024
Scalable Interactive Machine Learning for Future Command and Control Anna Madison Ellen R. Novoseller Vinicius G. Goecks Benjamin T. Files Nicholas R. Waytowich Alfred Yu Vernon J. Lawhern Steven Thurman Christopher Kelshaw Kaleb McDowell 27 4 0 09 Feb 2024
Towards Understanding Inductive Bias in Transformers: A View From Infinity Itay Lavie Guy Gur-Ari Z. Ringel 29 1 0 07 Feb 2024
Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks Jongho Park Jaeseung Park Zheyang Xiong Nayoung Lee Jaewoong Cho Samet Oymak Kangwook Lee Dimitris Papailiopoulos 19 69 0 06 Feb 2024
Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains Ashok Vardhan Makkuva Marco Bondaschi Adway Girish Alliot Nagle Martin Jaggi Hyeji Kim Michael C. Gastpar OffRL 13 25 0 06 Feb 2024
In-context learning agents are asymmetric belief updaters Johannes A. Schubert A. Jagadish Marcel Binz Eric Schulz LLMAG 8 8 0 06 Feb 2024
Large Language Models to Enhance Bayesian Optimization Tennison Liu Nicolás Astorga Nabeel Seedat M. Schaar 58 45 0 06 Feb 2024
QuantAgent: Seeking Holy Grail in Trading by Self-Improving Large Language Model Sai Wang Hang Yuan Lionel M. Ni Jian Guo LLMAG AIFin 14 9 0 06 Feb 2024
How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for Metric Learning Zeping Yu Sophia Ananiadou 48 7 0 05 Feb 2024
Data Poisoning for In-context Learning Pengfei He Han Xu Yue Xing Hui Liu Makoto Yamada Jiliang Tang AAML SILM 22 10 0 03 Feb 2024
Self-attention Networks Localize When QK-eigenspectrum Concentrates Han Bao Ryuichiro Hataya Ryo Karakida 11 5 0 03 Feb 2024