An Explanation of In-context Learning as Implicit Bayesian Inference

3 November 2021

Papers citing "An Explanation of In-context Learning as Implicit Bayesian Inference"

50 / 531 papers shown

Title
ScriptSmith: A Unified LLM Framework for Enhancing IT Operations via Automated Bash Script Generation, Assessment, and Refinement Oishik Chatterjee Pooja Aggarwal Suranjana Samanta Ting Dai P. Mohapatra ... Ruchi Mahindru Steve Barbieri Eugen Postea Brad Blancett Arthur De Magalhaes 16 1 0 12 Sep 2024
DiPT: Enhancing LLM reasoning through diversified perspective-taking H. Just Mahavir Dabas Lifu Huang Ming Jin Ruoxi Jia LRM 32 1 0 10 Sep 2024
Larger Language Models Don't Care How You Think: Why Chain-of-Thought Prompting Fails in Subjective Tasks Georgios Chochlakis Niyantha Maruthu Pandiyan Kristina Lerman Shrikanth Narayanan ReLM KELM LRM 32 4 0 10 Sep 2024
MILE: A Mutation Testing Framework of In-Context Learning Systems Zeming Wei Yihao Zhang Meng Sun 35 0 0 07 Sep 2024
Large Language Models-Enabled Digital Twins for Precision Medicine in Rare Gynecological Tumors Jacqueline Lammert Nicole Pfarr Leonid Kuligin Sonja Mathes Tobias Dreyer ... Martin Boeker Marion Kiechle Ulrich A. Schatz Holger Bronger Maximilian Tschochohei LM&MA AI4CE 19 0 0 31 Aug 2024
Multimodal Contrastive In-Context Learning Yosuke Miyanishi Minh Le Nguyen 32 2 0 23 Aug 2024
Multilevel Interpretability Of Artificial Neural Networks: Leveraging Framework And Methods From Neuroscience Zhonghao He Jascha Achterberg Katie Collins Kevin K. Nejad Danyal Akarca ... Chole Li Kai J. Sandbrink Stephen Casper Anna Ivanova Grace W. Lindsay AI4CE 23 1 0 22 Aug 2024
Promoting Equality in Large Language Models: Identifying and Mitigating the Implicit Bias based on Bayesian Theory Yongxin Deng Xihe Qiu Xiaoyu Tan Jing Pan Chen Jue Zhijun Fang Yinghui Xu Wei Chu Yuan Qi 26 2 0 20 Aug 2024
In-Context Learning with Representations: Contextual Generalization of Trained Transformers Tong Yang Yu Huang Yingbin Liang Yuejie Chi MLT 27 5 0 19 Aug 2024
Concept Distillation from Strong to Weak Models via Hypotheses-to-Theories Prompting Emmanuel Aboah Boateng Cassiano O. Becker Nabiha Asghar Kabir Walia Ashwin Srinivasan Ehi Nosakhare Victor Dibia Soundar Srinivasan LRM 31 0 0 18 Aug 2024
Large Language Models Might Not Care What You Are Saying: Prompt Format Beats Descriptions Chenming Tang Zhixiang Wang Yunfang Wu LRM 21 0 0 16 Aug 2024
LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMs Do Xuan Long Hai Nguyen Ngoc Tiviatis Sim Hieu Dao Shafiq R. Joty Kenji Kawaguchi Nancy F. Chen Min-Yen Kan 29 7 0 16 Aug 2024
How Transformers Utilize Multi-Head Attention in In-Context Learning? A Case Study on Sparse Linear Regression Xingwu Chen Lei Zhao Difan Zou 36 6 0 08 Aug 2024
Can Reinforcement Learning Unlock the Hidden Dangers in Aligned Large Language Models? Mohammad Bahrami Karkevandi Nishant Vishwamitra Peyman Najafirad AAML 43 1 0 05 Aug 2024
Spin glass model of in-context learning Yuhao Li Ruoran Bai Haiping Huang LRM 37 0 0 05 Aug 2024
LawLLM: Law Large Language Model for the US Legal System Dong Shu Haoran Zhao Xukun Liu David Demeter Mengnan Du Yongfeng Zhang AILaw ELM 18 6 0 27 Jul 2024
Large Language Models for Human-like Autonomous Driving: A Survey Yun Li Kai Katsumata Ehsan Javanmardi Manabu Tsukada LM&MA 35 5 0 27 Jul 2024
Do Large Language Models Have Compositional Ability? An Investigation into Limitations and Scalability Zhuoyan Xu Zhenmei Shi Yingyu Liang CoGe LRM 27 27 0 22 Jul 2024
Empirical Capacity Model for Self-Attention Neural Networks Aki Härmä M. Pietrasik Anna Wilbik 27 1 0 22 Jul 2024
Intrinsic Self-correction for Enhanced Morality: An Analysis of Internal Mechanisms and the Superficial Hypothesis Guang-Da Liu Haitao Mao Jiliang Tang K. Johnson LRM 22 7 0 21 Jul 2024
Rethinking Learned Image Compression: Context is All You Need Jixiang Luo 24 0 0 16 Jul 2024
Representing Rule-based Chatbots with Transformers Dan Friedman Abhishek Panigrahi Danqi Chen 59 1 0 15 Jul 2024
Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond Yingcong Li A. S. Rawat Samet Oymak 23 6 0 13 Jul 2024
Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agents Haoyi Xiong Zhiyuan Wang Xuhong Li Jiang Bian Zeke Xie Shahid Mumtaz Laura E. Barnes LLMAG 34 7 0 11 Jul 2024
ICLGuard: Controlling In-Context Learning Behavior for Applicability Authorization Wai Man Si Michael Backes Yang Zhang 25 1 0 09 Jul 2024
Enhancing Language Model Rationality with Bi-Directional Deliberation Reasoning Yadong Zhang Shaoguang Mao Wenshan Wu Yan Xia Tao Ge Man Lan Furu Wei 48 1 0 08 Jul 2024
Why does in-context learning fail sometimes? Evaluating in-context learning on open and closed questions Xiang Li Haoran Tang Siyu Chen Ziwei Wang Ryan Chen Marcin Abram LRM 29 1 0 02 Jul 2024
SADL: An Effective In-Context Learning Method for Compositional Visual QA Long Hoang Dang T. Le Vuong Le Tu Minh Phuong Truyen Tran ReLM CoGe 41 2 0 02 Jul 2024
Deciphering the Factors Influencing the Efficacy of Chain-of-Thought: Probability, Memorization, and Noisy Reasoning Akshara Prabhakar Thomas L. Griffiths R. Thomas McCoy LRM 42 16 0 01 Jul 2024
Universal Approximation Theory: The Basic Theory for Transformer-based Large Language Models Wei Wang Qing Li 28 0 0 01 Jul 2024
From Introspection to Best Practices: Principled Analysis of Demonstrations in Multimodal In-Context Learning Nan Xu Fei Wang Sheng Zhang Hoifung Poon Muhao Chen 32 6 0 01 Jul 2024
One Prompt is not Enough: Automated Construction of a Mixture-of-Expert Prompts Ruochen Wang Sohyun An Minhao Cheng Tianyi Zhou Sung Ju Hwang Cho-Jui Hsieh 34 7 0 28 Jun 2024
When Search Engine Services meet Large Language Models: Visions and Challenges Haoyi Xiong Jiang Bian Yuchen Li Xuhong Li Mengnan Du Shuaiqiang Wang Dawei Yin Sumi Helal 43 28 0 28 Jun 2024
Does ChatGPT Have a Mind? Simon Goldstein B. Levinstein AI4MH LRM 21 5 0 27 Jun 2024
Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers Yibo Jiang Goutham Rajendran Pradeep Ravikumar Bryon Aragam CLL KELM 29 6 0 26 Jun 2024
Towards Probing Speech-Specific Risks in Large Multimodal Models: A Taxonomy, Benchmark, and Insights Hao Yang Lizhen Qu Ehsan Shareghi Gholamreza Haffari 28 0 0 25 Jun 2024
Distributed Rule Vectors is A Key Mechanism in Large Language Models' In-Context Learning Bowen Zheng Ming Ma Zhongqiao Lin Tianming Yang 25 1 0 23 Jun 2024
Understanding the Role of User Profile in the Personalization of Large Language Models Bin Wu Zhengyan Shi Hossein A. Rahmani Varsha Ramineni Emine Yilmaz 41 5 0 22 Jun 2024
ICLEval: Evaluating In-Context Learning Ability of Large Language Models Wentong Chen Yankai Lin ZhenHao Zhou HongYun Huang Yantao Jia Zhao Cao Ji-Rong Wen ELM 26 3 0 21 Jun 2024
A Hopfieldian View-based Interpretation for Chain-of-Thought Reasoning Lijie Hu Liang Liu Shu Yang Xin Chen Hongru Xiao Mengdi Li Pan Zhou Muhammad Asif Ali Di Wang LRM 33 5 0 18 Jun 2024
Efficient Sequential Decision Making with Large Language Models Dingyang Chen Qi Zhang Yinglun Zhu LRM 21 2 0 17 Jun 2024
Safety Arithmetic: A Framework for Test-time Safety Alignment of Language Models by Steering Parameters and Activations Rima Hazra Sayan Layek Somnath Banerjee Soujanya Poria KELM LLMSV 29 6 0 17 Jun 2024
Learning from Natural Language Explanations for Generalizable Entity Matching Somin Wadhwa Adit Krishnan Runhui Wang Byron C. Wallace Chris Kong LRM 26 3 0 13 Jun 2024
Bayesian Statistical Modeling with Predictors from LLMs Michael Franke Polina Tsvilodub Fausto Carcassi 29 4 0 13 Jun 2024
Estimating the Hallucination Rate of Generative AI Andrew Jesson Nicolas Beltran-Velez Quentin Chu Sweta Karlekar Jannik Kossen Yarin Gal John P. Cunningham David M. Blei 46 6 0 11 Jun 2024
AIM: Let Any Multi-modal Large Language Models Embrace Efficient In-Context Learning Jun Gao Qian Qiao Ziqiang Cao Zili Wang Wenjie Li 26 3 0 11 Jun 2024
LLM-Enhanced Bayesian Optimization for Efficient Analog Layout Constraint Generation Guojin Chen Keren Zhu Seunggeun Kim Hanqing Zhu Yao Lai Bei Yu David Z. Pan 21 6 0 07 Jun 2024
On Subjective Uncertainty Quantification and Calibration in Natural Language Generation Ziyu Wang Chris Holmes UQLM 45 4 0 07 Jun 2024
Pretraining Decision Transformers with Reward Prediction for In-Context Multi-task Structured Bandit Learning Subhojyoti Mukherjee Josiah P. Hanna Qiaomin Xie Robert Nowak 61 2 0 07 Jun 2024
What Do Language Models Learn in Context? The Structured Task Hypothesis Jiaoda Li Yifan Hou Mrinmaya Sachan Ryan Cotterell LRM 36 7 0 06 Jun 2024