Understanding In-Context Learning from Repetitions

30 September 2023

Papers citing "Understanding In-Context Learning from Repetitions"

20 / 20 papers shown

Title
OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMs Wasi Uddin Ahmad Aleksander Ficek Mehrzad Samadi Jocelyn Huang Vahid Noroozi Somshubra Majumdar Boris Ginsburg ALM 42 1 0 05 Apr 2025
Repetitions are not all alike: distinct mechanisms sustain repetition in language models Matéo Mahaut Francesca Franzon 42 0 0 01 Apr 2025
Unveiling Attractor Cycles in Large Language Models: A Dynamical Systems View of Successive Paraphrasing Zhilin Wang Yafu Li Jianhao Yan Yu Cheng Yue Zhang 65 0 0 21 Feb 2025
Repetition Neurons: How Do Language Models Produce Repetitions? Tatsuya Hiraoka Kentaro Inui MILM 75 6 0 21 Feb 2025
From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set M. Finkelstein Dan Deutsch Parker Riley Juraj Juraska Geza Kovacs Markus Freitag 76 0 0 23 Nov 2024
CoPS: Empowering LLM Agents with Provable Cross-Task Experience Sharing Chen Yang Chenyang Zhao Q. Gu Dongruo Zhou LRM 38 0 0 22 Oct 2024
ELICIT: LLM Augmentation via External In-Context Capability Futing Wang Jianhao Yan Yue Zhang Tao Lin 44 0 0 12 Oct 2024
Composited-Nested-Learning with Data Augmentation for Nested Named Entity Recognition Xingming Liao Nankai Lin Haowen Li Lianglun Cheng Zhuowei Wang Chong Chen 43 0 0 18 Jun 2024
Unraveling the Mechanics of Learning-Based Demonstration Selection for In-Context Learning Hui Liu Wenya Wang Hao Sun Chris Xing Tian Chenqi Kong Xin Dong Haoliang Li 54 5 0 14 Jun 2024
PROMPT-SAW: Leveraging Relation-Aware Graphs for Textual Prompt Compression Muhammad Asif Ali Zhengping Li Shu Yang Keyuan Cheng Yang Cao Tianhao Huang Lijie Hu Lu Yu Di Wang VLM RALM 38 9 0 30 Mar 2024
RefuteBench: Evaluating Refuting Instruction-Following for Large Language Models Jianhao Yan Yun Luo Yue Zhang ALM LRM 38 6 0 21 Feb 2024
Parallel Structures in Pre-training Data Yield In-Context Learning Yanda Chen Chen Zhao Zhou Yu Kathleen McKeown He He 29 12 0 19 Feb 2024
Crafting a Good Prompt or Providing Exemplary Dialogues? A Study of In-Context Learning for Persona-based Dialogue Generation Jiashu Pu Yajing Wan Yuru Zhang Jing Chen Ling Cheng Qian Shao Yongzhu Chang Tangjie Lv Rongsheng Zhang 23 1 0 15 Feb 2024
WaveCoder: Widespread And Versatile Enhancement For Code Large Language Models By Instruction Tuning Zhaojian Yu Xin Zhang Ning Shang Yangyu Huang Can Xu Yishujie Zhao Wenxiang Hu Qiufeng Yin SyDa 25 22 0 20 Dec 2023
In-context Learning and Induction Heads Catherine Olsson Nelson Elhage Neel Nanda Nicholas Joseph Nova Dassarma ... Tom B. Brown Jack Clark Jared Kaplan Sam McCandlish C. Olah 250 460 0 24 Sep 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 379 8,495 0 28 Jan 2022
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity Yao Lu Max Bartolo Alastair Moore Sebastian Riedel Pontus Stenetorp AILaw LRM 279 1,124 0 18 Apr 2021
What Makes Good In-Context Examples for GPT- $3$ ? Jiachang Liu Dinghan Shen Yizhe Zhang Bill Dolan Lawrence Carin Weizhu Chen AAML RALM 275 1,312 0 17 Jan 2021
A Theoretical Analysis of the Repetition Problem in Text Generation Z. Fu Wai Lam Anthony Man-Cho So Bei Shi 77 90 0 29 Dec 2020
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 258 1,432 0 22 Aug 2019