Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Ordering

20 December 2022

Zhiyong Wu

Yaoxiang Wang

Jiacheng Ye

Lingpeng Kong

ArXiv PDF HTML

Papers citing "Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Ordering"

50 / 97 papers shown

Title
Incomplete In-context Learning Wenqiang Wang Yangshijie Zhang 26 0 0 12 May 2025
Divide, Optimize, Merge: Fine-Grained LLM Agent Optimization at Scale Jiale Liu Yifan Zeng Shaokun Zhang Chi Zhang Malte Højmark-Bertelsen Marie Normann Gadeberg H. Wang Qingyun Wu 34 0 0 06 May 2025
GraphPrompter: Multi-stage Adaptive Prompt Optimization for Graph In-Context Learning Rui Lv Z. Zhang Kai Zhang Qi Liu Weibo Gao J. H. Liu Jiaxia Yan Linan Yue Fangzhou Yao 86 0 0 04 May 2025
Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models Guanghao Zhou Panjia Qiu C. L. P. Chen J. Wang Zheming Yang Jian Xu Minghui Qiu OffRL LRM 53 0 0 30 Apr 2025
Never Start from Scratch: Expediting On-Device LLM Personalization via Explainable Model Selection Haoming Wang Boyuan Yang Xiangyu Yin Wei Gao 28 0 0 15 Apr 2025
Mimic In-Context Learning for Multimodal Tasks Yuchu Jiang Jiale Fu Chenduo Hao Xinting Hu Yingzhe Peng Xin Geng Xu Yang 27 0 0 11 Apr 2025
Collaborative Evolution: Multi-Round Learning Between Large and Small Language Models for Emergent Fake News Detection Ziyi Zhou Xiaoming Zhang Shenghan Tan Litian Zhang Chaozhuo Li 44 0 0 27 Mar 2025
Monte Carlo Sampling for Analyzing In-Context Examples S. Schoch Yangfeng Ji 32 0 0 27 Mar 2025
Knowledge Updating? No More Model Editing! Just Selective Contextual Reasoning Guoxiu He Xin Song Aixin Sun KELM 57 3 0 07 Mar 2025
Advancing Multimodal In-Context Learning in Large Vision-Language Models with Task-aware Demonstrations Yanshu Li 44 0 0 05 Mar 2025
Problem-Solving Logic Guided Curriculum In-Context Learning for LLMs Complex Reasoning Xuetao Ma Wenbin Jiang Hua Huang LRM 68 1 0 24 Feb 2025
MMRAG: Multi-Mode Retrieval-Augmented Generation with Large Language Models for Biomedical In-Context Learning Zaifu Zhan J. Wang Shuang Zhou Jiawen Deng Rui Zhang 40 4 0 21 Feb 2025
D.Va: Validate Your Demonstration First Before You Use It Qi Zhang Zhiqing Xiao Ruixuan Xiao Lirong Gao Junbo Zhao 49 0 0 20 Feb 2025
OptiSeq: Ordering Examples On-The-Fly for In-Context Learning R. Bhope Praveen Venkateswaran K. R. Jayaram Vatche Isahagian Vinod Muthusamy N. Venkatasubramanian 52 0 0 20 Feb 2025
Don't Just Demo, Teach Me the Principles: A Principle-Based Multi-Agent Prompting Strategy for Text Classification Peipei Wei Dimitris Dimitriadis Yan Xu Mingwei Shen 55 1 0 11 Feb 2025
In-Context Learning (and Unlearning) of Length Biases S. Schoch Yangfeng Ji 93 0 0 10 Feb 2025
Understanding Knowledge Hijack Mechanism in In-context Learning through Associative Memory Shuo Wang Issei Sato 69 0 0 16 Dec 2024
No Free Lunch for Defending Against Prefilling Attack by In-Context Learning Zhiyu Xue Guangliang Liu Bocheng Chen K. Johnson Ramtin Pedarsani AAML 68 0 0 13 Dec 2024
Smoothie: Label Free Language Model Routing Neel Guha Mayee F. Chen Trevor Chow Ishan S. Khare Christopher Ré 71 4 0 06 Dec 2024
Evolutionary Pre-Prompt Optimization for Mathematical Reasoning Mathurin Videau Alessandro Leite Marc Schoenauer O. Teytaud ReLM LRM 71 0 0 05 Dec 2024
Curriculum Demonstration Selection for In-Context Learning Duc Anh Vu Nguyen Tran Cong Duy Xiaobao Wu Hoang Minh Nhat Du Mingzhe Nguyen Thanh Thong Anh Tuan Luu 67 0 0 27 Nov 2024
What Factors Affect Multi-Modal In-Context Learning? An In-Depth Exploration L. Qin Qiguang Chen Hao Fei Zhi Chen Min Li Wanxiang Che 34 5 0 27 Oct 2024
Scaling Diffusion Language Models via Adaptation from Autoregressive Models Shansan Gong Shivam Agarwal Yizhe Zhang Jiacheng Ye Lin Zheng ... Peilin Zhao W. Bi Jiawei Han Hao Peng Lingpeng Kong AI4CE 70 14 0 23 Oct 2024
Order Matters: Exploring Order Sensitivity in Multimodal Large Language Models Zhijie Tan Xu Chu Weiping Li Tong Mo 21 1 0 22 Oct 2024
Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning Jiacheng Ye Jiahui Gao Shansan Gong Lin Zheng Xin Jiang Z. Li Lingpeng Kong DiffM LRM 42 15 0 18 Oct 2024
Effective Self-Mining of In-Context Examples for Unsupervised Machine Translation with LLMs Abdellah El Mekki Muhammad Abdul-Mageed LRM 29 0 0 14 Oct 2024
Accelerating Inference of Networks in the Frequency Domain Chenqiu Zhao Guanfang Dong Anup Basu 35 0 0 06 Oct 2024
AiBAT: Artificial Intelligence/Instructions for Build, Assembly, and Test Benjamin Nuernberger Anny Liu Heather Stefanini Richard Otis Amanda Towler R. Peter Dillon 19 0 0 03 Oct 2024
GraphIC: A Graph-Based In-Context Example Retrieval Model for Multi-Step Reasoning Jiale Fu Yaqing Wang Simeng Han Jiaming Fan Chen Si 23 1 0 03 Oct 2024
Auto-Demo Prompting: Leveraging Generated Outputs as Demonstrations for Enhanced Batch Prompting Longyu Feng Mengze Hong Chen Jason Zhang 39 2 0 02 Oct 2024
RISCORE: Enhancing In-Context Riddle Solving in Language Models through Context-Reconstructed Example Augmentation Ioannis Panagiotopoulos Giorgos Filandrianos Maria Lymperaiou Giorgos Stamou LRM ReLM 33 0 0 24 Sep 2024
Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboards Furkan Şahinuç Thy Thy Tran Yulia Grishina Yufang Hou Bei Chen Iryna Gurevych 21 6 0 19 Sep 2024
Reasoning Graph Enhanced Exemplars Retrieval for In-Context Learning Yukang Lin Bingchen Zhong Shuoran Jiang Joanna Siebert Qingcai Chen RALM ReLM LRM 20 0 0 17 Sep 2024
AlpaPICO: Extraction of PICO Frames from Clinical Trial Documents Using LLMs Madhusudan Ghosh Shrimon Mukherjee Asmit Ganguly Partha Basuchowdhuri S. Naskar Debasis Ganguly 29 7 0 15 Sep 2024
In-Context Learning Improves Compositional Understanding of Vision-Language Models Matteo Nulli Anesa Ibrahimi Avik Pal Hoshe Lee Ivona Najdenkoska VLM CoGe 30 0 0 22 Jul 2024
Sub-SA: Strengthen In-context Learning via Submodular Selective Annotation Jian Qian Miao Sun Sifan Zhou Ziyu Zhao Ruizhi Hun Patrick Chiang 30 1 0 08 Jul 2024
SADL: An Effective In-Context Learning Method for Compositional Visual QA Long Hoang Dang T. Le Vuong Le Tu Minh Phuong Truyen Tran ReLM CoGe 41 2 0 02 Jul 2024
From Introspection to Best Practices: Principled Analysis of Demonstrations in Multimodal In-Context Learning Nan Xu Fei Wang Sheng Zhang Hoifung Poon Muhao Chen 32 6 0 01 Jul 2024
Enhancing In-Context Learning via Implicit Demonstration Augmentation Xiaoling Zhou Wei Ye Yidong Wang Chaoya Jiang Zhemg Lee Rui Xie Shikun Zhang 20 3 0 27 Jun 2024
CLEAR: Can Language Models Really Understand Causal Graphs? Sirui Chen Mengying Xu Kun Wang Xingyu Zeng Rui Zhao Shengjie Zhao Chaochao Lu LRM ELM 27 7 0 24 Jun 2024
SeCoKD: Aligning Large Language Models for In-Context Learning with Fewer Shots Weixing Wang Haojin Yang Christoph Meinel 24 0 0 20 Jun 2024
Learnable In-Context Vector for Visual Question Answering Yingzhe Peng Chenduo Hao Xu Yang Jiawei Peng Xinting Hu Xin Geng 37 4 0 19 Jun 2024
How Far Can In-Context Alignment Go? Exploring the State of In-Context Alignment Heyan Huang Yinghao Li Huashan Sun Yu Bai Yang Gao 33 3 0 17 Jun 2024
Task Facet Learning: A Structured Approach to Prompt Optimization Gurusha Juneja Nagarajan Natarajan Hua Li Jian Jiao Amit Sharma 48 6 0 15 Jun 2024
Demonstration Augmentation for Zero-shot In-context Learning Yi Su Yunpeng Tai Yixin Ji Juntao Li Bowen Yan Min Zhang RALM 33 6 0 03 Jun 2024
PromptWizard: Task-Aware Agent-driven Prompt Optimization Framework Eshaan Agarwal Vivek Dani T. Ganu A. Nambi LLMAG 26 3 0 28 May 2024
On the Noise Robustness of In-Context Learning for Text Generation Hongfu Gao Feipeng Zhang Wenyu Jiang Jun Shu Feng Zheng Hongxin Wei 50 3 0 27 May 2024
Implicit In-context Learning Zhuowei Li Zihao Xu Ligong Han Yunhe Gao Song Wen Di Liu Hao Wang Dimitris N. Metaxas 38 1 0 23 May 2024
Feature-Adaptive and Data-Scalable In-Context Learning Jiahao Li Quan Wang L. Zhang Guoqing Jin Zhendong Mao 65 2 0 17 May 2024
MCS-SQL: Leveraging Multiple Prompts and Multiple-Choice Selection For Text-to-SQL Generation Dongjun Lee Choongwon Park Jaehyuk Kim Heesoo Park 37 37 0 13 May 2024