All Papers

0 / 0 papers shown

Title

v1v2 (latest)

When Do Prompting and Prefix-Tuning Work? A Theory of Capabilities and Limitations

International Conference on Learning Representations (ICLR), 2023

30 October 2023

Papers citing "When Do Prompting and Prefix-Tuning Work? A Theory of Capabilities and Limitations"

25 / 25 papers shown

Title
Vocabulary In-Context Learning in Transformers: Benefits of Positional Encoding Qian Ma Ruoxiang Xu Yongqiang Cai 56 0 0 09 Nov 2025
VIPAMIN: Visual Prompt Initialization via Embedding Selection and Subspace Expansion Jaekyun Park Hye Won Chung VPVLM VLM 153 0 0 18 Oct 2025
Learning to Crawl: Latent Model-Based Reinforcement Learning for Soft Robotic Adaptive Locomotion Vaughn Gzenda Robin Chhabra 53 0 0 07 Oct 2025
Domain Adaptation of LLMs for Process Data Rafael Oyamada Jari Peeperkorn Jochen De Weerdt Johannes De Smedt 92 1 0 03 Sep 2025
Memory Limitations of Prompt Tuning in Transformers Maxime Meyer Mario Michelessa C. Chaux Vincent Y. F. Tan VLM 104 0 0 30 Aug 2025
Learned Structure in Cartridges: Keys as Shareable Routers in Self-Studied Representations Maurizio Diaz 92 0 0 23 Aug 2025
Prefix-Tuning+: Modernizing Prefix-Tuning by Decoupling the Prefix from Attention Haonan Wang Brian K Chen Siquan Li Xinhe Liang Hwee Kuan Lee Kenji Kawaguchi Tianyang Hu 141 0 0 16 Jun 2025
Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction Zesheng Ye C. Cai Ruijiang Dong Jianzhong Qi Bingquan Shen Pin-Yu Chen Feng Liu 479 1 0 05 Jun 2025
Understanding Prompt Tuning and In-Context Learning via Meta-Learning Tim Genewein Kevin Wenliang Li Jordi Grau-Moya Anian Ruoss Laurent Orseau Marcus Hutter VPVLM 282 2 0 22 May 2025
Towards Rehearsal-Free Continual Relation Extraction: Capturing Within-Task Variance with Adaptive Prompting Bao-Ngoc Dao Quang Nguyen Luyen Ngo Dinh Minh Le Nam Le Linh Ngo Van CLL 177 1 0 20 May 2025
Efficient Knowledge Transfer in Multi-Task Learning through Task-Adaptive Low-Rank Representation Xiao Zhang Kangsheng Wang Tianyu Hu Huimin Ma 249 3 0 20 Apr 2025
Re-Imagining Multimodal Instruction Tuning: A Representation ViewInternational Conference on Learning Representations (ICLR), 2025 Yiyang Liu James Liang Ruixiang Tang Yugyung Lee Majid Rabbani ... Raghuveer M. Rao Lifu Huang Dongfang Liu Qifan Wang Cheng Han 966 9 0 02 Mar 2025
PromptExp: Multi-granularity Prompt Explanation of Large Language Models Ximing Dong Shaowei Wang Dayi Lin Gopi Krishnan Rajbahadur Boquan Zhou Shichao Liu Ahmed E. Hassan AAML LRM 295 4 0 16 Oct 2024
Parameter-Efficient Fine-Tuning of State Space Models Kevin Galim Wonjun Kang Yuchen Zeng H. Koo Kangwook Lee 351 6 0 11 Oct 2024
How Much Can RAG Help the Reasoning of LLM? Jingyu Liu Jiaen Lin Yong Liu LRM 188 24 0 03 Oct 2024
Revisiting Prefix-tuning: Statistical Benefits of Reparameterization among PromptsInternational Conference on Learning Representations (ICLR), 2024 Minh Le Chau Nguyen Huy Nguyen Quyen Tran Trung Le Nhat Ho 565 11 0 03 Oct 2024
Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely Siyun Zhao Yuqing Yang Zilong Wang Zhiyuan He Luna Qiu Lili Qiu SyDa RALM 3DV 257 89 0 23 Sep 2024
PromptDSI: Prompt-based Rehearsal-free Continual Learning for Document Retrieval Tuan-Luc Huynh Thuy-Trang Vu Weiqing Wang Yinwei Wei T. Le D. Gašević Yuan-Fang Li Thanh-Toan Do VLM CLL 246 1 0 18 Jun 2024
Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt Adaptation Abhinav C. P. Jain Swarat Chaudhuri Thomas W. Reps Christopher M. Jermaine 141 7 0 24 May 2024
Towards Incremental Learning in Large Language Models: A Critical Review M. Jovanovic Peter Voss ELM CLL KELM 448 8 0 28 Apr 2024
$R^2$ -Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding Ye Liu Jixuan He Wanhua Li Junsik Kim D. Wei Hanspeter Pfister Chang Wen Chen 171 31 0 31 Mar 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 604 655 0 21 Mar 2024
Code Simulation Challenges for Large Language Models Emanuele La Malfa Christoph Weinhuber Orazio Torre Fangru Lin Samuele Marro Anthony Cohn Nigel Shadbolt Michael Wooldridge LLMAG LRM 223 10 0 17 Jan 2024
The Expressive Power of Low-Rank AdaptationInternational Conference on Learning Representations (ICLR), 2023 Yuchen Zeng Kangwook Lee 397 91 0 26 Oct 2023
An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningIEEE Transactions on Audio, Speech, and Language Processing (TASLP), 2023 Yun Luo Zhen Yang Fandong Meng Yafu Li Jie Zhou Yue Zhang CLL KELM 545 476 0 17 Aug 2023

v1v2 (latest)

When Do Prompting and Prefix-Tuning Work? A Theory of Capabilities and Limitations

International Conference on Learning Representations (ICLR), 2023

30 October 2023

Papers citing "When Do Prompting and Prefix-Tuning Work? A Theory of Capabilities and Limitations"

25 / 25 papers shown

Title
Vocabulary In-Context Learning in Transformers: Benefits of Positional Encoding Qian Ma Ruoxiang Xu Yongqiang Cai 56 0 0 09 Nov 2025
VIPAMIN: Visual Prompt Initialization via Embedding Selection and Subspace Expansion Jaekyun Park Hye Won Chung VPVLM VLM 153 0 0 18 Oct 2025
Learning to Crawl: Latent Model-Based Reinforcement Learning for Soft Robotic Adaptive Locomotion Vaughn Gzenda Robin Chhabra 53 0 0 07 Oct 2025
Domain Adaptation of LLMs for Process Data Rafael Oyamada Jari Peeperkorn Jochen De Weerdt Johannes De Smedt 92 1 0 03 Sep 2025
Memory Limitations of Prompt Tuning in Transformers Maxime Meyer Mario Michelessa C. Chaux Vincent Y. F. Tan VLM 104 0 0 30 Aug 2025
Learned Structure in Cartridges: Keys as Shareable Routers in Self-Studied Representations Maurizio Diaz 92 0 0 23 Aug 2025
Prefix-Tuning+: Modernizing Prefix-Tuning by Decoupling the Prefix from Attention Haonan Wang Brian K Chen Siquan Li Xinhe Liang Hwee Kuan Lee Kenji Kawaguchi Tianyang Hu 141 0 0 16 Jun 2025
Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction Zesheng Ye C. Cai Ruijiang Dong Jianzhong Qi Bingquan Shen Pin-Yu Chen Feng Liu 479 1 0 05 Jun 2025
Understanding Prompt Tuning and In-Context Learning via Meta-Learning Tim Genewein Kevin Wenliang Li Jordi Grau-Moya Anian Ruoss Laurent Orseau Marcus Hutter VPVLM 282 2 0 22 May 2025
Towards Rehearsal-Free Continual Relation Extraction: Capturing Within-Task Variance with Adaptive Prompting Bao-Ngoc Dao Quang Nguyen Luyen Ngo Dinh Minh Le Nam Le Linh Ngo Van CLL 177 1 0 20 May 2025
Efficient Knowledge Transfer in Multi-Task Learning through Task-Adaptive Low-Rank Representation Xiao Zhang Kangsheng Wang Tianyu Hu Huimin Ma 249 3 0 20 Apr 2025
Re-Imagining Multimodal Instruction Tuning: A Representation ViewInternational Conference on Learning Representations (ICLR), 2025 Yiyang Liu James Liang Ruixiang Tang Yugyung Lee Majid Rabbani ... Raghuveer M. Rao Lifu Huang Dongfang Liu Qifan Wang Cheng Han 966 9 0 02 Mar 2025
PromptExp: Multi-granularity Prompt Explanation of Large Language Models Ximing Dong Shaowei Wang Dayi Lin Gopi Krishnan Rajbahadur Boquan Zhou Shichao Liu Ahmed E. Hassan AAML LRM 295 4 0 16 Oct 2024
Parameter-Efficient Fine-Tuning of State Space Models Kevin Galim Wonjun Kang Yuchen Zeng H. Koo Kangwook Lee 351 6 0 11 Oct 2024
How Much Can RAG Help the Reasoning of LLM? Jingyu Liu Jiaen Lin Yong Liu LRM 188 24 0 03 Oct 2024
Revisiting Prefix-tuning: Statistical Benefits of Reparameterization among PromptsInternational Conference on Learning Representations (ICLR), 2024 Minh Le Chau Nguyen Huy Nguyen Quyen Tran Trung Le Nhat Ho 565 11 0 03 Oct 2024
Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely Siyun Zhao Yuqing Yang Zilong Wang Zhiyuan He Luna Qiu Lili Qiu SyDa RALM 3DV 257 89 0 23 Sep 2024
PromptDSI: Prompt-based Rehearsal-free Continual Learning for Document Retrieval Tuan-Luc Huynh Thuy-Trang Vu Weiqing Wang Yinwei Wei T. Le D. Gašević Yuan-Fang Li Thanh-Toan Do VLM CLL 246 1 0 18 Jun 2024
Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt Adaptation Abhinav C. P. Jain Swarat Chaudhuri Thomas W. Reps Christopher M. Jermaine 141 7 0 24 May 2024
Towards Incremental Learning in Large Language Models: A Critical Review M. Jovanovic Peter Voss ELM CLL KELM 448 8 0 28 Apr 2024
$R^2$ -Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding Ye Liu Jixuan He Wanhua Li Junsik Kim D. Wei Hanspeter Pfister Chang Wen Chen 171 31 0 31 Mar 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 604 655 0 21 Mar 2024
Code Simulation Challenges for Large Language Models Emanuele La Malfa Christoph Weinhuber Orazio Torre Fangru Lin Samuele Marro Anthony Cohn Nigel Shadbolt Michael Wooldridge LLMAG LRM 223 10 0 17 Jan 2024
The Expressive Power of Low-Rank AdaptationInternational Conference on Learning Representations (ICLR), 2023 Yuchen Zeng Kangwook Lee 397 91 0 26 Oct 2023
An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningIEEE Transactions on Audio, Speech, and Language Processing (TASLP), 2023 Yun Luo Zhen Yang Fandong Meng Yafu Li Jie Zhou Yue Zhang CLL KELM 545 476 0 17 Aug 2023