Adapting LLMs for Efficient Context Processing through Soft Prompt
Compression

Adapting LLMs for Efficient Context Processing through Soft Prompt Compression

7 April 2024

Papers citing "Adapting LLMs for Efficient Context Processing through Soft Prompt Compression"

11 / 11 papers shown

Title
PIS: Linking Importance Sampling and Attention Mechanisms for Efficient Prompt Compression Lizhe Chen Binjia Zhou Yuyao Ge Jiayi Chen Shiguang NI 75 0 0 23 Apr 2025
From Cool Demos to Production-Ready FMware: Core Challenges and a Technology Roadmap Gopi Krishnan Rajbahadur G. Oliva Dayi Lin Ahmed E. Hassan 41 1 0 28 Jan 2025
CA-BERT: Leveraging Context Awareness for Enhanced Multi-Turn Chat Interaction Minghao Liu Mingxiu Sui Yi Nan Cangqing Wang Zhijie Zhou 28 2 0 05 Sep 2024
Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inference Barys Liskavets Maxim Ushakov Shuvendu Roy Mark Klibanov Ali Etemad Shane Luke 30 6 0 02 Sep 2024
Theoretical Analysis of Meta Reinforcement Learning: Generalization Bounds and Convergence Guarantees Cangqing Wang Mingxiu Sui Dan Sun Zecheng Zhang Yan Zhou 36 26 0 22 May 2024
Enhancing user experience in large language models through human-centered design: Integrating theoretical insights with an experimental study to meet diverse software learning needs with a single document knowledge base Yuchen Wang Yin-Shan Lin Ruixin Huang Jinyin Wang Sensen Liu 19 7 0 19 May 2024
Enhancing 3D Object Detection by Using Neural Network with Self-adaptive Thresholding Houze Liu Chongqing Wang Xiaoan Zhan Haotian Zheng Chang Che 17 3 0 13 May 2024
Exploring Diverse Methods in Visual Question Answering Panfeng Li Qikai Yang Xieming Geng Wenjing Zhou Zhicheng Ding Yi Nian 34 53 0 21 Apr 2024
Reinforcement Learning Approach for Integrating Compressed Contexts into Knowledge Graphs Ngoc Quach Qi Wang Zijun Gao Qifeng Sun Bo Guan Lillian Floyd OffRL GNN 20 5 0 19 Apr 2024
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,835 0 18 Apr 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 249 2,009 0 28 Jul 2020