PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model
Adaptation

PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation

22 August 2022

Liang Ding

Bo Du

Papers citing "PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation"

15 / 15 papers shown

Title
Learning Optimal Prompt Ensemble for Multi-source Visual Prompt Transfer Enming Zhang Liwen Cao Yanru Wu Zijie Zhao Guan Wang Yang Li 45 0 0 09 Apr 2025
Empowering Large Language Model for Continual Video Question Answering with Collaborative Prompting Chen Cai Zheng Wang J. Gao Wenyang Liu Ye Lu Runzhong Zhang Kim-Hui Yap CLL 44 0 0 20 Jan 2025
Concept Distillation from Strong to Weak Models via Hypotheses-to-Theories Prompting Emmanuel Aboah Boateng Cassiano O. Becker Nabiha Asghar Kabir Walia Ashwin Srinivasan Ehi Nosakhare Victor Dibia Soundar Srinivasan LRM 26 0 0 18 Aug 2024
Revisiting Token Dropping Strategy in Efficient BERT Pretraining Qihuang Zhong Liang Ding Juhua Liu Xuebo Liu Min Zhang Bo Du Dacheng Tao VLM 14 9 0 24 May 2023
Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao AI4MH 23 231 0 19 Feb 2023
Model ensemble instead of prompt fusion: a sample-specific knowledge transfer method for few-shot prompt tuning Xiangyu Peng Chen Xing Prafulla Kumar Choubey Chien-Sheng Wu Caiming Xiong VLM 53 11 0 23 Oct 2022
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao 21 26 0 30 May 2022
ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts Akari Asai Mohammadreza Salehi Matthew E. Peters Hannaneh Hajishirzi 118 98 0 24 May 2022
A Contrastive Cross-Channel Data Augmentation Framework for Aspect-based Sentiment Analysis Bing Wang Liang Ding Qihuang Zhong Ximing Li Dacheng Tao 17 31 0 16 Apr 2022
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer Tu Vu Brian Lester Noah Constant Rami Al-Rfou Daniel Matthew Cer VLM LRM 131 276 0 15 Oct 2021
Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning Runxin Xu Fuli Luo Zhiyuan Zhang Chuanqi Tan Baobao Chang Songfang Huang Fei Huang LRM 133 177 0 13 Sep 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 275 3,784 0 18 Apr 2021
Understanding and Improving Lexical Choice in Non-Autoregressive Translation Liang Ding Longyue Wang Xuebo Liu Derek F. Wong Dacheng Tao Zhaopeng Tu 85 76 0 29 Dec 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 248 1,382 0 21 Jan 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018