Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design
Approach

Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach

28 March 2024

Wei Dong

Qingsen Yan

Peng Wang

Papers citing "Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach"

10 / 10 papers shown

Title
APLA: A Simple Adaptation Method for Vision Transformers Moein Sorkhei Emir Konuk Kevin Smith Christos Matsoukas 50 0 0 14 Mar 2025
Mixture of Physical Priors Adapter for Parameter-Efficient Fine-Tuning Z. Wang C. J. Li QiXiang Ye Tong Zhang MoE 67 1 0 03 Dec 2024
Efficient Adaptation of Pre-trained Vision Transformer via Householder Transformation Wei Dong Yuan Sun Yiting Yang Xing Zhang Zhijun Lin Qingsen Yan H. Zhang Peng Wang Yang Yang Hengtao Shen 26 0 0 30 Oct 2024
PACE: Marrying generalization in PArameter-efficient fine-tuning with Consistency rEgularization Yao Ni Shan Zhang Piotr Koniusz 78 2 0 25 Sep 2024
Multiple-Exit Tuning: Towards Inference-Efficient Adaptation for Vision Transformer Zheng Liu Jinchao Zhu Nannan Li Gao Huang 27 0 0 21 Sep 2024
LCM-LoRA: A Universal Stable-Diffusion Acceleration Module Simian Luo Yiqin Tan Suraj Patil Daniel Gu Patrick von Platen Apolinário Passos Longbo Huang Jian Li Hang Zhao MoMe 108 144 0 09 Nov 2023
AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition Shoufa Chen Chongjian Ge Zhan Tong Jiangliu Wang Yibing Song Jue Wang Ping Luo 141 635 0 26 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 258 7,412 0 11 Nov 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,835 0 18 Apr 2021
Fine-Grained Car Detection for Visual Census Estimation Timnit Gebru J. Krause Yilun Wang Duyun Chen Jia Deng Li Fei-Fei 60 116 0 07 Sep 2017