Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey

3 February 2024

Yi Xin

Jianjiang Yang

Yuntao Du

Papers citing "Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey"

50 / 67 papers shown

Title
A Sensor Agnostic Domain Generalization Framework for Leveraging Geospatial Foundation Models: Enhancing Semantic Segmentation viaSynergistic Pseudo-Labeling and Generative Learning Anan Yaghmour Melba M. Crawford Saurabh Prasad 14 0 0 02 May 2025
Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Preference Understanding Kun Li J. Wang Yangfan He Xinyuan Song Ruoyu Wang ... K. Li Sida Li Miao Zhang Tianyu Shi Xueqian Wang 37 0 0 25 Apr 2025
Prompt-Tuning SAM: From Generalist to Specialist with only 2048 Parameters and 16 Training Images Tristan Piater Björn Barz Alexander Freytag VLM MedIm 47 0 0 23 Apr 2025
PointLoRA: Low-Rank Adaptation with Token Selection for Point Cloud Learning Song Wang Xiaolu Liu Lingdong Kong Jianyun Xu Chunyong Hu Gongfan Fang Wentong Li Jianke Zhu Xinchao Wang 19 0 0 22 Apr 2025
Parameter-Efficient Continual Fine-Tuning: A Survey Eric Nuertey Coleman Luigi Quarantiello Ziyue Liu Qinwen Yang Samrat Mukherjee J. Hurtado Vincenzo Lomonaco CLL 24 0 0 18 Apr 2025
CSMF: Cascaded Selective Mask Fine-Tuning for Multi-Objective Embedding-Based Retrieval Hao Deng Haibo Xing Kanefumi Matsuyama Moyu Zhang Jinxin Hu Hong Wen Yu Zhang Xiaoyi Zeng Jing-Xuan Zhang 26 0 0 17 Apr 2025
FastRSR: Efficient and Accurate Road Surface Reconstruction from Bird's Eye View Yuting Zhao Yuheng Ji Xiaoshuai Hao Shuxiao Li 23 0 0 13 Apr 2025
Neural Pruning for 3D Scene Reconstruction: Efficient NeRF Acceleration Tianqi Ding Dawei Xiang Pablo Rivas Liang Dong 41 1 0 01 Apr 2025
Decoupling Angles and Strength in Low-rank Adaptation Massimo Bini Leander Girrbach Zeynep Akata 40 0 0 23 Mar 2025
TDRI: Two-Phase Dialogue Refinement and Co-Adaptation for Interactive Image Generation Yuheng Feng Jianhui Wang Kun Li Sida Li Tianyu Shi Haoyue Han Miao Zhang Xueqian Wang DiffM 41 0 0 22 Mar 2025
A Survey on Federated Fine-tuning of Large Language Models Yebo Wu Chunlin Tian Jingguang Li He Sun Kahou Tam Li Li Chengzhong Xu FedML 75 0 0 15 Mar 2025
Achieving More with Less: Additive Prompt Tuning for Rehearsal-Free Class-Incremental Learning Haoran Chen Ping Wang Zihan Zhou X. Zhang Zuxuan Wu Yu Jiang CLL 52 0 0 11 Mar 2025
Iterative Prompt Relocation for Distribution-Adaptive Visual Prompt Tuning Chikai Shang Mengke Li Yiqun Zhang Zhen Chen Jinlin Wu Fangqing Gu Yang Lu Yiu-ming Cheung VLM 63 0 0 10 Mar 2025
Resource-Efficient Affordance Grounding with Complementary Depth and Semantic Prompts Yizhou Huang Fan Yang Guoliang Zhu Gen Li Hao-miao Shi Yukun Zuo Wenrui Chen Z. Li Kailun Yang 56 0 0 04 Mar 2025
CoPEFT: Fast Adaptation Framework for Multi-Agent Collaborative Perception with Parameter-Efficient Fine-Tuning Quanmin Wei Penglin Dai Wei Li Bingyi Liu Xiao-Jun Wu 33 0 0 15 Feb 2025
Parameter-Efficient Fine-Tuning for Foundation Models Dan Zhang Tao Feng Lilong Xue Yuandong Wang Yuxiao Dong J. Tang 31 6 0 23 Jan 2025
MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehension Ting Liu Zunnan Xu Yue Hu Liangtao Shi Zhiqiang Wang Quanjun Yin 54 2 0 03 Jan 2025
Efficient Fine-Tuning of Single-Cell Foundation Models Enables Zero-Shot Molecular Perturbation Prediction Sepideh Maleki Jan-Christian Huetter Kangway V Chuang Gabriele Scalia Tommaso Biancalani Tommaso Biancalani AI4CE 77 2 0 18 Dec 2024
Selective Visual Prompting in Vision Mamba Yifeng Yao Zichen Liu Zhenyu Cui Yuxin Peng Jiahuan Zhou VLM Mamba 79 1 0 12 Dec 2024
LQ-Adapter: ViT-Adapter with Learnable Queries for Gallbladder Cancer Detection from Ultrasound Image Chetan Madan Mayuna Gupta Soumen Basu Pankaj Gupta Chetan Arora 78 0 0 30 Nov 2024
Video-to-Task Learning via Motion-Guided Attention for Few-Shot Action Recognition Hanyu Guo Wanchuan Yu Suzhou Que Kaiwen Du Yan Yan Hanzi Wang 68 1 0 18 Nov 2024
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies L. Wang Sheng Chen Linnan Jiang Shu Pan Runze Cai Sen Yang Fei Yang 40 3 0 24 Oct 2024
MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning Jingfan Zhang Yi Zhao Dan Chen Xing Tian Huanran Zheng Wei Zhu MoE 23 12 0 23 Oct 2024
A Unified View of Delta Parameter Editing in Post-Trained Large-Scale Models Qiaoyu Tang Le Yu Bowen Yu Hongyu Lin K. Lu Y. Lu Xianpei Han Le Sun MoMe 24 1 0 17 Oct 2024
SAM-Guided Masked Token Prediction for 3D Scene Understanding Zhimin Chen Liang Yang Yingwei Li Longlong Jing Bing Li 21 3 0 16 Oct 2024
A Survey of Low-shot Vision-Language Model Adaptation via Representer Theorem Kun Ding Ying Wang Gaofeng Meng Shiming Xiang VLM 24 0 0 15 Oct 2024
Parameter-Efficient Fine-Tuning of Large Language Models using Semantic Knowledge Tuning Nusrat Jahan Prottasha Asif Mahmud Md. Shohanur Islam Sobuj Prakash Bhat Md. Kowsher Niloofar Yousefi O. Garibay 22 4 0 11 Oct 2024
Revisiting Prefix-tuning: Statistical Benefits of Reparameterization among Prompts Minh Le Chau Nguyen Huy Nguyen Quyen Tran Trung Le Nhat Ho 25 3 0 03 Oct 2024
Efficient Source-Free Time-Series Adaptation via Parameter Subspace Disentanglement Gaurav Patel Christopher Sandino Behrooz Mahasseni Ellen L. Zippi Erdrin Azemi Ali Moin Juri Minxha TTA AI4TS 37 3 0 03 Oct 2024
Pruning then Reweighting: Towards Data-Efficient Training of Diffusion Models Yize Li Yihua Zhang Sijia Liu Xue Lin 37 3 0 27 Sep 2024
Improving Intersession Reproducibility for Forearm Ultrasound based Hand Gesture Classification through an Incremental Learning Approach Keshav Bimbraw Jack Rothenberg Haichong K. Zhang 29 0 0 24 Sep 2024
Leveraging Foundation Models for Efficient Federated Learning in Resource-restricted Edge Networks S. K. Atapour S. J. Seyedmohammadi S. Mohammad Sheikholeslami J. Abouei Konstantinos N. Plataniotis Arash Mohammadi FedML 45 1 0 14 Sep 2024
Structuring a Training Strategy to Robustify Perception Models with Realistic Image Augmentations Ahmed Hammam B. K. Sreedhar Nura Kawa Tim Patzelt Oliver De Candido 28 0 0 30 Aug 2024
TalkLoRA: Low-Rank Adaptation for Speech-Driven Animation Jack D. Saunders Vinay P. Namboodiri 40 1 0 25 Aug 2024
Adaptive Layer Selection for Efficient Vision Transformer Fine-Tuning Alessio Devoto Federico Alvetreti Jary Pomponi P. Lorenzo Pasquale Minervini Simone Scardapane 43 2 0 16 Aug 2024
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective Jingren Liu Zhong Ji Yunlong Yu Jiale Cao Yanwei Pang Jungong Han Xuelong Li CLL 23 3 0 24 Jul 2024
Reprogramming Distillation for Medical Foundation Models Yuhang Zhou Siyuan Du Haolin Li Jiangchao Yao Ya Zhang Yanfeng Wang 33 1 0 09 Jul 2024
CU-Net: a U-Net architecture for efficient brain-tumor segmentation on BraTS 2019 dataset Qimin Zhang Weiwei Qi Huili Zheng Xinyu Shen 29 30 0 19 Jun 2024
Exploiting Diffusion Prior for Out-of-Distribution Detection Armando Zhu Jiabei Liu Keqin Li Shuying Dai Bo Hong Peng Zhao Changsong Wei 27 4 0 16 Jun 2024
Research on the Application of Computer Vision Based on Deep Learning in Autonomous Driving Technology Jingyu Zhang Jin Cao Jinghao Chang Xinjin Li Houze Liu Zhenglin Li 25 14 0 01 Jun 2024
IAPT: Instruction-Aware Prompt Tuning for Large Language Models Wei-wei Zhu Aaron Xuxiang Tian Congrui Yin Yuan Ni Xiaoling Wang Guotong Xie 32 0 0 28 May 2024
Multi-Modal UAV Detection, Classification and Tracking Algorithm -- Technical Report for CVPR 2024 UG2 Challenge Tianchen Deng Yi Zhou Wenhua Wu Mingrui Li Jingwei Huang ... Hao Zuo Yanbo Wang Yutao Yue Hesheng Wang Weidong Chen 26 11 0 26 May 2024
Sparse-Tuning: Adapting Vision Transformers with Efficient Fine-tuning and Inference Ting Liu Xuyang Liu Liangtao Shi Zunnan Xu Siteng Huang Yi Xin Quanjun Yin 33 5 0 23 May 2024
Mixture of Experts Meets Prompt-Based Continual Learning Minh Le An Nguyen Huy Nguyen Trang Nguyen Trang Pham L. Ngo Nhat Ho CLL 35 7 0 23 May 2024
Towards SAR Automatic Target Recognition MultiCategory SAR Image Classification Based on Light Weight Vision Transformer Guibin Zhao Pengfei Li Zhibo Zhang Fusen Guo Xueting Huang Wei Xu Jinyin Wang Jianlong Chen 21 6 0 18 May 2024
LLM-based Multi-Agent Reinforcement Learning: Current and Future Directions Chuanneng Sun Songjun Huang D. Pompili LLMAG 29 21 0 17 May 2024
Real-Time Pill Identification for the Visually Impaired Using Deep Learning Bo Dang Wenchao Zhao Yufeng Li Danqing Ma Qixuan Yu Elly Yijun Zhu MedIm 32 37 0 08 May 2024
Mapping New Realities: Ground Truth Image Creation with Pix2Pix Image-to-Image Translation Zhenglin Li Bo Guan Yuanzhou Wei Yiming Zhou Jingyu Zhang Jinxin Xu 34 10 0 30 Apr 2024
Adaptive speed planning for Unmanned Vehicle Based on Deep Reinforcement Learning Hao Liu Yi Shen Wenjing Zhou Yuelin Zou Chang Zhou Shuyao He 21 26 0 26 Apr 2024
Cross-Task Multi-Branch Vision Transformer for Facial Expression and Mask Wearing Classification Armando Zhu Keqin Li Tong Wu Peng Zhao Bo Hong 23 25 0 22 Apr 2024