BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 816 papers shown

Title
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models Fanxu Meng Zhaohui Wang Muhan Zhang VLM 64 70 0 03 Apr 2024
IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFT Junchen Fu Xuri Ge Xin Xin Alexandros Karatzoglou Ioannis Arapakis Jie Wang Joemon M. Jose 39 17 0 02 Apr 2024
Predicting the Performance of Foundation Models via Agreement-on-the-Line Aman Mehra Rahul Saxena Taeyoun Kim Christina Baek Zico Kolter Aditi Raghunathan UQCV 43 1 0 02 Apr 2024
Efficiently Distilling LLMs for Edge Applications Achintya Kundu Fabian Lim Aaron Chew L. Wynter Penny Chong Rhui Dih Lee 42 6 0 01 Apr 2024
Potentials of the Metaverse for Robotized Applications in Industry 4.0 and Industry 5.0 E. Kaigom 32 2 0 31 Mar 2024
InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning Yan-Shuo Liang Wu-Jun Li CLL 40 39 0 30 Mar 2024
MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning Ahmed A. Agiza Marina Neseem Sherief Reda MoE 43 12 0 29 Mar 2024
LayerNorm: A key component in parameter-efficient fine-tuning Taha ValizadehAslani Hualou Liang 49 1 0 29 Mar 2024
Is Synthetic Image Useful for Transfer Learning? An Investigation into Data Generation, Volume, and Utilization Yuhang Li Xin Dong Chen Chen Jingtao Li Yuxin Wen Michael Spranger Lingjuan Lyu DiffM 30 4 0 28 Mar 2024
Model Stock: All we need is just a few fine-tuned models Dong-Hwan Jang Sangdoo Yun Dongyoon Han OODD MoMe 32 38 0 28 Mar 2024
Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach Wei Dong Xing Zhang Bihui Chen Dawei Yan Zhijun Lin Qingsen Yan Peng Wang Yang Yang 39 6 0 28 Mar 2024
Hierarchical Recurrent Adapters for Efficient Multi-Task Adaptation of Large Speech Models Tsendsuren Munkhdalai Youzheng Chen K. Sim Fadi Biadsy Tara N. Sainath P. M. Mengibar 19 1 0 25 Mar 2024
Block Selective Reprogramming for On-device Training of Vision Transformers Sreetama Sarkar Souvik Kundu Kai Zheng P. Beerel 37 2 0 25 Mar 2024
PathoTune: Adapting Visual Foundation Model to Pathological Specialists Jiaxuan Lu Fang Yan Xiaofan Zhang Yue Gao Shaoting Zhang VLM LM&MA MedIm 42 6 0 25 Mar 2024
DeepMachining: Online Prediction of Machining Errors of Lathe Machines Xiang-Li Lu Hwai-Jung Hsu Che-Wei Chou H. T. Kung Chen-Hsin Lee Sheng-Mao Cheng AI4CE 23 0 0 25 Mar 2024
ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models Zequan Liu Jiawen Lyn Wei-wei Zhu Xing Tian Yvette Graham OffRL 32 10 0 24 Mar 2024
SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking Xiaojun Hou Jiazheng Xing Yijie Qian Yaowei Guo Shuo Xin ... Kai Tang Mengmeng Wang Zhengkai Jiang Liang Liu Yong-Jin Liu 30 22 0 24 Mar 2024
Towards Low-Energy Adaptive Personalization for Resource-Constrained Devices Yushan Huang Josh Millar Yuxuan Long Yuchen Zhao Hamed Haddadi 38 0 0 23 Mar 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 150 310 0 21 Mar 2024
LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models Yaowei Zheng Richong Zhang Junhao Zhang Yanhan Ye Zheyan Luo Zhangchi Feng Yongqiang Ma 35 368 0 20 Mar 2024
BiLoRA: A Bi-level Optimization Framework for Overfitting-Resilient Low-Rank Adaptation of Large Pre-trained Models Rushi Qiang Ruiyi Zhang Pengtao Xie AI4CE 28 8 0 19 Mar 2024
Prompt-Guided Adaptive Model Transformation for Whole Slide Image Classification Yi-Mou Lin Zhengjie Zhu Kwang-Ting Cheng Hao Chen VLM MedIm 19 3 0 19 Mar 2024
Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation Wangbo Zhao Jiasheng Tang Yizeng Han Yibing Song Kai Wang Gao Huang F. Wang Yang You 40 11 0 18 Mar 2024
Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters Jiazuo Yu Yunzhi Zhuge Lu Zhang Ping Hu Dong Wang Huchuan Lu You He VLM KELM CLL OODD 108 68 0 18 Mar 2024
Continual Forgetting for Pre-trained Vision Models Hongbo Zhao Bolin Ni Haochen Wang Junsong Fan Fei Zhu Yuxi Wang Yuntao Chen Gaofeng Meng Zhaoxiang Zhang MU VLM 63 11 0 18 Mar 2024
Gradient based Feature Attribution in Explainable AI: A Technical Review Yongjie Wang Tong Zhang Xu Guo Zhiqi Shen XAI 21 18 0 15 Mar 2024
TransLandSeg: A Transfer Learning Approach for Landslide Semantic Segmentation Based on Vision Foundation Model Changhong Hou Junchuan Yu Daqing Ge Liu Yang Laidian Xi Yunxuan Pang Yi Wen 25 0 0 15 Mar 2024
PreCurious: How Innocent Pre-Trained Language Models Turn into Privacy Traps Ruixuan Liu Tianhao Wang Yang Cao Li Xiong AAML SILM 53 15 0 14 Mar 2024
PYRA: Parallel Yielding Re-Activation for Training-Inference Efficient Task Adaptation Yizhe Xiong Hui Chen Tianxiang Hao Zijia Lin Jungong Han Yuesong Zhang Guoxin Wang Yongjun Bao Guiguang Ding 45 16 0 14 Mar 2024
ProSwitch: Knowledge-Guided Instruction Tuning to Generate Professional and Non-Professional Styled Text Chang Zong Yuyan Chen Weiming Lu Jian Shao Yueting Zhuang 32 1 0 14 Mar 2024
Explore In-Context Segmentation via Latent Diffusion Models Chaoyang Wang Xiangtai Li Henghui Ding Lu Qi Jiangning Zhang Yunhai Tong Chen Change Loy Shuicheng Yan DiffM 63 6 0 14 Mar 2024
Ethos: Rectifying Language Models in Orthogonal Parameter Space Lei Gao Yue Niu Tingting Tang A. Avestimehr Murali Annavaram MU 32 10 0 13 Mar 2024
Fine-grained Prompt Tuning: A Parameter and Memory Efficient Transfer Learning Method for High-resolution Medical Image Classification Yijin Huang Pujin Cheng Roger Tam Xiaoying Tang VLM MedIm 37 1 0 12 Mar 2024
Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning Yao Liang Yuwei Wang Yang Li Yi Zeng 44 0 0 12 Mar 2024
Generative AI for Synthetic Data Generation: Methods, Challenges and the Future Xu Guo Yiqiang Chen SyDa 24 30 0 07 Mar 2024
Controllable Prompt Tuning For Balancing Group Distributional Robustness Hoang Phan Andrew Gordon Wilson Qi Lei 43 5 0 05 Mar 2024
Derivative-Free Optimization for Low-Rank Adaptation in Large Language Models Feihu Jin Yin Liu Ying Tan 35 3 0 04 Mar 2024
Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysis Xin Zhou Dingkang Liang Wei Xu Xingkui Zhu Yihan Xu Zhikang Zou Xiang Bai 24 26 0 03 Mar 2024
Fine Tuning vs. Retrieval Augmented Generation for Less Popular Knowledge Heydar Soudani Evangelos Kanoulas Faegheh Hasibi 26 28 0 03 Mar 2024
Analysis of Privacy Leakage in Federated Large Language Models Minh Nhat Vu Truc D. T. Nguyen Tre' R. Jeter My T. Thai 39 6 0 02 Mar 2024
Large Convolutional Model Tuning via Filter Subspace Wei Chen Zichen Miao Qiang Qiu 51 3 0 01 Mar 2024
FineDiffusion: Scaling up Diffusion Models for Fine-grained Image Generation with 10,000 Classes Ziying Pan Kun Wang Gang Li Feihong He Yongxuan Lai 37 0 0 28 Feb 2024
Is Crowdsourcing Breaking Your Bank? Cost-Effective Fine-Tuning of Pre-trained Language Models with Proximal Policy Optimization Shuo Yang Gjergji Kasneci ALM 45 2 0 28 Feb 2024
NIIRF: Neural IIR Filter Field for HRTF Upsampling and Personalization Yoshiki Masuyama G. Wichern François Germain Zexu Pan Sameer Khurana Chiori Hori Jonathan Le Roux 46 3 0 27 Feb 2024
Structure-Guided Adversarial Training of Diffusion Models Ling Yang Haotian Qian Zhilong Zhang Jingwei Liu Bin Cui 25 10 0 27 Feb 2024
LSPT: Long-term Spatial Prompt Tuning for Visual Representation Learning Shentong Mo Yansen Wang Xufang Luo Dongsheng Li VLM 38 1 0 27 Feb 2024
When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method Biao Zhang Zhongtao Liu Colin Cherry Orhan Firat LRM 52 124 0 27 Feb 2024
One-stage Prompt-based Continual Learning Youngeun Kim Yuhang Li Priyadarshini Panda VLM CLL 36 4 0 25 Feb 2024
PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization Xiangdi Meng Damai Dai Weiyao Luo Zhe Yang Shaoxiang Wu Xiaochen Wang Peiyi Wang Qingxiu Dong Liang Chen Zhifang Sui 114 11 0 25 Feb 2024
LoRA Meets Dropout under a Unified Framework Sheng Wang Liheng Chen Jiyue Jiang Boyang Xue Lingpeng Kong Chuan Wu 23 13 0 25 Feb 2024