ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.10199
  4. Cited By
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based
  Masked Language-models
v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021
18 June 2021
Elad Ben-Zaken
Shauli Ravfogel
Yoav Goldberg
ArXiv (abs)PDFHTML

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 968 papers shown
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
Xinyu Ma
Xu Chu
Zhibang Yang
Yang Lin
Xin Gao
Junfeng Zhao
308
17
0
05 Apr 2024
ReFT: Representation Finetuning for Language Models
ReFT: Representation Finetuning for Language ModelsNeural Information Processing Systems (NeurIPS), 2024
Zhengxuan Wu
Aryaman Arora
Zheng Wang
Atticus Geiger
Daniel Jurafsky
Christopher D. Manning
Christopher Potts
OffRL
463
125
0
04 Apr 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language ModelsNeural Information Processing Systems (NeurIPS), 2024
Fanxu Meng
Zhaohui Wang
Muhan Zhang
VLM
646
195
0
03 Apr 2024
IISAN: Efficiently Adapting Multimodal Representation for Sequential
  Recommendation with Decoupled PEFT
IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFTAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2024
Junchen Fu
Xuri Ge
Xin Xin
Alexandros Karatzoglou
Ioannis Arapakis
Jie Wang
Joemon M. Jose
310
38
0
02 Apr 2024
Predicting the Performance of Foundation Models via
  Agreement-on-the-Line
Predicting the Performance of Foundation Models via Agreement-on-the-LineNeural Information Processing Systems (NeurIPS), 2024
Aman Mehra
Rahul Saxena
Taeyoun Kim
Christina Baek
Zico Kolter
Aditi Raghunathan
UQCV
213
4
0
02 Apr 2024
Efficiently Distilling LLMs for Edge Applications
Efficiently Distilling LLMs for Edge Applications
Achintya Kundu
Fabian Lim
Aaron Chew
L. Wynter
Penny Chong
Rhui Dih Lee
215
9
0
01 Apr 2024
Potentials of the Metaverse for Robotized Applications in Industry 4.0
  and Industry 5.0
Potentials of the Metaverse for Robotized Applications in Industry 4.0 and Industry 5.0
E. Kaigom
276
5
0
31 Mar 2024
InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning
InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning
Yan-Shuo Liang
Wu-Jun Li
CLL
427
116
0
30 Mar 2024
MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning
MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning
Ahmed A. Agiza
Marina Neseem
Sherief Reda
MoE
241
45
0
29 Mar 2024
LayerNorm: A key component in parameter-efficient fine-tuning
LayerNorm: A key component in parameter-efficient fine-tuning
Taha ValizadehAslani
Hualou Liang
263
5
0
29 Mar 2024
Is Synthetic Image Useful for Transfer Learning? An Investigation into
  Data Generation, Volume, and Utilization
Is Synthetic Image Useful for Transfer Learning? An Investigation into Data Generation, Volume, and Utilization
Yuhang Li
Xin Dong
Chen Chen
Jingtao Li
Yuxin Wen
Michael Spranger
Lingjuan Lyu
DiffM
264
6
0
28 Mar 2024
Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design
  Approach
Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach
Wei Dong
Xing Zhang
Bihui Chen
Dawei Yan
Zhijun Lin
Qingsen Yan
Peng Wang
Yang Yang
221
19
0
28 Mar 2024
Model Stock: All we need is just a few fine-tuned models
Model Stock: All we need is just a few fine-tuned models
Dong-Hwan Jang
Sangdoo Yun
Dongyoon Han
OODDMoMe
362
70
0
28 Mar 2024
Hierarchical Recurrent Adapters for Efficient Multi-Task Adaptation of
  Large Speech Models
Hierarchical Recurrent Adapters for Efficient Multi-Task Adaptation of Large Speech Models
Tsendsuren Munkhdalai
Youzheng Chen
K. Sim
Fadi Biadsy
Tara N. Sainath
P. M. Mengibar
178
1
0
25 Mar 2024
Block Selective Reprogramming for On-device Training of Vision
  Transformers
Block Selective Reprogramming for On-device Training of Vision Transformers
Sreetama Sarkar
Souvik Kundu
Kai Zheng
Peter A. Beerel
227
5
0
25 Mar 2024
PathoTune: Adapting Visual Foundation Model to Pathological Specialists
PathoTune: Adapting Visual Foundation Model to Pathological Specialists
Jiaxuan Lu
Fang Yan
Xiaofan Zhang
Yue Gao
Shaoting Zhang
VLMLM&MAMedIm
327
10
0
25 Mar 2024
DeepMachining: Online Prediction of Machining Errors of Lathe Machines
DeepMachining: Online Prediction of Machining Errors of Lathe Machines
Xiang-Li Lu
Hwai-Jung Hsu
Che-Wei Chou
H. T. Kung
Chen-Hsin Lee
Sheng-Mao Cheng
AI4CE
113
1
0
25 Mar 2024
ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language
  Models
ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models
Zequan Liu
Jiawen Lyn
Wei-wei Zhu
Xing Tian
Yvette Graham
OffRL
357
36
0
24 Mar 2024
SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal
  Visual Object Tracking
SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object TrackingComputer Vision and Pattern Recognition (CVPR), 2024
Xiaojun Hou
Jiazheng Xing
Yijie Qian
Yaowei Guo
Shuo Xin
...
Kai Tang
Mengmeng Wang
Zhengkai Jiang
Liang Liu
Yong-Jin Liu
320
84
0
24 Mar 2024
Towards Low-Energy Adaptive Personalization for Resource-Constrained
  Devices
Towards Low-Energy Adaptive Personalization for Resource-Constrained Devices
Yushan Huang
Josh Millar
Yuxuan Long
Yuchen Zhao
Hamed Haddadi
419
1
0
23 Mar 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
Zeyu Han
Chao Gao
Jinyang Liu
Jeff Zhang
Sai Qian Zhang
800
707
0
21 Mar 2024
LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models
LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models
Yaowei Zheng
Richong Zhang
Junhao Zhang
Yanhan Ye
Zheyan Luo
Zhangchi Feng
Yongqiang Ma
662
1,179
0
20 Mar 2024
BiLoRA: A Bi-level Optimization Framework for Overfitting-Resilient
  Low-Rank Adaptation of Large Pre-trained Models
BiLoRA: A Bi-level Optimization Framework for Overfitting-Resilient Low-Rank Adaptation of Large Pre-trained Models
Rushi Qiang
Ruiyi Zhang
Pengtao Xie
AI4CE
162
12
0
19 Mar 2024
Prompt-Guided Adaptive Model Transformation for Whole Slide Image
  Classification
Prompt-Guided Adaptive Model Transformation for Whole Slide Image Classification
Yi Lin
Zhengjie Zhu
Kwang-Ting Cheng
Hao Chen
VLMMedIm
172
5
0
19 Mar 2024
Dynamic Tuning Towards Parameter and Inference Efficiency for ViT
  Adaptation
Dynamic Tuning Towards Parameter and Inference Efficiency for ViT AdaptationNeural Information Processing Systems (NeurIPS), 2024
Wangbo Zhao
Jiasheng Tang
Yizeng Han
Yibing Song
Kai Wang
Gao Huang
F. Wang
Yang You
325
23
0
18 Mar 2024
Boosting Continual Learning of Vision-Language Models via
  Mixture-of-Experts Adapters
Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts AdaptersComputer Vision and Pattern Recognition (CVPR), 2024
Jiazuo Yu
Yunzhi Zhuge
Lu Zhang
Ping Hu
Dong Wang
Huchuan Lu
You He
VLMKELMCLLOODD
453
174
0
18 Mar 2024
Continual Forgetting for Pre-trained Vision Models
Continual Forgetting for Pre-trained Vision ModelsComputer Vision and Pattern Recognition (CVPR), 2024
Hongbo Zhao
Bolin Ni
Haochen Wang
Junsong Fan
Fei Zhu
Yuxi Wang
Yuntao Chen
Gaofeng Meng
Zhaoxiang Zhang
MUVLM
329
21
0
18 Mar 2024
Gradient based Feature Attribution in Explainable AI: A Technical Review
Gradient based Feature Attribution in Explainable AI: A Technical Review
Yongjie Wang
Tong Zhang
Xu Guo
Zhiqi Shen
XAI
285
43
0
15 Mar 2024
TransLandSeg: A Transfer Learning Approach for Landslide Semantic
  Segmentation Based on Vision Foundation Model
TransLandSeg: A Transfer Learning Approach for Landslide Semantic Segmentation Based on Vision Foundation Model
Changhong Hou
Junchuan Yu
Daqing Ge
Liu Yang
Laidian Xi
Yunxuan Pang
Yi Wen
138
5
0
15 Mar 2024
PreCurious: How Innocent Pre-Trained Language Models Turn into Privacy
  Traps
PreCurious: How Innocent Pre-Trained Language Models Turn into Privacy TrapsConference on Computer and Communications Security (CCS), 2024
Ruixuan Liu
Tianhao Wang
Yang Cao
Li Xiong
AAMLSILM
661
28
0
14 Mar 2024
PYRA: Parallel Yielding Re-Activation for Training-Inference Efficient
  Task Adaptation
PYRA: Parallel Yielding Re-Activation for Training-Inference Efficient Task AdaptationEuropean Conference on Computer Vision (ECCV), 2024
Yizhe Xiong
Hui Chen
Tianxiang Hao
Zijia Lin
Jungong Han
Yuesong Zhang
Guoxin Wang
Yongjun Bao
Guiguang Ding
340
25
0
14 Mar 2024
ProSwitch: Knowledge-Guided Instruction Tuning to Generate Professional
  and Non-Professional Styled Text
ProSwitch: Knowledge-Guided Instruction Tuning to Generate Professional and Non-Professional Styled Text
Chang Zong
Yuyan Chen
Weiming Lu
Jian Shao
Yueting Zhuang
374
1
0
14 Mar 2024
Explore In-Context Segmentation via Latent Diffusion Models
Explore In-Context Segmentation via Latent Diffusion ModelsAAAI Conference on Artificial Intelligence (AAAI), 2024
Chaoyang Wang
Xiangtai Li
Henghui Ding
Lu Qi
Jiangning Zhang
Yunhai Tong
Chen Change Loy
Shuicheng Yan
DiffM
374
13
0
14 Mar 2024
Ethos: Rectifying Language Models in Orthogonal Parameter Space
Ethos: Rectifying Language Models in Orthogonal Parameter Space
Lei Gao
Yue Niu
Tingting Tang
A. Avestimehr
Murali Annavaram
MU
313
19
0
13 Mar 2024
Fine-grained Prompt Tuning: A Parameter and Memory Efficient Transfer
  Learning Method for High-resolution Medical Image Classification
Fine-grained Prompt Tuning: A Parameter and Memory Efficient Transfer Learning Method for High-resolution Medical Image ClassificationInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2024
Yijin Huang
Pujin Cheng
Roger Tam
Xiaoying Tang
VLMMedIm
334
8
0
12 Mar 2024
Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A
  Brain-Inspired Method for Parameter-Efficient Fine-Tuning
Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning
Yao Liang
Yuwei Wang
Yang Li
Yi Zeng
224
2
0
12 Mar 2024
Generative AI for Synthetic Data Generation: Methods, Challenges and the
  Future
Generative AI for Synthetic Data Generation: Methods, Challenges and the Future
Xu Guo
Yiqiang Chen
SyDa
203
55
0
07 Mar 2024
Controllable Prompt Tuning For Balancing Group Distributional Robustness
Controllable Prompt Tuning For Balancing Group Distributional Robustness
Hoang Phan
Andrew Gordon Wilson
Qi Lei
328
12
0
05 Mar 2024
Derivative-Free Optimization for Low-Rank Adaptation in Large Language
  Models
Derivative-Free Optimization for Low-Rank Adaptation in Large Language Models
Feihu Jin
Yin Liu
Ying Tan
211
14
0
04 Mar 2024
Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer
  Learning for Point Cloud Analysis
Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysis
Xin Zhou
Dingkang Liang
Wei Xu
Xingkui Zhu
Yihan Xu
Zhikang Zou
Xiang Bai
299
45
0
03 Mar 2024
Fine Tuning vs. Retrieval Augmented Generation for Less Popular
  Knowledge
Fine Tuning vs. Retrieval Augmented Generation for Less Popular Knowledge
Heydar Soudani
Evangelos Kanoulas
Faegheh Hasibi
326
81
0
03 Mar 2024
Analysis of Privacy Leakage in Federated Large Language Models
Analysis of Privacy Leakage in Federated Large Language Models
Minh Nhat Vu
Truc D. T. Nguyen
Tre' R. Jeter
My T. Thai
198
12
0
02 Mar 2024
Large Convolutional Model Tuning via Filter Subspace
Large Convolutional Model Tuning via Filter Subspace
Wei Chen
Zichen Miao
Qiang Qiu
577
10
0
01 Mar 2024
FineDiffusion: Scaling up Diffusion Models for Fine-grained Image
  Generation with 10,000 Classes
FineDiffusion: Scaling up Diffusion Models for Fine-grained Image Generation with 10,000 Classes
Ziying Pan
Kun Wang
Gang Li
Feihong He
Yongxuan Lai
340
4
0
28 Feb 2024
Is Crowdsourcing Breaking Your Bank? Cost-Effective Fine-Tuning of
  Pre-trained Language Models with Proximal Policy Optimization
Is Crowdsourcing Breaking Your Bank? Cost-Effective Fine-Tuning of Pre-trained Language Models with Proximal Policy Optimization
Shuo Yang
Gjergji Kasneci
ALM
141
4
0
28 Feb 2024
NIIRF: Neural IIR Filter Field for HRTF Upsampling and Personalization
NIIRF: Neural IIR Filter Field for HRTF Upsampling and Personalization
Yoshiki Masuyama
Gordon Wichern
François Germain
Zexu Pan
Sameer Khurana
Chiori Hori
Jonathan Le Roux
180
18
0
27 Feb 2024
Structure-Guided Adversarial Training of Diffusion Models
Structure-Guided Adversarial Training of Diffusion Models
Ling Yang
Haotian Qian
Zhilong Zhang
Jingwei Liu
Tengjiao Wang
400
20
0
27 Feb 2024
LSPT: Long-term Spatial Prompt Tuning for Visual Representation Learning
LSPT: Long-term Spatial Prompt Tuning for Visual Representation Learning
Shentong Mo
Yansen Wang
Xufang Luo
Dongsheng Li
VLM
187
3
0
27 Feb 2024
When Scaling Meets LLM Finetuning: The Effect of Data, Model and
  Finetuning Method
When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method
Biao Zhang
Zhongtao Liu
Colin Cherry
Orhan Firat
LRM
280
233
0
27 Feb 2024
One-stage Prompt-based Continual Learning
One-stage Prompt-based Continual Learning
Youngeun Kim
Yuhang Li
Priyadarshini Panda
VLMCLL
200
17
0
25 Feb 2024
Previous
123...91011...181920
Next