ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.10199
  4. Cited By
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based
  Masked Language-models
v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021
18 June 2021
Elad Ben-Zaken
Shauli Ravfogel
Yoav Goldberg
ArXiv (abs)PDFHTML

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 968 papers shown
MemControl: Mitigating Memorization in Diffusion Models via Automated Parameter Selection
MemControl: Mitigating Memorization in Diffusion Models via Automated Parameter Selection
Raman Dutt
Pedro Sanchez
Ondrej Bohdal
Sotirios A. Tsaftaris
Timothy M. Hospedales
MedIm
490
2
0
29 May 2024
Low-Rank Few-Shot Adaptation of Vision-Language Models
Low-Rank Few-Shot Adaptation of Vision-Language Models
Maxime Zanella
Ismail Ben Ayed
OffRLVLM
214
88
0
28 May 2024
IAPT: Instruction-Aware Prompt Tuning for Large Language Models
IAPT: Instruction-Aware Prompt Tuning for Large Language Models
Wei-wei Zhu
Aaron Xuxiang Tian
Congrui Yin
Yuan Ni
Xiaoling Wang
Guotong Xie
345
0
0
28 May 2024
Sparsity- and Hybridity-Inspired Visual Parameter-Efficient Fine-Tuning
  for Medical Diagnosis
Sparsity- and Hybridity-Inspired Visual Parameter-Efficient Fine-Tuning for Medical Diagnosis
Mingyuan Liu
Lu Xu
Shengnan Liu
Jicong Zhang
165
5
0
28 May 2024
Diffusion Model Patching via Mixture-of-Prompts
Diffusion Model Patching via Mixture-of-Prompts
Seokil Ham
Sangmin Woo
Jin-Young Kim
Hyojun Go
Byeongjun Park
Changick Kim
VLM
297
5
0
28 May 2024
DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank
  Distribution
DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank Distribution
Yulong Mao
Kaiyu Huang
Changhao Guan
Ganglin Bao
Fengran Mo
Jinan Xu
365
41
0
27 May 2024
$\textit{Trans-LoRA}$: towards data-free Transferable Parameter
  Efficient Finetuning
Trans-LoRA\textit{Trans-LoRA}Trans-LoRA: towards data-free Transferable Parameter Efficient Finetuning
Runqian Wang
Soumya Ghosh
David D. Cox
Diego Antognini
Aude Oliva
Rogerio Feris
Leonid Karlinsky
290
7
0
27 May 2024
Laboratory-Scale AI: Open-Weight Models are Competitive with ChatGPT
  Even in Low-Resource Settings
Laboratory-Scale AI: Open-Weight Models are Competitive with ChatGPT Even in Low-Resource Settings
Robert Wolfe
Isaac Slaughter
Bin Han
Bingbing Wen
Yiwei Yang
...
Bernease Herman
E. Brown
Zening Qu
Nicholas Weber
Bill Howe
296
11
0
27 May 2024
LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
Klaudia Bałazy
Mohammadreza Banaei
Karl Aberer
Jacek Tabor
340
51
0
27 May 2024
Mixture of Experts Using Tensor Products
Mixture of Experts Using Tensor Products
Zhan Su
Fengran Mo
Prayag Tiwari
Benyou Wang
Jian-Yun Nie
J. Simonsen
MoEMoMe
163
3
0
26 May 2024
Optimizing Large Language Models for OpenAPI Code Completion
Optimizing Large Language Models for OpenAPI Code Completion
Bohdan Petryshyn
M. Lukoševičius
LLMAGALM
189
0
0
24 May 2024
Bridging The Gap between Low-rank and Orthogonal Adaptation via
  Householder Reflection Adaptation
Bridging The Gap between Low-rank and Orthogonal Adaptation via Householder Reflection Adaptation
Shen Yuan
Haotian Liu
Hongteng Xu
270
10
0
24 May 2024
Thinking Forward: Memory-Efficient Federated Finetuning of Language
  Models
Thinking Forward: Memory-Efficient Federated Finetuning of Language Models
Kunjal Panchal
Nisarg Parikh
Sunav Choudhary
Lijun Zhang
Yuriy Brun
Hui Guan
225
7
0
24 May 2024
VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks
VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks
Yang Li
Shaobo Han
Shihao Ji
MoE
288
28
0
24 May 2024
Sparse-Tuning: Adapting Vision Transformers with Efficient Fine-tuning and Inference
Sparse-Tuning: Adapting Vision Transformers with Efficient Fine-tuning and Inference
Ting Liu
Xuyang Liu
Liangtao Shi
Zunnan Xu
Yue Hu
Yi Xin
Quanjun Yin
Bineng Zhong
Donglin Wang
273
16
0
23 May 2024
Maintaining Structural Integrity in Parameter Spaces for Parameter Efficient Fine-tuning
Maintaining Structural Integrity in Parameter Spaces for Parameter Efficient Fine-tuningInternational Conference on Learning Representations (ICLR), 2024
Chongjie Si
Xuehui Wang
Xue Yang
Zhengqin Xu
Qingyun Li
Jifeng Dai
Yu Qiao
Yunbo Wang
Wei Shen
251
6
0
23 May 2024
Erasing the Bias: Fine-Tuning Foundation Models for Semi-Supervised
  Learning
Erasing the Bias: Fine-Tuning Foundation Models for Semi-Supervised Learning
Kai Gan
Tong Wei
250
21
0
20 May 2024
Efficient Prompt Tuning by Multi-Space Projection and Prompt Fusion
Efficient Prompt Tuning by Multi-Space Projection and Prompt Fusion
Pengxiang Lan
Enneng Yang
Yuting Liu
Guibing Guo
Linying Jiang
Jianzhe Zhao
Xingwei Wang
VLMAAML
233
4
0
19 May 2024
Low-Rank Adaptation of Time Series Foundational Models for Out-of-Domain
  Modality Forecasting
Low-Rank Adaptation of Time Series Foundational Models for Out-of-Domain Modality ForecastingInternational Conference on Multimodal Interaction (ICMI), 2024
Divij Gupta
Anubhav Bhatti
Surajsinh Parmar
Chen Dan
Yuwei Liu
Bingjie Shen
San Lee
AI4TS
208
17
0
16 May 2024
SPD-CFL: Stepwise Parameter Dropout for Efficient Continual Federated Learning
SPD-CFL: Stepwise Parameter Dropout for Efficient Continual Federated Learning
Yuning Yang
H. Yu
Tianrun Gao
Tianrun Gao
Xiaohong Liu
Xiaodong Xu
Ping Zhang
Guangyu Wang
285
6
0
15 May 2024
DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation
DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation
Jie Xu
Karthikeyan P. Saravanan
Rogier van Dalen
Haaris Mehmood
David Tuckey
Mete Ozay
772
10
0
10 May 2024
Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
Memory-Space Visual Prompting for Efficient Vision-Language Fine-TuningInternational Conference on Machine Learning (ICML), 2024
Shibo Jie
Yehui Tang
Ning Ding
Zhi-Hong Deng
Kai Han
Yunhe Wang
VLM
345
20
0
09 May 2024
FlexEControl: Flexible and Efficient Multimodal Control for
  Text-to-Image Generation
FlexEControl: Flexible and Efficient Multimodal Control for Text-to-Image Generation
Xuehai He
Jian Zheng
Jacob Zhiyuan Fang
Robinson Piramuthu
Mohit Bansal
Vicente Ordonez
Gunnar Sigurdsson
Nanyun Peng
Xin Eric Wang
DiffM
235
4
0
08 May 2024
Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
Parameter-Efficient Fine-Tuning with Discrete Fourier TransformInternational Conference on Machine Learning (ICML), 2024
Ziqi Gao
Qichao Wang
Chenyi Zi
Zijing Liu
Bingzhe Wu
Liang Chen
Jia Li
310
57
0
05 May 2024
Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuning
Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuningInternational Conference on Machine Learning (ICML), 2024
Jing Xu
Jingzhao Zhang
226
11
0
04 May 2024
SPAFIT: Stratified Progressive Adaptation Fine-tuning for Pre-trained
  Large Language Models
SPAFIT: Stratified Progressive Adaptation Fine-tuning for Pre-trained Large Language Models
Samir Arora
Liangliang Wang
115
1
0
30 Apr 2024
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning
  Leveraging Weight Decomposition
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition
Yuxuan Yan
Qianqian Yang
Shunpu Tang
Zhiguo Shi
588
32
0
29 Apr 2024
HFT: Half Fine-Tuning for Large Language Models
HFT: Half Fine-Tuning for Large Language Models
Tingfeng Hui
Ying Tai
Shuohuan Wang
Weiran Xu
Yu Sun
Hua Wu
CLL
295
13
0
29 Apr 2024
Chameleon: A Data-Efficient Generalist for Dense Visual Prediction in
  the Wild
Chameleon: A Data-Efficient Generalist for Dense Visual Prediction in the Wild
Donggyun Kim
Seongwoong Cho
Semin Kim
Chong Luo
Seunghoon Hong
VLM
258
5
0
29 Apr 2024
BlockLLM: Multi-tenant Finer-grained Serving for Large Language Models
BlockLLM: Multi-tenant Finer-grained Serving for Large Language Models
Jiamin Li
Le Xu
Hong-Yu Xu
Aditya Akella
243
6
0
28 Apr 2024
Towards Incremental Learning in Large Language Models: A Critical Review
Towards Incremental Learning in Large Language Models: A Critical Review
M. Jovanovic
Peter Voss
ELMCLLKELM
597
8
0
28 Apr 2024
AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with
  Foundation Models
AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Models
Zhiqiang Tang
Haoyang Fang
Su Zhou
Taojiannan Yang
Zihan Zhong
Tony Hu
Katrin Kirchhoff
George Karypis
322
30
0
24 Apr 2024
Generalization Measures for Zero-Shot Cross-Lingual Transfer
Generalization Measures for Zero-Shot Cross-Lingual Transfer
Saksham Bassi
Duygu Ataman
Kyunghyun Cho
216
0
0
24 Apr 2024
FL-TAC: Enhanced Fine-Tuning in Federated Learning via Low-Rank,
  Task-Specific Adapter Clustering
FL-TAC: Enhanced Fine-Tuning in Federated Learning via Low-Rank, Task-Specific Adapter Clustering
Siqi Ping
Yuzhu Mao
Yang Liu
Xiao-Ping Zhang
Wenbo Ding
FedML
251
6
0
23 Apr 2024
Advances and Open Challenges in Federated Learning with Foundation
  Models
Advances and Open Challenges in Federated Learning with Foundation Models
Chao Ren
Han Yu
Hongyi Peng
Xiaoli Tang
Anran Li
...
A. Tan
Bo Zhao
Xiaoxiao Li
Zengxiang Li
Qiang Yang
FedMLAIFinAI4CE
435
3
0
23 Apr 2024
ColA: Collaborative Adaptation with Gradient Learning
ColA: Collaborative Adaptation with Gradient Learning
Enmao Diao
Qi Le
Suya Wu
Xinran Wang
Ali Anwar
Jie Ding
Vahid Tarokh
212
1
0
22 Apr 2024
MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based
  Mixture of Experts
MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
Dengchun Li
Yingzi Ma
Naizheng Wang
Zhengmao Ye
Zhiyuan Cheng
...
Yan Zhang
Lei Duan
Jie Zuo
Cal Yang
Mingjie Tang
MoE
371
108
0
22 Apr 2024
Parameter Efficient Fine Tuning: A Comprehensive Analysis Across
  Applications
Parameter Efficient Fine Tuning: A Comprehensive Analysis Across Applications
Charith Chandra Sai Balne
S. Bhaduri
Tamoghna Roy
Vinija Jain
Vasu Sharma
338
33
0
21 Apr 2024
A Large-scale Medical Visual Task Adaptation Benchmark
A Large-scale Medical Visual Task Adaptation Benchmark
Shentong Mo
Xufang Luo
Yansen Wang
Dongsheng Li
MedIm
154
3
0
19 Apr 2024
AdaIR: Exploiting Underlying Similarities of Image Restoration Tasks
  with Adapters
AdaIR: Exploiting Underlying Similarities of Image Restoration Tasks with Adapters
Hao-Wei Chen
Yu-Syuan Xu
Kelvin C. K. Chan
Hsien-Kai Kuo
Chun-Yi Lee
Ming-Hsuan Yang
240
2
0
17 Apr 2024
Diffscaler: Enhancing the Generative Prowess of Diffusion Transformers
Diffscaler: Enhancing the Generative Prowess of Diffusion Transformers
Nithin Gopalakrishnan Nair
Jeya Maria Jose Valanarasu
Vishal M. Patel
232
2
0
15 Apr 2024
LoRA Dropout as a Sparsity Regularizer for Overfitting Control
LoRA Dropout as a Sparsity Regularizer for Overfitting Control
Yang Lin
Xinyu Ma
Xu Chu
Yujie Jin
Zhibang Yang
Yasha Wang
Hong-yan Mei
216
46
0
15 Apr 2024
How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Model
How to build the best medical image segmentation algorithm using foundation models: a comprehensive empirical study with Segment Anything Model
Han Gu
Haoyu Dong
Jichen Yang
Maciej A. Mazurowski
MedImVLM
381
42
0
15 Apr 2024
Navigating the Landscape of Large Language Models: A Comprehensive
  Review and Analysis of Paradigms and Fine-Tuning Strategies
Navigating the Landscape of Large Language Models: A Comprehensive Review and Analysis of Paradigms and Fine-Tuning Strategies
Benjue Weng
LM&MA
284
14
0
13 Apr 2024
Diffusion Models Meet Remote Sensing: Principles, Methods, and
  Perspectives
Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives
Yidan Liu
Jun Yue
Shaobo Xia
Pedram Ghamisi
Weiying Xie
Leyuan Fang
DiffM
381
30
0
13 Apr 2024
Emerging Property of Masked Token for Effective Pre-training
Emerging Property of Masked Token for Effective Pre-training
Hyesong Choi
Hunsang Lee
Seyoung Joung
Hyejin Park
Jiyeong Kim
Dongbo Min
170
10
0
12 Apr 2024
Salience-Based Adaptive Masking: Revisiting Token Dynamics for Enhanced
  Pre-training
Salience-Based Adaptive Masking: Revisiting Token Dynamics for Enhanced Pre-training
Hyesong Choi
Hyejin Park
Kwang Moo Yi
Sungmin Cha
Dongbo Min
271
10
0
12 Apr 2024
iVPT: Improving Task-relevant Information Sharing in Visual Prompt
  Tuning by Cross-layer Dynamic Connection
iVPT: Improving Task-relevant Information Sharing in Visual Prompt Tuning by Cross-layer Dynamic Connection
Nan Zhou
Jiaxin Chen
Di Huang
260
3
0
08 Apr 2024
DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large
  Language Model
DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model
Chao Gao
Sai Qian Zhang
ALM
370
9
0
08 Apr 2024
Facial Affective Behavior Analysis with Instruction Tuning
Facial Affective Behavior Analysis with Instruction Tuning
Jiayi Zhang
Anh Dao
Wentao Bao
Zhen Tan
Tianlong Chen
Huan Liu
Yu Kong
CVBM
251
23
0
07 Apr 2024
Previous
123...8910...181920
Next