ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.10199
  4. Cited By
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based
  Masked Language-models
v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021
18 June 2021
Elad Ben-Zaken
Shauli Ravfogel
Yoav Goldberg
ArXiv (abs)PDFHTML

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 965 papers shown
Title
Parameter-Efficient Multi-Task Learning via Progressive Task-Specific Adaptation
Parameter-Efficient Multi-Task Learning via Progressive Task-Specific Adaptation
Neeraj Gangwar
A. Rangi
Rishabh Deshmukh
Holakou Rahmanian
Yesh Dattatreya
N. Kani
MoMe
136
0
0
23 Sep 2025
TASO: Task-Aligned Sparse Optimization for Parameter-Efficient Model Adaptation
TASO: Task-Aligned Sparse Optimization for Parameter-Efficient Model Adaptation
Daiye Miao
Yufang Liu
Jie Wang
Changzhi Sun
Yunke Zhang
Demei Yan
Shaokang Dong
Qi Zhang
Man Lan
72
0
0
22 Sep 2025
COLA: Context-aware Language-driven Test-time Adaptation
COLA: Context-aware Language-driven Test-time AdaptationIEEE Transactions on Image Processing (IEEE TIP), 2025
Aiming Zhang
Tianyuan Yu
Liang Bai
Jun Tang
Yanming Guo
Yirun Ruan
Yun Zhou
Zhihe Lu
TTAVLM
246
0
0
22 Sep 2025
BEFT: Bias-Efficient Fine-Tuning of Language Models
BEFT: Bias-Efficient Fine-Tuning of Language Models
Baichuan Huang
Ananth Balashankar
Amir Aminifar
96
0
0
19 Sep 2025
Latent Traits and Cross-Task Transfer: Deconstructing Dataset Interactions in LLM Fine-tuning
Latent Traits and Cross-Task Transfer: Deconstructing Dataset Interactions in LLM Fine-tuningJoint Conference on Lexical and Computational Semantics (*SEM), 2025
Shambhavi Krishna
Atharva Naik
Chaitali Agarwal
Sudharshan Govindan
Taesung Lee
Haw-Shiuan Chang
119
0
0
17 Sep 2025
LadderSym: A Multimodal Interleaved Transformer for Music Practice Error Detection
LadderSym: A Multimodal Interleaved Transformer for Music Practice Error Detection
Benjamin Shiue-Hal Chou
Purvish Jajal
Nick Eliopoulos
James C. Davis
George K. Thiruvathukal
Kristen Yeon-Ji Yun
Yung-Hsiang Lu
116
0
0
16 Sep 2025
PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint
PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint
Bhoomit Vasani
Jack FitzGerald
Anjie Fang
Sushmit Vaish
116
1
0
13 Sep 2025
HEFT: A Coarse-to-Fine Hierarchy for Enhancing the Efficiency and Accuracy of Language Model Reasoning
HEFT: A Coarse-to-Fine Hierarchy for Enhancing the Efficiency and Accuracy of Language Model Reasoning
Brennen Hill
76
0
0
11 Sep 2025
DP-FedLoRA: Privacy-Enhanced Federated Fine-Tuning for On-Device Large Language Models
DP-FedLoRA: Privacy-Enhanced Federated Fine-Tuning for On-Device Large Language Models
Honghui Xu
Shiva Shrestha
Wei Chen
Zhiyuan Li
Zhipeng Cai
93
0
0
11 Sep 2025
Universal Few-Shot Spatial Control for Diffusion Models
Universal Few-Shot Spatial Control for Diffusion Models
Kiet T. Nguyen
Chanhuyk Lee
Donggyun Kim
Dong Hoon Lee
Seunghoon Hong
80
0
0
09 Sep 2025
LM-Searcher: Cross-domain Neural Architecture Search with LLMs via Unified Numerical Encoding
LM-Searcher: Cross-domain Neural Architecture Search with LLMs via Unified Numerical Encoding
Yuxuan Hu
Jihao Liu
Ke Wang
Jinliang Zhen
Weikang Shi
Manyuan Zhang
Qi Dou
R. Liu
Aojun Zhou
Hongsheng Li
175
1
0
06 Sep 2025
Singular Value Few-shot Adaptation of Vision-Language Models
Singular Value Few-shot Adaptation of Vision-Language Models
Taha Koleilat
H. Rivaz
Yiming Xiao
VLM
214
0
0
03 Sep 2025
SSVD: Structured SVD for Parameter-Efficient Fine-Tuning and Benchmarking under Domain Shift in ASR
SSVD: Structured SVD for Parameter-Efficient Fine-Tuning and Benchmarking under Domain Shift in ASR
Pu Wang
Shinji Watanabe
Hugo Van hamme
116
0
0
02 Sep 2025
Language-Aware Information Maximization for Transductive Few-Shot CLIP
Language-Aware Information Maximization for Transductive Few-Shot CLIP
Ghassen Baklouti
Maxime Zanella
Ismail Ben Ayed
VLM
114
0
0
30 Aug 2025
SWiFT: Soft-Mask Weight Fine-tuning for Bias Mitigation
SWiFT: Soft-Mask Weight Fine-tuning for Bias MitigationMachine Learning for Biomedical Imaging (MLBI), 2025
Junyu Yan
Feng Chen
Yuyang Xue
Yuning Du
Konstantinos Vilouras
Sotirios A. Tsaftaris
Steven McDonagh
189
0
0
26 Aug 2025
Towards Alignment-Centric Paradigm: A Survey of Instruction Tuning in Large Language Models
Towards Alignment-Centric Paradigm: A Survey of Instruction Tuning in Large Language Models
Xudong Han
Junjie Yang
Pohsun Feng
Ziqian Bi
Xinyuan Song
Junfeng Hao
Junhao Song
LM&MAALM
362
4
0
24 Aug 2025
GEM: A Scale-Aware and Distribution-Sensitive Sparse Fine-Tuning Framework for Effective Downstream Adaptation
GEM: A Scale-Aware and Distribution-Sensitive Sparse Fine-Tuning Framework for Effective Downstream Adaptation
Sungmin Kang
Jisoo Kim
Salman Avestimehr
Sunwoo Lee
MoE
128
0
0
22 Aug 2025
Pixels Under Pressure: Exploring Fine-Tuning Paradigms for Foundation Models in High-Resolution Medical Imaging
Pixels Under Pressure: Exploring Fine-Tuning Paradigms for Foundation Models in High-Resolution Medical Imaging
Zahra Tehraninasab
Amar Kumar
Tal Arbel
MedIm
97
0
0
19 Aug 2025
SynSpill: Improved Industrial Spill Detection With Synthetic Data
SynSpill: Improved Industrial Spill Detection With Synthetic Data
Aaditya Baranwal
Abdul Mueez
Jason Voelker
Guneet Bhatia
Shruti Vyas
76
0
0
13 Aug 2025
Decentralized Rank Scheduling for Energy-Constrained Multi-Task Federated Fine-Tuning in Edge-Assisted IoV Networks
Decentralized Rank Scheduling for Energy-Constrained Multi-Task Federated Fine-Tuning in Edge-Assisted IoV Networks
Bokeng Zheng
Jianqiang Zhong
Jiayi Liu
Xiaoxi Zhang
72
0
0
13 Aug 2025
MCP-Orchestrated Multi-Agent System for Automated Disinformation Detection
MCP-Orchestrated Multi-Agent System for Automated Disinformation Detection
Alexandru-Andrei Avram
Adrian Groza
Alexandru Lecu
150
0
0
13 Aug 2025
Classifier Language Models: Unifying Sparse Finetuning and Adaptive Tokenization for Specialized Classification Tasks
Classifier Language Models: Unifying Sparse Finetuning and Adaptive Tokenization for Specialized Classification Tasks
Adit Krishnan
Chu Wang
Chris Kong
73
0
0
12 Aug 2025
Separation and Collaboration: Two-Level Routing Grouped Mixture-of-Experts for Multi-Domain Continual Learning
Separation and Collaboration: Two-Level Routing Grouped Mixture-of-Experts for Multi-Domain Continual Learning
Jialu Zhou
Dianxi Shi
Shaowu Yang
Xinyu Wei
Mingyue Yang
Leqian Li
Mengzhu Wang
Chunping Qiu
CLLMoE
199
0
0
11 Aug 2025
Exploiting Layer Normalization Fine-tuning in Visual Transformer Foundation Models for Classification
Exploiting Layer Normalization Fine-tuning in Visual Transformer Foundation Models for Classification
Zhaorui Tan
Tan Pan
K. Huang
Weimiao Yu
Kai Yao
...
Qiufeng Wang
Anh Nguyen
Xin Guo
Yuan Cheng
Xi Yang
107
1
0
11 Aug 2025
Fed MobiLLM: Efficient Federated LLM Fine-Tuning over Heterogeneous Mobile Devices via Server Assisted Side-Tuning
Fed MobiLLM: Efficient Federated LLM Fine-Tuning over Heterogeneous Mobile Devices via Server Assisted Side-Tuning
Xingke Yang
Liang Li
Sicong Li
Liwei Guan
Hao Wang
Xiaoqi Qi
Jiang-Dong Liu
Xin Fu
Miao Pan
80
1
0
09 Aug 2025
Deepfake Detection that Generalizes Across Benchmarks
Deepfake Detection that Generalizes Across Benchmarks
Andrii Yermakov
Jan Cech
Jiri Matas
Mario Fritz
169
1
0
08 Aug 2025
Tensorized Clustered LoRA Merging for Multi-Task Interference
Tensorized Clustered LoRA Merging for Multi-Task Interference
Zhan Su
Fengran Mo
G. Liang
Jinghan Zhang
Bingbing Wen
Prayag Tiwari
Jian-Yun Nie
MoMe
144
0
0
06 Aug 2025
MoKA: Mixture of Kronecker Adapters
MoKA: Mixture of Kronecker Adapters
Mohammadreza Sadeghi
Mahsa Ghazvini Nejad
MirHamed Jafarzadeh Asl
Yu Gu
Yuanhao Yu
M. Asgharian
Vahid Partovi Nia
MoE
84
0
0
05 Aug 2025
Rein++: Efficient Generalization and Adaptation for Semantic Segmentation with Vision Foundation Models
Rein++: Efficient Generalization and Adaptation for Semantic Segmentation with Vision Foundation Models
Zhixiang Wei
Xiaoxiao Ma
Ruishen Yan
Tao Tu
Huajun Chen
Jinjin Zheng
Yi-jing Jin
Enhong Chen
VLM
155
1
0
03 Aug 2025
TR-PTS: Task-Relevant Parameter and Token Selection for Efficient Tuning
TR-PTS: Task-Relevant Parameter and Token Selection for Efficient Tuning
Siqi Luo
Haoran Yang
Yi Xin
Mingyang Yi
Guangyang Wu
Guangtao Zhai
Xiaohong Liu
136
5
0
30 Jul 2025
CLoRA: Parameter-Efficient Continual Learning with Low-Rank Adaptation
CLoRA: Parameter-Efficient Continual Learning with Low-Rank Adaptation
Shishir Muralidhara
D. Stricker
René Schuster
CLL
153
0
0
26 Jul 2025
Multi-Task Dense Prediction Fine-Tuning with Mixture of Fine-Grained Experts
Multi-Task Dense Prediction Fine-Tuning with Mixture of Fine-Grained Experts
Yangyang Xu
Xi Ye
Duo Su
MoEMoMe
177
0
0
25 Jul 2025
Parameter-Efficient Fine-Tuning of 3D DDPM for MRI Image Generation Using Tensor Networks
Parameter-Efficient Fine-Tuning of 3D DDPM for MRI Image Generation Using Tensor NetworksInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2025
Binghua Li
Ziqing Chang
Tong Liang
Chao Li
Toshihisa Tanaka
Shigeki Aoki
Qibin Zhao
Zhe Sun
MedIm
108
1
0
24 Jul 2025
Efficient Compositional Multi-tasking for On-device Large Language Models
Efficient Compositional Multi-tasking for On-device Large Language Models
Ondrej Bohdal
Mete Ozay
J. Moon
Kyeng-Hun Lee
Hyeonmok Ko
Umberto Michieli
174
1
0
21 Jul 2025
Solo Connection: A Parameter Efficient Fine-Tuning Technique for Transformers
Solo Connection: A Parameter Efficient Fine-Tuning Technique for Transformers
Harsh Nilesh Pathak
Randy Paffenroth
149
1
0
18 Jul 2025
Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmark
Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmark
Yi Xin
Jianjiang Yang
Haodi Zhou
Junlong Du
Qi Qin
...
Bin Fu
Xiaokang Yang
Guangtao Zhai
Ming-Hsuan Yang
Xiaohong Liu
VLM
509
86
0
01 Jul 2025
PAE MobiLLM: Privacy-Aware and Efficient LLM Fine-Tuning on the Mobile Device via Additive Side-Tuning
PAE MobiLLM: Privacy-Aware and Efficient LLM Fine-Tuning on the Mobile Device via Additive Side-Tuning
Xingke Yang
Liang Li
Zhiyi Wan
Sicong Li
Xiaoqi Qi
Jiang Liu
Tomoaki Ohtsuki
Xin Fu
Miao Pan
170
2
0
01 Jul 2025
Orthogonal Finetuning Made Scalable
Orthogonal Finetuning Made Scalable
Zeju Qiu
Weiyang Liu
Adrian Weller
Bernhard Schölkopf
169
1
0
24 Jun 2025
Benchmarking Foundation Models and Parameter-Efficient Fine-Tuning for Prognosis Prediction in Medical Imaging
Benchmarking Foundation Models and Parameter-Efficient Fine-Tuning for Prognosis Prediction in Medical Imaging
Filippo Ruffini
Elena Mulero Ayllón
Linlin Shen
Paolo Soda
V. Guarrasi
LM&MA
268
4
0
23 Jun 2025
A geometric framework for momentum-based optimizers for low-rank training
A geometric framework for momentum-based optimizers for low-rank training
Steffen Schotthöfer
Timon Klein
J. Kusch
AI4CE
161
1
0
20 Jun 2025
SafeTriage: Facial Video De-identification for Privacy-Preserving Stroke Triage
SafeTriage: Facial Video De-identification for Privacy-Preserving Stroke TriageInformation Processing in Medical Imaging (IPMI), 2025
Tongan Cai
Haomiao Ni
Wenchao Ma
Yuan Xue
Qian Ma
...
Kelvin K. Wong
John Volpi
Stephen T. C. Wong
James Z. Wang
Sharon X. Huang
127
0
0
19 Jun 2025
Joint Tensor-Train Parameterization for Efficient and Expressive Low-Rank Adaptation
Joint Tensor-Train Parameterization for Efficient and Expressive Low-Rank Adaptation
Jun Qi
Chen-Yu Liu
Sabato Marco Siniscalchi
Chao-Han Huck Yang
Min-hsiu Hsieh
174
0
0
19 Jun 2025
Improving LoRA with Variational Learning
Improving LoRA with Variational Learning
Bai Cong
Nico Daheim
Yuesong Shen
Rio Yokota
Mohammad Emtiyaz Khan
Thomas Möllenhoff
199
1
0
17 Jun 2025
Dynamic Context-oriented Decomposition for Task-aware Low-rank Adaptation with Less Forgetting and Faster Convergence
Dynamic Context-oriented Decomposition for Task-aware Low-rank Adaptation with Less Forgetting and Faster Convergence
Jianlong Wu
Sihao Liu
Chuan Rao
Bang An
Tiancheng Shen
Juil Sock
Ming-Hsuan Yang
Bernard Ghanem
200
4
0
16 Jun 2025
Theoretically Unmasking Inference Attacks Against LDP-Protected Clients in Federated Vision Models
Theoretically Unmasking Inference Attacks Against LDP-Protected Clients in Federated Vision Models
Quan Nguyen
Minh Nhat Vu
Truc D. T. Nguyen
My T. Thai
AAMLFedML
141
0
0
16 Jun 2025
LARGO: Low-Rank Regulated Gradient Projection for Robust Parameter Efficient Fine-Tuning
LARGO: Low-Rank Regulated Gradient Projection for Robust Parameter Efficient Fine-Tuning
Haotian Zhang
Liu Liu
Baosheng Yu
Jiayan Qiu
Yanwei Ren
Xianglong Liu
182
0
0
14 Jun 2025
EMLoC: Emulator-based Memory-efficient Fine-tuning with LoRA Correction
EMLoC: Emulator-based Memory-efficient Fine-tuning with LoRA Correction
Hsi-Che Lin
Yu-Chu Yu
Kai-Po Chang
Y. Wang
234
0
0
13 Jun 2025
Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA AllocationIEEE Transactions on Neural Networks and Learning Systems (IEEE TNNLS), 2025
Zikai Zhang
Ping Liu
Jiahao Xu
Rui Hu
212
5
0
13 Jun 2025
FedNano: Toward Lightweight Federated Tuning for Pretrained Multimodal Large Language Models
FedNano: Toward Lightweight Federated Tuning for Pretrained Multimodal Large Language Models
Y. Zhang
Hewei Gao
Haokun Chen
Weiguo Li
Yunpu Ma
Volker Tresp
116
1
0
12 Jun 2025
Attention, Please! Revisiting Attentive Probing Through the Lens of Efficiency
Attention, Please! Revisiting Attentive Probing Through the Lens of Efficiency
Bill Psomas
Dionysis Christopoulos
Eirini Baltzi
Ioannis Kakogeorgiou
Tilemachos Aravanis
N. Komodakis
Konstantinos Karantzalos
Yannis Avrithis
Giorgos Tolias
265
1
0
11 Jun 2025
Previous
12345...181920
Next