ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.10199
  4. Cited By
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based
  Masked Language-models
v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021
18 June 2021
Elad Ben-Zaken
Shauli Ravfogel
Yoav Goldberg
ArXiv (abs)PDFHTML

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 968 papers shown
Harnessing Frozen Unimodal Encoders for Flexible Multimodal Alignment
Harnessing Frozen Unimodal Encoders for Flexible Multimodal AlignmentComputer Vision and Pattern Recognition (CVPR), 2024
Mayug Maniparambil
Raiymbek Akshulakov
Y. A. D. Djilali
Sanath Narayan
Ankit Singh
Noel E. O'Connor
VLMMLLM
164
0
0
28 Sep 2024
PEDRO: Parameter-Efficient Fine-tuning with Prompt DEpenDent
  Representation MOdification
PEDRO: Parameter-Efficient Fine-tuning with Prompt DEpenDent Representation MOdificationInternational Conference on Neural Information Processing (ICONIP), 2024
Tianfang Xie
Tianjing Li
Wei Zhu
Wei Han
Yi Zhao
301
7
0
26 Sep 2024
On the Implicit Relation Between Low-Rank Adaptation and Differential Privacy
On the Implicit Relation Between Low-Rank Adaptation and Differential Privacy
Saber Malekmohammadi
G. Farnadi
546
2
0
26 Sep 2024
Parameter-efficient Bayesian Neural Networks for Uncertainty-aware Depth
  Estimation
Parameter-efficient Bayesian Neural Networks for Uncertainty-aware Depth Estimation
Richard D. Paul
Alessio Quercia
Vincent Fortuin
Katharina Nöh
Hanno Scharr
UQCVBDL
175
2
0
25 Sep 2024
Vision-Language Model Fine-Tuning via Simple Parameter-Efficient
  Modification
Vision-Language Model Fine-Tuning via Simple Parameter-Efficient ModificationConference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Ming Li
J. Zhong
Chenxin Li
Liuzhuozheng Li
Nie Lin
Masashi Sugiyama
CLIPVLM
192
21
0
25 Sep 2024
Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual Recognition
Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual RecognitionComputer Vision and Pattern Recognition (CVPR), 2024
Zheda Mai
Ping Zhang
Cheng-Hao Tu
Hong-You Chen
Li Zhang
Wei-Lun Chao
303
0
0
24 Sep 2024
Multiple-Exit Tuning: Towards Inference-Efficient Adaptation for Vision
  Transformer
Multiple-Exit Tuning: Towards Inference-Efficient Adaptation for Vision Transformer
Zheng Liu
Jinchao Zhu
Nannan Li
Gao Huang
221
1
0
21 Sep 2024
HUT: A More Computation Efficient Fine-Tuning Method With Hadamard
  Updated Transformation
HUT: A More Computation Efficient Fine-Tuning Method With Hadamard Updated Transformation
Geyuan Zhang
Xiaofei Zhou
Chuheng Chen
148
0
0
20 Sep 2024
MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehension
MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression ComprehensionConference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Ting Liu
Zunnan Xu
Yue Hu
Liangtao Shi
Zhiqiang Wang
Quanjun Yin
542
6
0
20 Sep 2024
Beyond LoRA: Exploring Efficient Fine-Tuning Techniques for Time Series
  Foundational Models
Beyond LoRA: Exploring Efficient Fine-Tuning Techniques for Time Series Foundational Models
Divij Gupta
Anubhav Bhatti
Surajsinh Parmar
AI4TS
267
7
0
17 Sep 2024
Propulsion: Steering LLM with Tiny Fine-Tuning
Propulsion: Steering LLM with Tiny Fine-TuningInternational Conference on Computational Linguistics (COLING), 2024
Md. Kowsher
Nusrat Jahan Prottasha
Prakash Bhat
271
10
0
17 Sep 2024
CtRNet-X: Camera-to-Robot Pose Estimation in Real-world Conditions Using
  a Single Camera
CtRNet-X: Camera-to-Robot Pose Estimation in Real-world Conditions Using a Single CameraIEEE International Conference on Robotics and Automation (ICRA), 2024
Jingpei Lu
Zekai Liang
Tristin Xie
Florian Ritcher
Shan Lin
Sainan Liu
Michael C. Yip
189
14
0
16 Sep 2024
Self-Masking Networks for Unsupervised Adaptation
Self-Masking Networks for Unsupervised AdaptationGerman Conference on Pattern Recognition (DAGM), 2024
Alfonso Taboada Warmerdam
Mathilde Caron
Yuki M. Asano
298
2
0
11 Sep 2024
PanAdapter: Two-Stage Fine-Tuning with Spatial-Spectral Priors Injecting
  for Pansharpening
PanAdapter: Two-Stage Fine-Tuning with Spatial-Spectral Priors Injecting for PansharpeningAAAI Conference on Artificial Intelligence (AAAI), 2024
Ruocheng Wu
ZiEn Zhang
ShangQi Deng
YuLe Duan
LiangJian Deng
166
4
0
11 Sep 2024
FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous
  Low-Rank Adaptations
FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank AdaptationsNeural Information Processing Systems (NeurIPS), 2024
Ziyao Wang
Sihan Chen
Bowei Tian
Zheyu Shen
Hongyi Wang
Lingjuan Lyu
Ang Li
300
100
0
09 Sep 2024
LLMs Will Always Hallucinate, and We Need to Live With This
LLMs Will Always Hallucinate, and We Need to Live With This
Sourav Banerjee
Ayushi Agarwal
Saloni Singla
HILMLRM
320
108
0
09 Sep 2024
Efficient Training of Large Vision Models via Advanced Automated
  Progressive Learning
Efficient Training of Large Vision Models via Advanced Automated Progressive Learning
Changlin Li
Jiawei Zhang
Sihao Lin
Zongxin Yang
Junwei Liang
Xiaodan Liang
Xiaojun Chang
VLM
259
2
0
06 Sep 2024
iConFormer: Dynamic Parameter-Efficient Tuning with Input-Conditioned Adaptation
iConFormer: Dynamic Parameter-Efficient Tuning with Input-Conditioned Adaptation
Hayeon Jo
Hyesong Choi
Minhee Cho
Dongbo Min
335
3
0
04 Sep 2024
A Novel Hybrid Parameter-Efficient Fine-Tuning Approach for Hippocampus
  Segmentation and Alzheimer's Disease Diagnosis
A Novel Hybrid Parameter-Efficient Fine-Tuning Approach for Hippocampus Segmentation and Alzheimer's Disease Diagnosis
Wangang Cheng
Guanghua He
Keli Hu
Mingyu Fang
Liang Dong
Zhong Li
Hancan Zhu
196
1
0
02 Sep 2024
Task-Specific Directions: Definition, Exploration, and Utilization in Parameter Efficient Fine-Tuning
Task-Specific Directions: Definition, Exploration, and Utilization in Parameter Efficient Fine-Tuning
Chongjie Si
Zhiyi Shi
Shifan Zhang
Xiaokang Yang
Hanspeter Pfister
Wei Shen
ALM
422
5
0
02 Sep 2024
Pre-training Everywhere: Parameter-Efficient Fine-Tuning for Medical Image Analysis via Target Parameter Pre-training
Pre-training Everywhere: Parameter-Efficient Fine-Tuning for Medical Image Analysis via Target Parameter Pre-training
Xingliang Lei
Yiwen Ye
Zhisong Wang
Ziyang Chen
Minglei Shu
Weidong (Tom) Cai
Yanning Zhang
Yong-quan Xia
274
2
0
27 Aug 2024
CVPT: Cross Visual Prompt Tuning
CVPT: Cross Visual Prompt Tuning
Lingyun Huang
Jianxu Mao
Junfei Yi
Ziming Tao
Yaonan Wang
VLMVPVLM
460
2
0
27 Aug 2024
Step-by-Step Unmasking for Parameter-Efficient Fine-tuning of Large Language Models
Step-by-Step Unmasking for Parameter-Efficient Fine-tuning of Large Language Models
Aradhye Agarwal
Suhas Kamasetty Ramesh
Ayan Sengupta
Tanmoy Chakraborty
316
2
0
26 Aug 2024
SAN: Hypothesizing Long-Term Synaptic Development and Neural Engram Mechanism in Scalable Model's Parameter-Efficient Fine-Tuning
SAN: Hypothesizing Long-Term Synaptic Development and Neural Engram Mechanism in Scalable Model's Parameter-Efficient Fine-Tuning
Gaole Dai
Yiming Tang
Chunkai Fan
Qizhe Zhang
Zhi Zhang
Yulu Gan
Chengqing Zeng
Shanghang Zhang
Tiejun Huang
Tiejun Huang
171
0
0
24 Aug 2024
NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models
NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models
Cheng Lin
Lujun Li
Dezhi Li
Jie Zou
Wei Xue
Yike Guo
AI4TS
255
13
0
18 Aug 2024
OU-CoViT: Copula-Enhanced Bi-Channel Multi-Task Vision Transformers with
  Dual Adaptation for OU-UWF Images
OU-CoViT: Copula-Enhanced Bi-Channel Multi-Task Vision Transformers with Dual Adaptation for OU-UWF Images
Yang Li
Jianing Deng
Chong Zhong
Danjuan Yang
Meiyan Li
A. H. Welsh
Aiyi Liu
Xingtao Zhou
Catherine C. Liu
Bo Fu
216
0
0
18 Aug 2024
5%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual
  Recognition Tasks
5%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition TasksComputer Vision and Pattern Recognition (CVPR), 2024
Dongshuo Yin
Leiyi Hu
Bin Li
Youqun Zhang
Xue Yang
388
35
0
15 Aug 2024
SeLoRA: Self-Expanding Low-Rank Adaptation of Latent Diffusion Model for
  Medical Image Synthesis
SeLoRA: Self-Expanding Low-Rank Adaptation of Latent Diffusion Model for Medical Image Synthesis
Yuchen Mao
Hongwei Bran Li
Wei Pang
G. Papanastasiou
G. Yang
Chengjia Wang
MedIm
248
2
0
13 Aug 2024
Token Compensator: Altering Inference Cost of Vision Transformer without
  Re-Tuning
Token Compensator: Altering Inference Cost of Vision Transformer without Re-TuningEuropean Conference on Computer Vision (ECCV), 2024
Shibo Jie
Yehui Tang
Jianyuan Guo
Zhi-Hong Deng
Kai Han
Yunhe Wang
VLM
210
6
0
13 Aug 2024
Multi-scale Contrastive Adaptor Learning for Segmenting Anything in
  Underperformed Scenes
Multi-scale Contrastive Adaptor Learning for Segmenting Anything in Underperformed Scenes
Ke Zhou
Zhongwei Qiu
Dongmei Fu
VLM
196
5
0
12 Aug 2024
Unsupervised Domain Adaption Harnessing Vision-Language Pre-training
Unsupervised Domain Adaption Harnessing Vision-Language Pre-training
Wenlve Zhou
Zhiheng Zhou
VLM
284
22
0
05 Aug 2024
Contribution-based Low-Rank Adaptation with Pre-training Model for Real
  Image Restoration
Contribution-based Low-Rank Adaptation with Pre-training Model for Real Image RestorationEuropean Conference on Computer Vision (ECCV), 2024
Donwon Park
Leixian Shen
Se Young Chun
335
4
0
02 Aug 2024
Tensor Train Low-rank Approximation (TT-LoRA): Democratizing AI with
  Accelerated LLMs
Tensor Train Low-rank Approximation (TT-LoRA): Democratizing AI with Accelerated LLMsInternational Conference on Machine Learning and Applications (ICMLA), 2024
Afia Anjum
Maksim E. Eren
V. Setlur
Boian Alexandrov
Manish Bhattarai
226
12
0
02 Aug 2024
Memorization Capacity for Additive Fine-Tuning with Small ReLU Networks
Memorization Capacity for Additive Fine-Tuning with Small ReLU NetworksConference on Uncertainty in Artificial Intelligence (UAI), 2024
Jy-yong Sohn
Dohyun Kwon
Seoyeon An
Kangwook Lee
343
0
0
01 Aug 2024
Multi-Modal Parameter-Efficient Fine-tuning via Graph Neural Network
Multi-Modal Parameter-Efficient Fine-tuning via Graph Neural Network
Bin Cheng
Jiaxuan Lu
215
0
0
01 Aug 2024
CELLM: An Efficient Communication in Large Language Models Training for
  Federated Learning
CELLM: An Efficient Communication in Large Language Models Training for Federated Learning
Raja Vavekanand
Kira Sam
282
0
0
30 Jul 2024
Forecast-PEFT: Parameter-Efficient Fine-Tuning for Pre-trained Motion
  Forecasting Models
Forecast-PEFT: Parameter-Efficient Fine-Tuning for Pre-trained Motion Forecasting Models
Jifeng Wang
Kaouther Messaoud
Yuejiang Liu
Juergen Gall
Alexandre Alahi
251
5
0
28 Jul 2024
Ego-VPA: Egocentric Video Understanding with Parameter-efficient Adaptation
Ego-VPA: Egocentric Video Understanding with Parameter-efficient AdaptationIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024
Tz-Ying Wu
Kyle Min
Subarna Tripathi
Nuno Vasconcelos
EgoV
492
0
0
28 Jul 2024
Parameter-Efficient Fine-Tuning via Circular Convolution
Parameter-Efficient Fine-Tuning via Circular Convolution
Chenyi Zi
Jiashun Cheng
Zijing Liu
Ziqi Gao
Fugee Tsung
Yu-Feng Li
Jia Li
493
4
0
27 Jul 2024
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective
Jingren Liu
Zhong Ji
YunLong Yu
Jiale Cao
Yanwei Pang
Jungong Han
Xuelong Li
CLL
350
5
0
24 Jul 2024
Exploring the Effectiveness and Consistency of Task Selection in
  Intermediate-Task Transfer Learning
Exploring the Effectiveness and Consistency of Task Selection in Intermediate-Task Transfer Learning
Pin-Jie Lin
Miaoran Zhang
Marius Mosbach
Dietrich Klakow
210
0
0
23 Jul 2024
DriveDiTFit: Fine-tuning Diffusion Transformers for Autonomous Driving
DriveDiTFit: Fine-tuning Diffusion Transformers for Autonomous Driving
Jiahang Tu
Wei Ji
Han Zhao
Chao Zhang
Roger Zimmermann
Hui Qian
184
10
0
22 Jul 2024
CP-Prompt: Composition-Based Cross-modal Prompting for
  Domain-Incremental Continual Learning
CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual Learning
Yu Feng
Zhen Tian
Zhonghong Ou
Zongfu Han
Haoran Luo
Guangwei Zhang
Meina Song
CLLVLM
207
18
0
22 Jul 2024
The Inter-Intra Modal Measure: A Predictive Lens on Fine-Tuning Outcomes in Vision-Language Models
The Inter-Intra Modal Measure: A Predictive Lens on Fine-Tuning Outcomes in Vision-Language Models
Laura Niss
Kevin Vogt-Lowell
Theodoros Tsiligkaridis
VLM
306
1
0
22 Jul 2024
Missing Modality Prediction for Unpaired Multimodal Learning via Joint
  Embedding of Unimodal Models
Missing Modality Prediction for Unpaired Multimodal Learning via Joint Embedding of Unimodal Models
Donggeun Kim
Taesup Kim
260
12
0
17 Jul 2024
Enhancing Parameter Efficiency and Generalization in Large-Scale Models:
  A Regularized and Masked Low-Rank Adaptation Approach
Enhancing Parameter Efficiency and Generalization in Large-Scale Models: A Regularized and Masked Low-Rank Adaptation Approach
Yuzhu Mao
Siqi Ping
Zihao Zhao
Yang Liu
Wenbo Ding
276
2
0
16 Jul 2024
SDPT: Synchronous Dual Prompt Tuning for Fusion-based Visual-Language
  Pre-trained Models
SDPT: Synchronous Dual Prompt Tuning for Fusion-based Visual-Language Pre-trained Models
Yang Zhou
Yongjian Wu
Jiya Saiyin
Bingzheng Wei
Maode Lai
Eric Chang
Yan Xu
VLM
225
2
0
16 Jul 2024
Revolutionizing Bridge Operation and maintenance with LLM-based Agents:
  An Overview of Applications and Insights
Revolutionizing Bridge Operation and maintenance with LLM-based Agents: An Overview of Applications and Insights
Xinyu-Chen
Lianzhen-Zhang
LLMAGAI4CE
421
6
0
14 Jul 2024
Low-Rank Interconnected Adaptation across Layers
Low-Rank Interconnected Adaptation across Layers
Yibo Zhong
Jinman Zhao
Yao Zhou
OffRLMoE
435
7
0
13 Jul 2024
Data Adaptive Traceback for Vision-Language Foundation Models in Image
  Classification
Data Adaptive Traceback for Vision-Language Foundation Models in Image Classification
Wenshuo Peng
Kaipeng Zhang
Yue Yang
Hao Zhang
Ping Luo
VLM
178
4
0
11 Jul 2024
Previous
123...678...181920
Next