ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.10199
  4. Cited By
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based
  Masked Language-models
v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021
18 June 2021
Elad Ben-Zaken
Shauli Ravfogel
Yoav Goldberg
ArXiv (abs)PDFHTML

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 968 papers shown
Foundation Model Engineering: Engineering Foundation Models Just as
  Engineering Software
Foundation Model Engineering: Engineering Foundation Models Just as Engineering Software
Dezhi Ran
Mengzhou Wu
Wei Yang
Tao Xie
AI4CE
238
6
0
11 Jul 2024
ROSA: Random Subspace Adaptation for Efficient Fine-Tuning
ROSA: Random Subspace Adaptation for Efficient Fine-Tuning
Marawan Gamal Abdel Hameed
Aristides Milios
Siva Reddy
Guillaume Rabusseau
CLL
182
3
0
10 Jul 2024
SHERL: Synthesizing High Accuracy and Efficient Memory for
  Resource-Limited Transfer Learning
SHERL: Synthesizing High Accuracy and Efficient Memory for Resource-Limited Transfer Learning
Haiwen Diao
Bo Wan
Xu Jia
Yunzhi Zhuge
Ying Zhang
Huchuan Lu
Long Chen
VLM
235
11
0
10 Jul 2024
Pareto Low-Rank Adapters: Efficient Multi-Task Learning with Preferences
Pareto Low-Rank Adapters: Efficient Multi-Task Learning with Preferences
Nikolaos Dimitriadis
Pascal Frossard
François Fleuret
MoE
542
9
0
10 Jul 2024
Parameter-Efficient and Memory-Efficient Tuning for Vision Transformer:
  A Disentangled Approach
Parameter-Efficient and Memory-Efficient Tuning for Vision Transformer: A Disentangled Approach
Taolin Zhang
Jiawang Bai
Zhihe Lu
Dongze Lian
Genping Wang
Xinchao Wang
Shu-Tao Xia
243
6
0
09 Jul 2024
Rethinking Image-to-Video Adaptation: An Object-centric Perspective
Rethinking Image-to-Video Adaptation: An Object-centric Perspective
Rui Qian
Shuangrui Ding
Dahua Lin
OCL
229
8
0
09 Jul 2024
CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community
CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community
Yan Liu
Bin Guo
Nuo Li
Yasan Ding
Zhouyangzi Zhang
Zhiwen Yu
363
5
0
09 Jul 2024
Artificial Intuition: Efficient Classification of Scientific Abstracts
Artificial Intuition: Efficient Classification of Scientific Abstracts
Harsh Sakhrani
Naseela Pervez
Anirudh Ravi Kumar
Fred Morstatter
Alexandra Graddy-Reed
Andrea Belz
172
3
0
08 Jul 2024
A Survey on LoRA of Large Language Models
A Survey on LoRA of Large Language Models
Yuren Mao
Yuhang Ge
Yijiang Fan
Wenyi Xu
Yu Mi
Zhonghao Hu
Yunjun Gao
ALM
599
91
0
08 Jul 2024
ASRRL-TTS: Agile Speaker Representation Reinforcement Learning for
  Text-to-Speech Speaker Adaptation
ASRRL-TTS: Agile Speaker Representation Reinforcement Learning for Text-to-Speech Speaker Adaptation
Ruibo Fu
Xin Qi
Zhengqi Wen
Jianhua Tao
Tao Wang
...
Xiaopeng Wang
Shuchen Shi
Yukun Liu
Zhengqi Wen
Shuai Zhang
266
2
0
07 Jul 2024
See Further for Parameter Efficient Fine-tuning by Standing on the
  Shoulders of Decomposition
See Further for Parameter Efficient Fine-tuning by Standing on the Shoulders of Decomposition
Chongjie Si
Xiaokang Yang
Wei Shen
245
12
0
07 Jul 2024
Hadamard Adapter: An Extreme Parameter-Efficient Adapter Tuning Method
  for Pre-trained Language Models
Hadamard Adapter: An Extreme Parameter-Efficient Adapter Tuning Method for Pre-trained Language Models
Yuyan Chen
Qiang Fu
Ge Fan
Lun Du
Jian-Guang Lou
Shi Han
Dongmei Zhang
Zhixu Li
Yanghua Xiao
MoE
176
22
0
04 Jul 2024
ASteISR: Adapting Single Image Super-resolution Pre-trained Model for
  Efficient Stereo Image Super-resolution
ASteISR: Adapting Single Image Super-resolution Pre-trained Model for Efficient Stereo Image Super-resolution
Yuanbo Zhou
Yuyang Xue
Wei Deng
Xinlin Zhang
Qinquan Gao
Tong Tong
269
0
0
04 Jul 2024
Modality-Specialized Synergizers for Interleaved Vision-Language Generalists
Modality-Specialized Synergizers for Interleaved Vision-Language Generalists
Zhiyang Xu
Minqian Liu
Ying Shen
Joy Rimchala
Jiaxin Zhang
Qifan Wang
Yu Cheng
Lifu Huang
VLM
240
2
0
04 Jul 2024
SAFT: Towards Out-of-Distribution Generalization in Fine-Tuning
SAFT: Towards Out-of-Distribution Generalization in Fine-Tuning
Bac Nguyen
Stefan Uhlich
Fabien Cardinaux
Lukas Mauch
Marzieh Edraki
Aaron Courville
OODDCLLVLM
377
8
0
03 Jul 2024
Increasing Model Capacity for Free: A Simple Strategy for Parameter
  Efficient Fine-tuning
Increasing Model Capacity for Free: A Simple Strategy for Parameter Efficient Fine-tuning
Haobo Song
Hao Zhao
Soumajit Majumder
Tao Lin
182
7
0
01 Jul 2024
CPT: Consistent Proxy Tuning for Black-box Optimization
CPT: Consistent Proxy Tuning for Black-box Optimization
Yuanyang He
Zitong Huang
Xinxing Xu
Rick Siow Mong Goh
Salman Khan
W. Zuo
Yong Liu
Chun-Mei Feng
243
1
0
01 Jul 2024
M2QA: Multi-domain Multilingual Question Answering
M2QA: Multi-domain Multilingual Question Answering
Leon Arne Engländer
Hannah Sterz
Clifton A. Poth
Jonas Pfeiffer
Ilia Kuznetsov
Iryna Gurevych
VLM
253
5
0
01 Jul 2024
Expressivity of Neural Networks with Random Weights and Learned Biases
Expressivity of Neural Networks with Random Weights and Learned Biases
Ezekiel Williams
Avery Hee-Woon Ryoo
Thomas Jiralerspong
Alexandre Payeur
M. Perich
Luca Mazzucato
Guillaume Lajoie
383
6
0
01 Jul 2024
AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for
  Memory-Efficient Large Language Models Fine-Tuning
AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning
Yifan Yang
Kai Zhen
Ershad Banijamal
Athanasios Mouchtaris
Zheng Zhang
135
20
0
26 Jun 2024
Structured Unrestricted-Rank Matrices for Parameter Efficient
  Fine-tuning
Structured Unrestricted-Rank Matrices for Parameter Efficient Fine-tuning
Arijit Sehanobish
Avinava Dubey
Krzysztof Choromanski
Somnath Basu Roy Chowdhury
Deepali Jain
Vikas Sindhwani
Snigdha Chaturvedi
ALM
274
7
0
25 Jun 2024
D2LLM: Decomposed and Distilled Large Language Models for Semantic
  Search
D2LLM: Decomposed and Distilled Large Language Models for Semantic Search
Zihan Liao
Hang Yu
Jianguo Li
Jun Wang
Wei Zhang
192
14
0
25 Jun 2024
Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing
  Backpropagation
Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation
Yuchen Yang
Yingdong Shi
Cheems Wang
Xiantong Zhen
Yuxuan Shi
Jun Xu
236
3
0
24 Jun 2024
Enhancing Large Language Model Performance with Gradient-Based Parameter Selection
Enhancing Large Language Model Performance with Gradient-Based Parameter Selection
Haoling Li
Xin Zhang
Xiao Liu
Yeyun Gong
Yifan Wang
Qi Chen
Qi Chen
49
0
0
21 Jun 2024
xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned
  MT Evaluation Metrics
xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics
Daniil Larionov
Mikhail Seleznyov
Vasiliy Viskov
Sergey Petrakov
Steffen Eger
138
9
0
20 Jun 2024
Computation-Efficient Semi-Supervised Learning for ECG-based
  Cardiovascular Diseases Detection
Computation-Efficient Semi-Supervised Learning for ECG-based Cardiovascular Diseases Detection
Rushuang Zhou
Zijun Liu
Lei A. Clifton
David Clifton
Kannie W. Y. Chan
Yuan-Ting Zhang
Yining Dong
233
2
0
20 Jun 2024
Towards Minimal Targeted Updates of Language Models with Targeted
  Negative Training
Towards Minimal Targeted Updates of Language Models with Targeted Negative Training
Lily H. Zhang
Rajesh Ranganath
Arya Tafvizi
328
1
0
19 Jun 2024
Bayesian-LoRA: LoRA based Parameter Efficient Fine-Tuning using Optimal
  Quantization levels and Rank Values trough Differentiable Bayesian Gates
Bayesian-LoRA: LoRA based Parameter Efficient Fine-Tuning using Optimal Quantization levels and Rank Values trough Differentiable Bayesian Gates
Cristian Meo
Ksenia Sycheva
Anirudh Goyal
Justin Dauwels
MQ
252
9
0
18 Jun 2024
Synergizing Foundation Models and Federated Learning: A Survey
Synergizing Foundation Models and Federated Learning: A Survey
Shenghui Li
Fanghua Ye
Meng Fang
Jiaxu Zhao
Yun-Hin Chan
Edith C. -H. Ngai
Thiemo Voigt
AI4CE
263
9
0
18 Jun 2024
Mitigate Negative Transfer with Similarity Heuristic Lifelong Prompt
  Tuning
Mitigate Negative Transfer with Similarity Heuristic Lifelong Prompt Tuning
Chenyuan Wu
Gangwei Jiang
Defu Lian
CLL
193
1
0
18 Jun 2024
On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion
On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion
Chenghao Fan
Zhenyi Lu
Wei Wei
Jie Tian
Xiaoye Qu
Dangyang Chen
Yu Cheng
MoMe
327
10
0
17 Jun 2024
Promoting Data and Model Privacy in Federated Learning through Quantized
  LoRA
Promoting Data and Model Privacy in Federated Learning through Quantized LoRA
Jianhao Zhu
Changze Lv
Xiaohua Wang
Muling Wu
Tianlong Li
Changze Lv
Zixuan Ling
Cenyuan Zhang
Xiaoqing Zheng
Xuanjing Huang
278
10
0
16 Jun 2024
Mixture-of-Subspaces in Low-Rank Adaptation
Mixture-of-Subspaces in Low-Rank Adaptation
Taiqiang Wu
Jiahao Wang
Zhe Zhao
Ngai Wong
534
41
0
16 Jun 2024
ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation
ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation
Yurun Song
Junchen Zhao
Ian G. Harris
Sangeetha Abdu Jyothi
307
6
0
16 Jun 2024
Reflecting on the State of Rehearsal-free Continual Learning with Pretrained Models
Reflecting on the State of Rehearsal-free Continual Learning with Pretrained Models
Lukas Thede
Karsten Roth
Olivier J. Hénaff
Matthias Bethge
Zeynep Akata
CLL
330
6
0
13 Jun 2024
Adapters Strike Back
Adapters Strike Back
Jan-Martin O. Steitz
Stefan Roth
226
14
0
10 Jun 2024
A Parameter-efficient Language Extension Framework for Multilingual ASR
A Parameter-efficient Language Extension Framework for Multilingual ASR
Wei Liu
Jingyong Hou
Dong Yang
Muyong Cao
Tan Lee
CLL
222
5
0
10 Jun 2024
Diving into Underwater: Segment Anything Model Guided Underwater Salient
  Instance Segmentation and A Large-scale Dataset
Diving into Underwater: Segment Anything Model Guided Underwater Salient Instance Segmentation and A Large-scale DatasetInternational Conference on Machine Learning (ICML), 2024
Shijie Lian
Ziyi Zhang
Hua Li
Wenjie Li
Laurence Tianruo Yang
Sam Kwong
Runmin Cong
VLM
286
33
0
10 Jun 2024
Multi-Prompting Decoder Helps Better Language Understanding
Multi-Prompting Decoder Helps Better Language UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL), 2024
Zifeng Cheng
Zhaoling Chen
Zhiwei Jiang
Yafeng Yin
Shiping Ge
Shiwei Gan
Qing Gu
AI4CE
236
2
0
10 Jun 2024
Federated LoRA with Sparse Communication
Federated LoRA with Sparse Communication
Kevin Kuo
Arian Raje
Kousik Rajesh
Virginia Smith
409
22
0
07 Jun 2024
Repurposing Language Models into Embedding Models: Finding the
  Compute-Optimal Recipe
Repurposing Language Models into Embedding Models: Finding the Compute-Optimal RecipeNeural Information Processing Systems (NeurIPS), 2024
Alicja Ziarko
Albert Q. Jiang
Bartosz Piotrowski
Wenda Li
M. Jamnik
Piotr Miłoś
189
3
0
06 Jun 2024
Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for
  Vision
Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Vision
Minglei Li
Peng Ye
Yongqi Huang
Lin Zhang
Tao Chen
Tong He
Jiayuan Fan
Wanli Ouyang
MoE
340
12
0
05 Jun 2024
LoFiT: Localized Fine-tuning on LLM Representations
LoFiT: Localized Fine-tuning on LLM Representations
Fangcong Yin
Xi Ye
Greg Durrett
257
39
0
03 Jun 2024
LOLA: LLM-Assisted Online Learning Algorithm for Content Experiments
LOLA: LLM-Assisted Online Learning Algorithm for Content Experiments
Zikun Ye
Hema Yoganarasimhan
Yufeng Zheng
169
16
0
03 Jun 2024
Diffusion Tuning: Transferring Diffusion Models via Chain of Forgetting
Diffusion Tuning: Transferring Diffusion Models via Chain of Forgetting
Jincheng Zhong
Xingzhuo Guo
Jiaxiang Dong
Mingsheng Long
DiffM
274
9
0
02 Jun 2024
LIDAO: Towards Limited Interventions for Debiasing (Large) Language
  Models
LIDAO: Towards Limited Interventions for Debiasing (Large) Language Models
Tianci Liu
Haoyu Wang
Shiyang Wang
Yu Cheng
Jing Gao
ALM
225
1
0
01 Jun 2024
A Survey on Large Language Models for Code Generation
A Survey on Large Language Models for Code Generation
Juyong Jiang
Fan Wang
Jiasi Shen
Sungju Kim
Sunghun Kim
522
511
0
01 Jun 2024
Multi-Label Guided Soft Contrastive Learning for Efficient Earth
  Observation Pretraining
Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining
Yi Wang
C. Albrecht
Xiao Xiang Zhu
287
16
0
30 May 2024
RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter
RAP: Efficient Text-Video Retrieval with Sparse-and-Correlated Adapter
Meng Cao
Haoran Tang
Jinfa Huang
Peng Jin
Can Zhang
Ruyang Liu
Long Chen
Xiaodan Liang
Li-ming Yuan
Ge Li
302
19
0
29 May 2024
MLAE: Masked LoRA Experts for Parameter-Efficient Fine-Tuning
MLAE: Masked LoRA Experts for Parameter-Efficient Fine-Tuning
Junjie Wang
Guangjing Yang
Wentao Chen
Huahui Yi
Xiaohu Wu
Qicheng Lao
MoEALM
267
0
0
29 May 2024
Previous
123...789...181920
Next