v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 959 papers shown

Title
Tuning the Right Foundation Models is What you Need for Partial Label Learning Kuang He Wei Tang Tong Wei Min Zhang VLM 226 1 0 05 Jun 2025
Backbone Augmented Training for Adaptations Jae Wan Park Junhyeok Kim Youngjun Jun Hyunah Ko Seong Jae Hwang 135 0 0 04 Jun 2025
Leveraging Coordinate Momentum in SignSGD and Muon: Memory-Optimized Zero-Order Egor Petrov Grigoriy Evseev Aleksey Antonov Andrey Veprikov Nikolay Bushkov Nikolay Bushkov Stanislav Moiseev 373 2 0 04 Jun 2025
FORLA: Federated Object-centric Representation Learning with Slot Attention Guiqiu Liao M. Jogan Eric Eaton Daniel A. Hashimoto FedML 197 1 0 03 Jun 2025
Schema as Parameterized Tools for Universal Information Extraction Sheng Liang Yongyue Zhang Yaxiong Wu Ruiming Tang Yong Liu 176 0 0 02 Jun 2025
PFMBench: Protein Foundation Model Benchmark Zhangyang Gao Hao Wang Cheng Tan Chenrui Xu Mengdi Liu Bozhen Hu Linlin Chao Xiaoming Zhang Stan Z. Li 190 1 0 01 Jun 2025
Assortment of Attention Heads: Accelerating Federated PEFT with Head Pruning and Strategic Client Selection Yeshwanth Venkatesha Souvik Kundu Priyadarshini Panda 118 1 0 31 May 2025
On Fairness of Task Arithmetic: The Role of Task Vectors Hiroki Naganuma Kotaro Yoshida Laura Gomezjurado Gonzalez Takafumi Horie Yuji Naraki Ryotaro Shimizu MoMe 160 2 0 30 May 2025
SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA Minrui Luo Fuhang Kuang Yu Wang Zirui Liu Tianxing He CLL 193 0 0 29 May 2025
Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics Shiwei Li Xiandi Luo Xing Tang Haozhao Wang Hao Chen Weihong Luo Yuhua Li Xiuqiang He Ruixuan Li AI4CE 165 7 0 29 May 2025
On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentation Liyao Tang Zhe Chen Dacheng Tao 3DPC 254 0 0 28 May 2025
MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task LearningAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Dacao Zhang Kun Zhang Shimao Chu Le Wu Xin Li Si Wei MoE ALM OffRL 137 3 0 28 May 2025
Continual Learning Beyond Experience Rehearsal and Full Model Surrogates Prashant Shivaram Bhat Laurens Niesten Elahe Arani Bahram Zonooz CLL 137 0 0 28 May 2025
InfoSAM: Fine-Tuning the Segment Anything Model from An Information-Theoretic Perspective Yuanhong Zhang Muyao Yuan Weizhan Zhang Tieliang Gong Wen Wen Jiangyong Ying Weijie Shi VLM 209 0 0 28 May 2025
Look Within or Look Beyond? A Theoretical Comparison Between Parameter-Efficient and Full Fine-Tuning Yongkang Liu Xingle Xu Ercong Nie Zijing Wang Shi Feng Daling Wang Qian Li Hinrich Schutze 178 0 0 28 May 2025
Improved Representation Steering for Language Models Zhengxuan Wu Qinan Yu Aryaman Arora Christopher D. Manning Christopher Potts LLMSV 179 2 0 27 May 2025
PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba AdapterComputer Vision and Pattern Recognition (CVPR), 2025 Yaohua Zha Yanzi Wang Hang Guo Jinpeng Wang Tao Dai Bin Chen Zhihao Ouyang Xue Yuerong Ke Chen Shu-Tao Xia 241 2 0 27 May 2025
Cuff-KT: Tackling Learners' Real-time Learning Pattern Adjustment via Tuning-Free Knowledge State Guided Model Updating Yiyun Zhou Zheqi Lv Shengyu Zhang Jingyuan Chen OffRL KELM 335 6 0 26 May 2025
Time Series Generation Under Data Scarcity: A Unified Generative Modeling Approach Tal Gonen Itai Pemper Ilan Naiman Nimrod Berman Omri Azencot DiffM 193 5 0 26 May 2025
Concept Reachability in Diffusion Models: Beyond Dataset Constraints Marta Aparicio Rodriguez Xenia Miscouridou Anastasia Borovykh 201 0 0 25 May 2025
HD-PiSSA: High-Rank Distributed Orthogonal Adaptation Yiding Wang Fauxu meng Xuefeng Zhang Fan Jiang Pingzhi Tang Muhan Zhang 210 0 0 24 May 2025
Steering LLM Reasoning Through Bias-Only Adaptation Viacheslav Sinii Alexey Gorbatovski Artem Cherepanov Boris Shaposhnikov Nikita Balagansky Daniil Gavrilov LLMSV LRM 204 2 0 24 May 2025
CoMoE: Contrastive Representation for Mixture-of-Experts in Parameter-Efficient Fine-tuning Jinyuan Feng Chaopeng Wei Tenghai Qiu Tianyi Hu Zhiqiang Pu MoE 275 0 0 23 May 2025
Parameter-Efficient Fine-Tuning of Multispectral Foundation Models for Hyperspectral Image Classification Bernardin Ligan Khalide Jbilou Fahd Kalloubi Ahmed Ratnani 287 1 0 21 May 2025
DeFTX: Denoised Sparse Fine-Tuning for Zero-Shot Cross-Lingual Transfer Sona Elza Simon Preethi Jyothi VLM 257 1 0 21 May 2025
Dual Decomposition of Weights and Singular Value Low Rank Adaptation Jialong Han Si Zhang Ke Zhang 163 0 0 20 May 2025
Enhancing Learned Knowledge in LoRA Adapters Through Efficient Contrastive Decoding on Ascend NPUs Morgan Lindsay Heisler Linzi Xing Ge Shi Hanieh Sadri Gursimran Singh Weiwei Zhang Tao Ye Ying Xiong Yong Zhang Zhenan Fan 144 1 0 20 May 2025
Shadow-FT: Tuning Instruct Model via Training on Paired Base Model Taiqiang Wu Runming Yang Jiayi Li Pengfei Hu Ngai Wong Ngai Wong Yujiu Yang 611 0 0 19 May 2025
SRLoRA: Subspace Recomposition in Low-Rank Adaptation via Importance-Based Fusion and Reinitialization Haodong Yang Lei Wang Md Zakir Hossain 240 0 0 18 May 2025
Dynamic Perturbed Adaptive Method for Infinite Task-Conflicting Time Series Jiang You Xiaozhen Wang Arben Cela AI4TS 137 0 0 17 May 2025
LoRASuite: Efficient LoRA Adaptation Across Large Language Model Upgrades Yanan Li Fanxu Meng Muhan Zhang Shiai Zhu Shangguang Wang Mengwei Xu MoMe 182 2 0 17 May 2025
Efficient Orthogonal Fine-Tuning with Principal Subspace Adaptation Fei Wu Jia Hu Geyong Min Shiqiang Wang 269 0 0 16 May 2025
Parallel Scaling Law for Language Models Mouxiang Chen Binyuan Hui Zeyu Cui Jiaxi Yang Dayiheng Liu Jianling Sun Junyang Lin Zhongxin Liu MoE LRM 285 20 0 15 May 2025
RepCali: High Efficient Fine-tuning Via Representation Calibration in Latent Space for Pre-trained Language ModelsData Intelligence (DI), 2025 Fujun Zhang Xiaoying Fan Xiangdong Su Guanglai Gao 245 1 0 13 May 2025
Enhancing Monocular Height Estimation via Sparse LiDAR-Guided Correction Jian Song Hongruixuan Chen Xiangwei Zhu 293 0 0 11 May 2025
ULFine: Unbiased Lightweight Fine-tuning for Foundation-Model-Assisted Long-Tailed Semi-Supervised Learning Enhao Zhang Chaohua Li Chuanxing Geng Songcan Chen 367 0 0 08 May 2025
GAPrompt: Geometry-Aware Point Cloud Prompt for 3D Vision Model Zixiang Ai Zichen Liu Yuanhang Lei Zhenyu Cui Xu Zou Jiahuan Zhou 347 5 0 07 May 2025
Token Coordinated Prompt Attention is Needed for Visual Prompting Zichen Liu Xu Zou Gang Hua Jiahuan Zhou 481 3 0 05 May 2025
Adapting In-Domain Few-Shot Segmentation to New Domains without Retraining Qi Fan Kaiqi Liu Nian Liu Hisham Cholakkal Rao Muhammad Anwer Wenbin Li Yang Gao 432 0 0 30 Apr 2025
A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning Jieming Bian Yuanzhe Peng Lei Wang Yin Huang Jie Xu FedML 306 8 0 29 Apr 2025
Can Differentially Private Fine-tuning LLMs Protect Against Privacy Attacks?Database Security (DBSec), 2025 Hao Du Shang Liu Yang Cao AAML 401 0 0 28 Apr 2025
BARIS: Boundary-Aware Refinement with Environmental Degradation Priors for Robust Underwater Instance Segmentation Pin-Chi Pan Soo-Chang Pei 226 0 0 28 Apr 2025
Fine-tune Smarter, Not Harder: Parameter-Efficient Fine-Tuning for Geospatial Foundation Models Francesc Marti Escofet Benedikt Blumenstiel L. Scheibenreif P. Fraccaro Konrad Schindler 282 4 0 24 Apr 2025
PointLoRA: Low-Rank Adaptation with Token Selection for Point Cloud LearningComputer Vision and Pattern Recognition (CVPR), 2025 Song Wang Xiaolu Liu Lingdong Kong Jianyun Xu Chunyong Hu Gongfan Fang Wentong Li Jianke Zhu Xinchao Wang 382 3 0 22 Apr 2025
HyperFlow: Gradient-Free Emulation of Few-Shot Fine-Tuning Donggyun Kim Chanwoo Kim Seunghoon Hong 136 0 0 21 Apr 2025
Histogram-based Parameter-efficient Tuning for Passive Sonar Classification Amirmohammad Mohammadi Davelle Carreiro A. V. Dine Joshua Peeples 238 0 0 21 Apr 2025
Efficient Knowledge Transfer in Multi-Task Learning through Task-Adaptive Low-Rank Representation Xiao Zhang Kangsheng Wang Tianyu Hu Huimin Ma 257 3 0 20 Apr 2025
Parameter-Efficient Continual Fine-Tuning: A Survey Eric Nuertey Coleman Luigi Quarantiello Ziyue Liu Qinwen Yang Samrat Mukherjee J. Hurtado Vincenzo Lomonaco CLL 303 5 0 18 Apr 2025
LIFT+: Lightweight Fine-Tuning for Long-Tail Learning Jiang-Xin Shi Tong Wei Yu-Feng Li 139 2 0 17 Apr 2025
Sparsity Outperforms Low-Rank Projections in Few-Shot Adaptation Nairouz Mrabah Nicolas Richet Ismail Ben Ayed Eric Granger BDL VLM 313 0 0 16 Apr 2025