v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 965 papers shown

Title
Unsupervised Parameter Efficient Source-free Post-pretraining Abhishek Jha Tinne Tuytelaars Yuki M. Asano OOD 232 0 0 28 Feb 2025
MobiLLM: Enabling LLM Fine-Tuning on the Mobile Device via Server Assisted Side Tuning Liang Li Xingke Yang Wen Wu Hao Wang Tomoaki Ohtsuki Xin Fu Miao Pan Xuemin Shen 153 7 0 27 Feb 2025
HaLoRA: Hardware-aware Low-Rank Adaptation for Large Language Models Based on Hybrid Compute-in-Memory Architecture Taiqiang Wu Chenchen Ding Wenyong Zhou Yuxin Cheng Xincheng Feng Shuqi Wang Chufan Shi Ziyue Liu Ngai Wong 271 0 0 27 Feb 2025
CLLoRA: An Approach to Measure the Effects of the Context Length for LLM Fine-Tuning Ping Zhang Zhaorui Zhang Sheng Di Yao Xin Benben Liu 210 3 0 26 Feb 2025
DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language ModelsAAAI Conference on Artificial Intelligence (AAAI), 2024 Yanming Liu Xinyue Peng Yuwei Zhang Xiaolan Ke Songhang Deng ... Sheng Cheng Xun Wang Yuxiang Cai Xuhong Zhang Xuhong Zhang 533 0 0 21 Feb 2025
LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits Zikai Zhou Qizheng Zhang Hermann Kumbong Kunle Olukotun MQ 1.1K 2 0 12 Feb 2025
The impact of allocation strategies in subset learning on the expressive power of neural networksInternational Conference on Learning Representations (ICLR), 2025 Ofir Schlisselberg Ran Darshan 269 0 0 10 Feb 2025
KARST: Multi-Kernel Kronecker Adaptation with Re-Scaling Transmission for Visual ClassificationIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025 Yue Zhu Haiwen Diao Shang Gao Long Chen Huchuan Lu 444 1 0 10 Feb 2025
DiTASK: Multi-Task Fine-Tuning with Diffeomorphic TransformationsComputer Vision and Pattern Recognition (CVPR), 2025 Krishna Sri Ipsit Mantri Carola-Bibiane Schönlieb Bruno Ribeiro Chaim Baskin Moshe Eliasof 391 5 0 09 Feb 2025
Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training Reza Shirkavand Qi He Qi He Heng-Chiao Huang ALM 491 1 0 05 Feb 2025
LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-TuningInternational Conference on Learning Representations (ICLR), 2025 Zhekai Du Yinjie Min Jingjing Li Ke Lu Changliang Zou Liuhua Peng Tingjin Chu Mingming Gong 852 3 0 05 Feb 2025
PARA: Parameter-Efficient Fine-tuning with Prompt Aware Representation AdjustmentConference on Empirical Methods in Natural Language Processing (EMNLP), 2025 Zequan Liu Yi Zhao Ming Tan Wei Zhu Aaron Xuxiang Tian 355 3 0 03 Feb 2025
Robust Federated Finetuning of LLMs via Alternating Optimization of LoRA Shuangyi Chen Yuanxin Guo Yue Ju Harik Dalal Zhongwen Zhu Ashish Khisti 321 4 0 03 Feb 2025
Memory-Efficient Fine-Tuning of Transformers via Token SelectionConference on Empirical Methods in Natural Language Processing (EMNLP), 2025 Antoine Simoulin Namyong Park Xiaoyi Liu Grey Yang 380 6 0 31 Jan 2025
Compact Neural TTS Voices for AccessibilityIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2025 Kunal Jain Eoin Murphy Deepanshu Gupta Jonathan Dyke Saumya Shah Vasilieios Tsiaras Petko Petkov Alistair Conkie 219 2 0 28 Jan 2025
BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language ModelsNeural Information Processing Systems (NeurIPS), 2024 Yibin Wang Haizhou Shi Ligong Han Dimitris N. Metaxas Hao Wang BDL UQLM 674 20 0 28 Jan 2025
Rethinking the Bias of Foundation Model under Long-tailed Distribution Jiahao Chen Bin Qin Jiangmeng Li Hao Chen Fuchun Sun 318 1 0 27 Jan 2025
Decentralized Low-Rank Fine-Tuning of Large Language Models Sajjad Ghiasvand Mahnoosh Alizadeh Ramtin Pedarsani ALM 598 9 0 26 Jan 2025
Parameter-Efficient Fine-Tuning for Foundation Models Dan Zhang Tao Feng Lilong Xue Yuandong Wang Yuxiao Dong J. Tang 489 31 0 23 Jan 2025
A Resource-Efficient Training Framework for Remote Sensing Text--Image Retrieval Weihang Zhang Jihao Li Shuoke Li Ziqing Niu Jialiang Chen Wenkai Zhang VLM 160 1 0 18 Jan 2025
Atleus: Accelerating Transformers on the Edge Enabled by 3D Heterogeneous Manycore ArchitecturesIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD), 2025 Pratyush Dhingra J. Doppa P. Pande 122 6 0 17 Jan 2025
Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learning Hanwen Zhong Jiaxin Chen Yutong Zhang Di Huang Yunhong Wang MoE 266 0 0 12 Jan 2025
A Hessian-informed hyperparameter optimization for differential learning rate Shiyun Xu Zhiqi Bu Yiliang Zhang Ian Barnett 314 1 0 12 Jan 2025
CM3T: Framework for Efficient Multimodal Learning for Inhomogeneous Interaction DatasetsIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2025 Tanay Agrawal Mohammed Guermal Michal Balazia François Brémond 185 0 0 08 Jan 2025
LLM4CVE: Enabling Iterative Automated Vulnerability Repair with Large Language Models Mohamad Fakih Rahul Dharmaji Halima Bouzidi Gustavo Quiros Araya O. Ogundare Mohammad Abdullah Al Faruque ELM 133 6 0 08 Jan 2025
GraphLoRA: Structure-Aware Contrastive Low-Rank Adaptation for Cross-Graph Transfer LearningKnowledge Discovery and Data Mining (KDD), 2024 Zhe-Rui Yang Jindong Han Chang-Dong Wang Hao Liu OffRL 319 6 0 08 Jan 2025
GaLore $+$ : Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection Xutao Liao Shaohui Li Yuhui Xu Zhi Li Zichen Liu You He VLM 247 7 0 31 Dec 2024
IV-tuning: Parameter-Efficient Transfer Learning for Infrared-Visible Tasks Yaming Zhang Chenqiang Gao Fangcen Liu Junjie Guo Lan Wang Xinggan Peng Deyu Meng 451 0 0 21 Dec 2024
Privacy in Fine-tuning Large Language Models: Attacks, Defenses, and Future DirectionsPacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2024 Hao Du Shang Liu Lele Zheng Yang Cao Atsuyoshi Nakamura Lei Chen AAML 418 12 0 21 Dec 2024
In-Context Learning Distillation for Efficient Few-Shot Fine-Tuning Yifei Duan Liu Li Zirui Zhai Jinxia Yao 225 2 0 17 Dec 2024
Enhance Vision-Language Alignment with NoiseAAAI Conference on Artificial Intelligence (AAAI), 2024 Sida Huang Hongyuan Zhang Xuelong Li VLM 345 72 0 14 Dec 2024
Selective Visual Prompting in Vision MambaAAAI Conference on Artificial Intelligence (AAAI), 2024 Yifeng Yao Zichen Liu Zhenyu Cui Yuxin Peng Jiahuan Zhou VLM Mamba 376 7 0 12 Dec 2024
PETALface: Parameter Efficient Transfer Learning for Low-resolution Face RecognitionIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024 Kartik Narayan Nithin Gopalakrishnan Nair Jennifer Xu Rama Chellappa Vishal M. Patel CVBM CLL 199 5 0 10 Dec 2024
KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language ModelsInternational Conference on Learning Representations (ICLR), 2024 Fan Wang Juyong Jiang Chansung Park Sunghun Kim Jing Tang 430 5 0 08 Dec 2024
Mixture of Physical Priors Adapter for Parameter-Efficient Fine-Tuning Xiping Hu C. J. Li QiXiang Ye Tong Zhang MoE 226 1 0 03 Dec 2024
Sustainable Self-evolution Adversarial TrainingACM Multimedia (MM), 2024 Wenxuan Wang Chenglei Wang Huihui Qi Menghao Ye Xuelin Qian Peng Wang Yanning Zhang AAML 381 0 0 03 Dec 2024
Unified Parameter-Efficient Unlearning for LLMsInternational Conference on Learning Representations (ICLR), 2024 Chenlu Ding Jiancan Wu Yancheng Yuan Jinda Lu Kai Zhang Alex Su Xiang Wang Xiangnan He MU KELM 431 12 0 30 Nov 2024
Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation S. Ly Hien Nguyen 299 4 0 28 Nov 2024
DESIRE: Dynamic Knowledge Consolidation for Rehearsal-Free Continual Learning Haiyang Guo Fei Zhu Fanhu Zeng Bing Liu Xu-Yao Zhang MoMe CLL 287 5 0 28 Nov 2024
How to Learn a New Language? An Efficient Solution for Self-Supervised Learning Models Unseen Languages Adaption in Low-Resource Scenario Shih-Heng Wang Zih-Ching Chen Jiatong Shi Ming-To Chuang Guan-Ting Lin Kuan Po Huang David Harwath Shang-Wen Li Hung-yi Lee 283 3 0 27 Nov 2024
Parameter Efficient Mamba Tuning via Projector-targeted Diagonal-centric Linear TransformationComputer Vision and Pattern Recognition (CVPR), 2024 Seokil Ham H. Kim Sangmin Woo Changick Kim Mamba 997 2 0 21 Nov 2024
Artificial Intelligence for Biomedical Video Generation Linyuan Li Jianing Qiu Anujit Saha Lin Li Poyuan Li Mengxian He Ziyu Guo Wu Yuan VGen 342 3 0 12 Nov 2024
FRUGAL: Memory-Efficient Optimization by Reducing State Overhead for Scalable Training Philip Zmushko Aleksandr Beznosikov Martin Takáč Samuel Horváth 266 3 0 12 Nov 2024
PSELDNets: Pre-trained Neural Networks on a Large-scale Synthetic Dataset for Sound Event Localization and DetectionIEEE Transactions on Audio, Speech, and Language Processing (TASLP), 2024 Jinbo Hu Yin Cao Ming Wu Fang Kang Feiran Yang Wenwu Wang Mark D. Plumbley J. Yang 293 5 0 10 Nov 2024
Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptation Ayan Sengupta Vaibhav Seth Arinjay Pathak Aastha Verma Natraj Raman Sriram Gopalakrishnan Niladri Chatterjee Tanmoy Chakraborty BDL 385 3 0 07 Nov 2024
MambaPEFT: Exploring Parameter-Efficient Fine-Tuning for MambaInternational Conference on Learning Representations (ICLR), 2024 Masakazu Yoshimura Teruaki Hayashi Yota Maeda Mamba 534 8 0 06 Nov 2024
Efficient and Effective Adaptation of Multimodal Foundation Models in Sequential Recommendation Junchen Fu Xuri Ge Xin Xin Alexandros Karatzoglou Ioannis Arapakis Kaiwen Zheng Yongxin Ni J. Jose 218 5 0 05 Nov 2024
Scalable Efficient Training of Large Language Models with Low-dimensional Projected AttentionConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Xingtai Lv Ning Ding Kaiyan Zhang Ermo Hua Ganqu Cui Bowen Zhou 176 6 0 04 Nov 2024
Expanding Sparse Tuning for Low Memory UsageNeural Information Processing Systems (NeurIPS), 2024 Shufan Shen Junshu Sun Xiangyang Ji Qingming Huang Shuhui Wang 289 9 0 04 Nov 2024
Parameter-Efficient Fine-Tuning of Large Language Models for Unit Test Generation: An Empirical Study André Storhaug Jingyue Li ALM 278 7 0 04 Nov 2024