v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 965 papers shown

Title
Parameter-efficient Prompt Learning for 3D Point Cloud Understanding Hongyu Sun Yongcai Wang Wang Chen Haoran Deng Deying Li VPVLM 231 10 0 24 Feb 2024
Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning Yong Liu Zirui Zhu Chaoyu Gong Minhao Cheng Cho-Jui Hsieh Yang You MoE 202 33 0 24 Feb 2024
Advancing Parameter Efficiency in Fine-tuning via Representation Editing Muling Wu Tianlong Li Xiaohua Wang Changze Lv Changze Lv Zixuan Ling Jianhao Zhu Cenyuan Zhang Xiaoqing Zheng Xuanjing Huang 374 31 0 23 Feb 2024
PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning Zhisheng Lin Han Fu Chenghao Liu Zhuo Li Jianling Sun MoE MoMe 222 6 0 23 Feb 2024
Q-Probe: A Lightweight Approach to Reward Maximization for Language Models Kenneth Li Samy Jelassi Hugh Zhang Sham Kakade Martin Wattenberg David Brandfonbrener 231 15 0 22 Feb 2024
Towards Unified Task Embeddings Across Multiple Models: Bridging the Gap for Prompt-Based Large Language Models and Beyond Xinyu Wang Hainiu Xu Lin Gui Yulan He MoMe AIFin 274 2 0 22 Feb 2024
CST: Calibration Side-Tuning for Parameter and Memory Efficient Transfer Learning Feng Chen 108 1 0 20 Feb 2024
SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning Zhihao Wen Jie Zhang Yuan Fang MoE 151 3 0 19 Feb 2024
Parameter Efficient Finetuning for Speech Emotion Recognition and Domain Adaptation Nineli Lashkarashvili Wen Wu Guangzhi Sun P. Woodland 122 10 0 19 Feb 2024
Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmetic Rishabh Bhardwaj Do Duc Anh Soujanya Poria MoMe 190 71 0 19 Feb 2024
GNNavi: Navigating the Information Flow in Large Language Models by Graph Neural Network Shuzhou Yuan Ercong Nie Michael Farber Helmut Schmid Hinrich Schütze 194 4 0 18 Feb 2024
LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models Yifan Yang Jiajun Zhou Ngai Wong Zheng Zhang 157 16 0 18 Feb 2024
Prompt-Based Bias Calibration for Better Zero/Few-Shot Learning of Language Models Kang He Yinghan Long Kaushik Roy 274 8 0 15 Feb 2024
Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence Weixiang Zhao Zhuojun Li Shilong Wang Yang Wang Yulin Hu Yanyan Zhao Chen Wei Bing Qin 468 13 0 15 Feb 2024
Model Compression and Efficient Inference for Large Language Models: A Survey Wenxiao Wang Wei Chen Yicong Luo Yongliu Long Zhengkai Lin Liye Zhang Binbin Lin Deng Cai Xiaofei He MQ 264 85 0 15 Feb 2024
Quantified Task Misalignment to Inform PEFT: An Exploration of Domain Generalization and Catastrophic Forgetting in CLIP Laura Niss Kevin Vogt-Lowell Theodoros Tsiligkaridis CLL 195 1 0 14 Feb 2024
Bayesian Multi-Task Transfer Learning for Soft Prompt Tuning Haeju Lee Minchan Jeong SeYoung Yun Kee-Eung Kim AAML VPVLM 195 4 0 13 Feb 2024
Let Your Graph Do the Talking: Encoding Structured Data for LLMs Bryan Perozzi Bahare Fatemi Dustin Zelle Anton Tsitsulin Mehran Kazemi Rami Al-Rfou Jonathan J. Halcrow GNN 206 98 0 08 Feb 2024
ConvLoRA and AdaBN based Domain Adaptation via Self-Training Sidra Aleem J. Dietlmeier Eric Arazo Suzanne Little 98 17 0 07 Feb 2024
Low-rank Attention Side-Tuning for Parameter-Efficient Fine-Tuning Ningyuan Tang Minghao Fu Ke Zhu Jianxin Wu 216 12 0 06 Feb 2024
Flora: Low-Rank Adapters Are Secretly Gradient CompressorsInternational Conference on Machine Learning (ICML), 2024 Yongchang Hao Yanshuai Cao Lili Mou 241 84 0 05 Feb 2024
Time-, Memory- and Parameter-Efficient Visual AdaptationComputer Vision and Pattern Recognition (CVPR), 2024 Otniel-Bogdan Mercea Alexey Gritsenko Cordelia Schmid Anurag Arnab VLM 178 22 0 05 Feb 2024
Revisiting the Power of Prompt for Visual Tuning Yuzhu Wang Lechao Cheng Chaowei Fang Dingwen Zhang Manni Duan Meng Wang VLM 328 26 0 04 Feb 2024
Advancing Graph Representation Learning with Large Language Models: A Comprehensive Survey of Techniques Qiheng Mao Zemin Liu Chenghao Liu Zhuo Li Jianling Sun 157 16 0 04 Feb 2024
Learning Semantic Proxies from Visual Prompts for Parameter-Efficient Fine-Tuning in Deep Metric Learning Li Ren Chen Chen Liqiang Wang Kien Hua 249 7 0 04 Feb 2024
Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters Umberto Cappellazzo Daniele Falavigna Alessio Brutti MoE 152 6 0 01 Feb 2024
SA-MDKIF: A Scalable and Adaptable Medical Domain Knowledge Injection Framework for Large Language Models Tianhan Xu Zhe Hu LingSen Chen Bin Li LM&MA 183 1 0 01 Feb 2024
Convolution Meets LoRA: Parameter Efficient Finetuning for Segment Anything Model Zihan Zhong Zhiqiang Tang Tong He Haoyang Fang Chun Yuan 229 77 0 31 Jan 2024
EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain Wei Zhang Miaoxin Cai Tong Zhang Zhuang Yin Xuerui Mao 347 199 0 30 Jan 2024
A Comprehensive Survey of Compression Algorithms for Language Models Seungcheol Park Jaehyeon Choi Sojin Lee U. Kang MQ 247 20 0 27 Jan 2024
HiFT: A Hierarchical Full Parameter Fine-Tuning StrategyConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Yongkang Liu Yiqun Zhang Qian Li Tong Liu Shi Feng Daling Wang Yifei Zhang Hinrich Schütze 244 14 0 26 Jan 2024
The Risk of Federated Learning to Skew Fine-Tuning Features and Underperform Out-of-Distribution Robustness Mengyao Du Miao Zhang Yuwen Pu Kai Xu R. Beyah Quanjun Yin 182 1 0 25 Jan 2024
Dynamic Layer Tying for Parameter-Efficient TransformersInternational Conference on Learning Representations (ICLR), 2024 Tamir David Hay Lior Wolf 134 11 0 23 Jan 2024
SLANG: New Concept Comprehension of Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Lingrui Mei Shenghua Liu Yiwei Wang Baolong Bi Xueqi Chen KELM 246 16 0 23 Jan 2024
APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and InferenceInternational Conference on Machine Learning (ICML), 2024 Bowen Zhao Hannaneh Hajishirzi Qingqing Cao 300 26 0 22 Jan 2024
PRILoRA: Pruned and Rank-Increasing Low-Rank AdaptationFindings (Findings), 2024 Nadav Benedek Lior Wolf 139 7 0 20 Jan 2024
A Novel Benchmark for Few-Shot Semantic Segmentation in the Era of Foundation Models Reda Bensaid Vincent Gripon Franccois Leduc-Primeau Lukas Mauch G. B. Hacene Fabien Cardinaux VLM 239 10 0 20 Jan 2024
SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Weixiang Zhao Shilong Wang Yulin Hu Yanyan Zhao Bing Qin Xuanyu Zhang Qing Yang Dongliang Xu Wanxiang Che KELM CLL 297 25 0 16 Jan 2024
Editing Arbitrary Propositions in LLMs without Subject Labels Itai Feigenbaum Devansh Arpit Huan Wang Shelby Heinecke Juan Carlos Niebles Weiran Yao Caiming Xiong Silvio Savarese KELM 95 3 0 15 Jan 2024
PersianMind: A Cross-Lingual Persian-English Large Language Model Pedram Rostami Ali Salemi M. Dousti CLL LRM 111 9 0 12 Jan 2024
Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Yae Jee Cho Luyang Liu Zheng Xu Aldi Fahrezi Gauri Joshi 303 104 0 12 Jan 2024
Scaling Laws for Forgetting When Fine-Tuning Large Language Models Damjan Kalajdzievski CLL 200 21 0 11 Jan 2024
A Survey on Efficient Federated Learning Methods for Foundation Model TrainingInternational Joint Conference on Artificial Intelligence (IJCAI), 2024 Herbert Woisetschläger Alexander Isenko Shiqiang Wang R. Mayer Hans-Arno Jacobsen FedML 226 37 0 09 Jan 2024
Empirical Analysis of Efficient Fine-Tuning Methods for Large Pre-Trained Language Models Nigel Doering Cyril Gorlla Trevor Tuttle Adhvaith Vijay 71 2 0 08 Jan 2024
Data-Centric Foundation Models in Computational Healthcare: A Survey Yunkun Zhang Jin Gao Zheling Tan Lingfeng Zhou Kexin Ding Mu Zhou Shaoting Zhang Yi Xu AI4CE 253 33 0 04 Jan 2024
Astraios: Parameter-Efficient Instruction Tuning Code Large Language Models Terry Yue Zhuo A. Zebaze Nitchakarn Suppattarachai Leandro von Werra H. D. Vries Qian Liu Niklas Muennighoff ALM 256 29 0 01 Jan 2024
Differentially Private Low-Rank Adaptation of Large Language Model Using Federated LearningACM Transactions on Management Information Systems (ACM TMIS), 2023 Xiao-Yang Liu Rongyi Zhu Daochen Zha Jiechao Gao Shan Zhong Matt White Yijia Zhao 247 44 0 29 Dec 2023
A Comprehensive Evaluation of Parameter-Efficient Fine-Tuning on Software Engineering Tasks Wentao Zou Qi Li Jidong Ge Chuanyi Li Xiaoyu Shen LiGuo Huang Bin Luo 206 9 0 25 Dec 2023
A Split-and-Privatize Framework for Large Language Model Fine-Tuning Xicong Shen Yang Liu Huiqi Liu Jue Hong Bing Duan Zirui Huang Yunlong Mao Ye Wu Di Wu 143 23 0 25 Dec 2023
PERP: Rethinking the Prune-Retrain Paradigm in the Era of LLMs Max Zimmer Megi Andoni Christoph Spiegel Sebastian Pokutta VLM 433 15 0 23 Dec 2023