v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 959 papers shown

Title
Efficiency-oriented approaches for self-supervised speech representation learning Luis Lugo Valentin Vielzeuf SSL 210 1 0 18 Dec 2023
When Parameter-efficient Tuning Meets General-purpose Vision-language Models Yihang Zhai Haixin Wang Jianlong Chang Xinlong Yang Jinan Sun Shikun Zhang Qi Tian VLM MLLM 179 1 0 16 Dec 2023
SPT: Fine-Tuning Transformer-based Language Models Efficiently with Sparsification Yuntao Gui Xiao Yan Peiqi Yin Han Yang James Cheng 149 2 0 16 Dec 2023
Gradient-based Parameter Selection for Efficient Fine-TuningComputer Vision and Pattern Recognition (CVPR), 2023 Zhi Zhang Qizhe Zhang Zijun Gao Renrui Zhang Ekaterina Shutova Shiji Zhou Shanghang Zhang 293 40 0 15 Dec 2023
Context-PEFT: Efficient Multi-Modal, Multi-Task Fine-Tuning Avelina Asada Hadji-Kyriacou Ognjen Arandjelović 121 2 0 14 Dec 2023
VMT-Adapter: Parameter-Efficient Transfer Learning for Multi-Task Dense Scene UnderstandingAAAI Conference on Artificial Intelligence (AAAI), 2023 Yi Xin Junlong Du Qiang Wang Zhiwen Lin Ke Yan VPVLM 345 76 0 14 Dec 2023
MmAP : Multi-modal Alignment Prompt for Cross-domain Multi-task LearningAAAI Conference on Artificial Intelligence (AAAI), 2023 Yi Xin Junlong Du Qiang Wang Ke Yan Shouhong Ding VLM 150 83 0 14 Dec 2023
EZ-CLIP: Efficient Zeroshot Video Action Recognition Shahzad Ahmad S. Chanda Yogesh S Rawat VLM 222 11 0 13 Dec 2023
AdaptIR: Parameter Efficient Multi-task Adaptation for Pre-trained Image Restoration ModelsNeural Information Processing Systems (NeurIPS), 2023 Hang Guo Tao Dai Yuanchao Bai Bin Chen Shu-Tao Xia Zexuan Zhu 153 1 0 12 Dec 2023
READ-PVLA: Recurrent Adapter with Partial Video-Language Alignment for Parameter-Efficient Transfer Learning in Low-Resource Video-Language ModelingAAAI Conference on Artificial Intelligence (AAAI), 2023 Thong Nguyen Xiaobao Wu Xinshuai Dong Khoi M. Le Zhiyuan Hu Cong-Duy Nguyen See-Kiong Ng Anh Tuan Luu 113 2 0 12 Dec 2023
Mutual Enhancement of Large and Small Language Models with Cross-Silo Knowledge Transfer Yongheng Deng Ziqing Qiao Ju Ren Yang Liu Yaoxue Zhang 232 15 0 10 Dec 2023
Initialization Matters for Adversarial Transfer LearningComputer Vision and Pattern Recognition (CVPR), 2023 Andong Hua Jindong Gu Zhiyu Xue Nicholas Carlini Eric Wong Yao Qin AAML 207 11 0 10 Dec 2023
Batched Low-Rank Adaptation of Foundation ModelsInternational Conference on Learning Representations (ICLR), 2023 Yeming Wen Swarat Chaudhuri OffRL 254 26 0 09 Dec 2023
Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentation Zhixiang Wei Lin Chen Yi Jin Xiaoxiao Ma Tianle Liu Pengyang Lin Ben Wang Huajun Chen Jinjin Zheng 337 94 0 07 Dec 2023
MoSA: Mixture of Sparse Adapters for Visual Efficient Tuning Qizhe Zhang Bocheng Zou Ruichuan An Jiaming Liu Shanghang Zhang MoE 233 6 0 05 Dec 2023
Clustering Pseudo Language Family in Multilingual Translation Models with Fisher Information MatrixConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Xinyu Ma Xuebo Liu Min Zhang 183 1 0 05 Dec 2023
Towards General Purpose Vision Foundation Models for Medical Image Analysis: An Experimental Study of DINOv2 on Radiology Benchmarks Mohammed Baharoon Waseem Qureshi J. Ouyang Yanwu Xu Abdulrhman Aljouie Wei Peng MedIm AI4CE 223 5 0 04 Dec 2023
The Efficiency Spectrum of Large Language Models: An Algorithmic Survey Tianyu Ding Tianyi Chen Haidong Zhu Jiachen Jiang Yiqi Zhong Jinxin Zhou Guangzhi Wang Zhihui Zhu Ilya Zharkov Luming Liang 308 32 0 01 Dec 2023
Grounding Foundation Models through Federated Transfer Learning: A General FrameworkACM Transactions on Intelligent Systems and Technology (ACM TIST), 2023 Weijing Chen Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 380 26 0 29 Nov 2023
Efficient Stitchable Task AdaptationComputer Vision and Pattern Recognition (CVPR), 2023 Haoyu He Zizheng Pan Jing Liu Jianfei Cai Bohan Zhuang 276 7 0 29 Nov 2023
End-to-End Temporal Action Detection with 1B Parameters Across 1000 FramesComputer Vision and Pattern Recognition (CVPR), 2023 Shuming Liu Chen-Da Liu-Zhang Chen Zhao Guohao Li 300 45 0 28 Nov 2023
BIM: Block-Wise Self-Supervised Learning with Masked Image Modeling Yixuan Luo Mengye Ren Sai Qian Zhang 164 0 0 28 Nov 2023
Parameter Efficient Fine-tuning via Cross Block Orchestration for Segment Anything ModelComputer Vision and Pattern Recognition (CVPR), 2023 Zelin Peng Zhengqin Xu Zhilin Zeng Lingxi Xie Qi Tian Wei Shen 200 18 0 28 Nov 2023
A Rank Stabilization Scaling Factor for Fine-Tuning with LoRA Damjan Kalajdzievski ALM 202 159 0 28 Nov 2023
Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer Learning Huanjin Yao Wenhao Wu Zhiheng Li VLM 238 13 0 27 Nov 2023
Adapter is All You Need for Tuning Visual Tasks Dongshuo Yin Leiyi Hu Bin Li Youqun Zhang 221 20 0 25 Nov 2023
PrivateLoRA For Efficient Privacy Preserving LLM Yiming Wang Yu Lin Xiaodong Zeng Guannan Zhang 203 22 0 23 Nov 2023
Towards Better Parameter-Efficient Fine-Tuning for Large Language Models: A Position Paper Chengyu Wang Junbing Yan Wei Zhang Jun Huang ALM 165 4 0 22 Nov 2023
ComPEFT: Compression for Communicating Parameter Efficient Updates via Sparsification and Quantization Prateek Yadav Leshem Choshen Colin Raffel Mohit Bansal 210 18 0 22 Nov 2023
Descriptor and Word Soups: Overcoming the Parameter Efficiency Accuracy Tradeoff for Out-of-Distribution Few-shot LearningComputer Vision and Pattern Recognition (CVPR), 2023 Christopher Liao Theodoros Tsiligkaridis Brian Kulis OODD 255 7 0 21 Nov 2023
Applications of Large Scale Foundation Models for Autonomous Driving Yu Huang Yue Chen Zhu Li ELM AI4CE LRM ALM LM&Ro 546 21 0 20 Nov 2023
LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model FinetuningInternational Conference on Learning Representations (ICLR), 2023 Han Guo P. Greengard Eric P. Xing Yoon Kim MQ 376 80 0 20 Nov 2023
Zero redundancy distributed learning with differential privacy Zhiqi Bu Justin Chiu Ruixuan Liu Sheng Zha George Karypis 209 10 0 20 Nov 2023
Sparse Low-rank Adaptation of Pre-trained Language Models Ning Ding Xingtai Lv Qiaosen Wang Yulin Chen Bowen Zhou Zhiyuan Liu Maosong Sun 221 92 0 20 Nov 2023
MultiLoRA: Democratizing LoRA for Better Multi-Task Learning Yiming Wang Yu Lin Xiaodong Zeng Guannan Zhang MoMe 231 31 0 20 Nov 2023
Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning Clifton A. Poth Hannah Sterz Indraneil Paul Sukannya Purkayastha Leon Arne Engländer Timo Imhof Ivan Vulić Sebastian Ruder Iryna Gurevych Jonas Pfeiffer 192 73 0 18 Nov 2023
A Framework for Monitoring and Retraining Language Models in Real-World Applications Jaykumar Kasundra Claudia Schulz Melicaalsadat Mirsafian Stavroula Skylaki OffRL LRM 161 1 0 16 Nov 2023
Overcoming Data Scarcity in Biomedical Imaging with a Foundational Multi-Task Model Raphael Schäfer Till Nicke Henning Höfener Annkristin Lange Dorit Merhof Friedrich Feuerhake Volkmar Schulz Johannes Lotz Fabian Kiessling VLM 107 44 0 16 Nov 2023
Tied-Lora: Enhancing parameter efficiency of LoRA with weight tying Adithya Renduchintala Tugrul Konuk Oleksii Kuchaiev MoMe 268 64 0 16 Nov 2023
SiRA: Sparse Mixture of Low Rank Adaptation Yun Zhu Nevan Wichers Chu-Cheng Lin Xinyi Wang Tianlong Chen ... Han Lu Canoee Liu Liangchen Luo Jindong Chen Lei Meng MoE 174 34 0 15 Nov 2023
Tunable Soft Prompts are Messengers in Federated LearningConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Chenhe Dong Yuexiang Xie Bolin Ding Ying Shen Yaliang Li FedML 167 9 0 12 Nov 2023
Aggregate, Decompose, and Fine-Tune: A Simple Yet Effective Factor-Tuning Method for Vision Transformer Dongping Chen 134 4 0 12 Nov 2023
Parameter-Efficient Orthogonal Finetuning via Butterfly FactorizationInternational Conference on Learning Representations (ICLR), 2023 Weiyang Liu Zeju Qiu Yao Feng Yuliang Xiu Yuxuan Xue ... Songyou Peng Yandong Wen Michael J. Black Adrian Weller Bernhard Schölkopf 308 94 0 10 Nov 2023
Mini but Mighty: Finetuning ViTs with Mini AdaptersIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2023 Imad Eddine Marouf Enzo Tartaglione Stéphane Lathuilière 137 11 0 07 Nov 2023
Task-Agnostic Low-Rank Adapters for Unseen English DialectsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Zedian Xiao William B. Held Yanchen Liu Diyi Yang 204 11 0 02 Nov 2023
Improving Prompt Tuning with Learned Prompting Layers Wei Zhu Ming Tan VLM 233 3 0 31 Oct 2023
Res-Tuning: A Flexible and Efficient Tuning Paradigm via Unbinding Tuner from BackboneNeural Information Processing Systems (NeurIPS), 2023 Zeyinzi Jiang Chaojie Mao Ziyuan Huang Ao Ma Yiliang Lv Yujun Shen Deli Zhao Jingren Zhou 209 22 0 30 Oct 2023
Fast Trainable Projection for Robust Fine-TuningNeural Information Processing Systems (NeurIPS), 2023 Junjiao Tian Yen-Cheng Liu James Seale Smith Z. Kira OOD 221 18 0 29 Oct 2023
Punica: Multi-Tenant LoRA ServingConference on Machine Learning and Systems (MLSys), 2023 Lequn Chen Zihao Ye Yongji Wu Danyang Zhuo Luis Ceze Arvind Krishnamurthy 169 58 0 28 Oct 2023
Parameter-Efficient Methods for Metastases Detection from Clinical Notes Maede Ashofteh Barabadi Xiaodan Zhu Wai-Yip Chan Amber L. Simpson Richard K G Do 211 1 0 27 Oct 2023