BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 819 papers shown

Title
MHLAT: Multi-hop Label-wise Attention Model for Automatic ICD Coding Junwen Duan Han Jiang Ying Yu 24 2 0 16 Sep 2023
MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentation Cheng Chen Juzheng Miao Dufan Wu Zhiling Yan Sekeun Kim ... Lichao Sun Xiang Li Tianming Liu Pheng-Ann Heng Quanzheng Li MedIm 53 58 0 16 Sep 2023
DePT: Decoupled Prompt Tuning Ji Zhang Shihan Wu Lianli Gao Hengtao Shen Jingkuan Song VLM 32 27 0 14 Sep 2023
Hydra: Multi-head Low-rank Adaptation for Parameter Efficient Fine-tuning Sanghyeon Kim Hyunmo Yang Younghyun Kim Youngjoon Hong Eunbyung Park AI4CE 29 16 0 13 Sep 2023
Scaled Prompt-Tuning for Few-Shot Natural Language Generation Ting Hu Christoph Meinel Haojin Yang 11 0 0 13 Sep 2023
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning Ted Zadouri Ahmet Üstün Arash Ahmadian Beyza Ermics Acyr Locatelli Sara Hooker MoE 35 88 0 11 Sep 2023
DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning Zhengxiang Shi Aldo Lipani VLM 28 30 0 11 Sep 2023
ImageBind-LLM: Multi-modality Instruction Tuning Jiaming Han Renrui Zhang Wenqi Shao Peng Gao Peng-Tao Xu ... Yafei Wen Xiaoxin Chen Xiangyu Yue Hongsheng Li Yu Qiao MLLM 49 116 0 07 Sep 2023
Delta-LoRA: Fine-Tuning High-Rank Parameters with the Delta of Low-Rank Matrices Bojia Zi Xianbiao Qi Lingzhi Wang Jianan Wang Kam-Fai Wong Lei Zhang 26 40 0 05 Sep 2023
MultiWay-Adapater: Adapting large-scale multi-modal models for scalable image-text retrieval Zijun Long George Killick R. McCreadie Gerardo Aragon Camarasa 14 2 0 04 Sep 2023
Parameter and Computation Efficient Transfer Learning for Vision-Language Pre-trained Models Qiong Wu Wei Yu Yiyi Zhou Shubin Huang Xiaoshuai Sun Rongrong Ji VLM 26 7 0 04 Sep 2023
Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following Ziyu Guo Renrui Zhang Xiangyang Zhu Yiwen Tang Xianzheng Ma ... Ke Chen Peng Gao Xianzhi Li Hongsheng Li Pheng-Ann Heng MLLM 35 125 0 01 Sep 2023
CEFHRI: A Communication Efficient Federated Learning Framework for Recognizing Industrial Human-Robot Interaction Umar Khalid Hasan Iqbal Saeed Vahidian Jing Hua Cheng Chen 21 3 0 29 Aug 2023
AutoProSAM: Automated Prompting SAM for 3D Multi-Organ Segmentation Chengyin Li Prashant Khanduri Yao Qiang Rafi Ibn Sultan I. Chetty D. Zhu MedIm 75 13 0 28 Aug 2023
Fine-Tuning Llama 2 Large Language Models for Detecting Online Sexual Predatory Chats and Abusive Texts Thanh Thi Nguyen Campbell Wilson Janis Dalins 21 23 0 28 Aug 2023
Mobile Foundation Model as Firmware Jinliang Yuan Chenchen Yang Dongqi Cai Shihe Wang Xin Yuan ... Di Zhang Hanzi Mei Xianqing Jia Shangguang Wang Mengwei Xu 40 19 0 28 Aug 2023
MetaWeather: Few-Shot Weather-Degraded Image Restoration Youngrae Kim Younggeol Cho Thanh-Tung Nguyen Seunghoon Hong Dongman Lee 27 0 0 28 Aug 2023
UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory Haiwen Diao Bo Wan Wenjie Qu Xuecong Jia Huchuan Lu Long Chen VLM 36 18 0 28 Aug 2023
FwdLLM: Efficient FedLLM using Forward Gradient Mengwei Xu Dongqi Cai Yaozong Wu Xiang Li Shangguang Wang FedML 55 24 0 26 Aug 2023
DR-Tune: Improving Fine-tuning of Pretrained Visual Models by Distribution Regularization with Semantic Calibration Nana Zhou Jiaxin Chen Di Huang 27 4 0 23 Aug 2023
IncreLoRA: Incremental Parameter Allocation Method for Parameter-Efficient Fine-tuning Feiyu F. Zhang Liangzhi Li Jun-Cheng Chen Zhouqian Jiang Bowen Wang Yiming Qian 51 32 0 23 Aug 2023
Instruction Tuning for Large Language Models: A Survey Shengyu Zhang Linfeng Dong Xiaoya Li Sen Zhang Xiaofei Sun ... Jiwei Li Runyi Hu Tianwei Zhang Fei Wu Guoyin Wang LM&MA 24 538 0 21 Aug 2023
VLN-PETL: Parameter-Efficient Transfer Learning for Vision-and-Language Navigation Yanyuan Qiao Zheng Yu Qi Wu VLM 22 16 0 20 Aug 2023
UniAP: Towards Universal Animal Perception in Vision via Few-shot Learning Meiqi Sun Zhonghan Zhao Wenhao Chai Hanjun Luo Shidong Cao Yanting Zhang Lei Li Gaoang Wang 27 7 0 19 Aug 2023
Tensor-Compressed Back-Propagation-Free Training for (Physics-Informed) Neural Networks Yequan Zhao Xinling Yu Zhixiong Chen Z. Liu Sijia Liu Zheng-Wei Zhang PINN 32 11 0 18 Aug 2023
VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control Zi-Yuan Hu Yanyang Li M. Lyu Liwei Wang VLM 32 15 0 18 Aug 2023
SimDA: Simple Diffusion Adapter for Efficient Video Generation Zhen Xing Qi Dai Hang-Rui Hu Zuxuan Wu Yu-Gang Jiang VGen DiffM 35 81 0 18 Aug 2023
PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose Estimation Han-Wen Liu Ju He Zhi-Qi Cheng Wangmeng Xiang Q. Yang ... Gaoang Wang Xueting Bao Bin Luo Yifeng Geng Xuansong Xie DiffM 32 19 0 18 Aug 2023
V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models Heng Wang Jianbo Ma Santiago Pascual Richard Cartwright Weidong (Tom) Cai VGen 21 38 0 18 Aug 2023
ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse Yi-Kai Zhang Lu Ren Chao Yi Qiwen Wang De-Chuan Zhan Han-Jia Ye 23 2 0 17 Aug 2023
Comparison between parameter-efficient techniques and full fine-tuning: A case study on multilingual news article classification Olesya Razuvayevskaya Ben Wu João A. Leite Freddy Heppell Ivan Srba Carolina Scarton Kalina Bontcheva Xingyi Song 24 8 0 14 Aug 2023
SLoRA: Federated Parameter Efficient Fine-Tuning of Language Models Sara Babakniya A. Elkordy Yahya H. Ezzeldin Qingfeng Liu Kee-Bong Song Mostafa El-Khamy Salman Avestimehr 27 56 0 12 Aug 2023
AdaptiveSAM: Towards Efficient Tuning of SAM for Surgical Scene Segmentation Jay N. Paranjape Nithin Gopalakrishnan Nair S. Sikder S. Vedula Vishal M. Patel MedIm 23 38 0 07 Aug 2023
LoRA-FA: Memory-efficient Low-rank Adaptation for Large Language Models Fine-tuning Longteng Zhang Lin Zhang S. Shi X. Chu Bo-wen Li AI4CE 18 91 0 07 Aug 2023
Multimodal Adaptation of CLIP for Few-Shot Action Recognition Jiazheng Xing Mengmeng Wang Xiaojun Hou Guangwen Dai Jingdong Wang Yong-Jin Liu VLM 22 0 0 03 Aug 2023
Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision Redundancy Shibo Jie Haoqing Wang Zhiwei Deng 19 31 0 31 Jul 2023
Bridging Vision and Language Encoders: Parameter-Efficient Tuning for Referring Image Segmentation Zunnan Xu Zhihong Chen Yong Zhang Yibing Song Xiang Wan Guanbin Li VLM 35 47 0 21 Jul 2023
Tuning Pre-trained Model via Moment Probing Mingze Gao Qilong Wang Zhenyi Lin Pengfei Zhu Qinghua Hu Jingbo Zhou 21 6 0 21 Jul 2023
Exploring the Landscape of Natural Language Processing Research Tim Schopf Karim Arabi Florian Matthes 21 13 0 20 Jul 2023
FinGPT: Democratizing Internet-scale Data for Financial Large Language Models Xiao-Yang Liu Guoxuan Wang Hongyang Yang Daochen Zha AIFin 41 43 0 19 Jul 2023
Tangent Transformers for Composition, Privacy and Removal Tian Yu Liu Aditya Golatkar Stefano Soatto 30 8 0 16 Jul 2023
MGit: A Model Versioning and Management System Wei Hao Daniel Mendoza Rafael Ferreira da Silva Deepak Narayanan Amar Phanishayee VLM 24 1 0 14 Jul 2023
A Comprehensive Overview of Large Language Models Humza Naveed Asad Ullah Khan Shi Qiu Muhammad Saqib Saeed Anwar Muhammad Usman Naveed Akhtar Nick Barnes Ajmal Saeed Mian OffRL 70 525 0 12 Jul 2023
Scaling In-Context Demonstrations with Structured Attention Tianle Cai Kaixuan Huang Jason D. Lee Mengdi Wang LRM 31 8 0 05 Jul 2023
OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models Shengding Hu Ning Ding Weilin Zhao Xingtai Lv Zhen Zhang Zhiyuan Liu Maosong Sun 37 7 0 05 Jul 2023
An Efficient General-Purpose Modular Vision Model via Multi-Task Heterogeneous Training Z. Chen Mingyu Ding Yikang Shen Wei Zhan Masayoshi Tomizuka Erik Learned-Miller Chuang Gan MoE 24 8 0 29 Jun 2023
Fauno: The Italian Large Language Model that will leave you senza parole! Andrea Bacciu Giovanni Trappolini Andrea Santilli Emanuele Rodolà Fabrizio Silvestri 20 18 0 26 Jun 2023
3DSAM-adapter: Holistic Adaptation of SAM from 2D to 3D for Promptable Medical Image Segmentation Shizhan Gong Yuan Zhong Wenao Ma Jinpeng Li Zhao Wang Jingyang Zhang Pheng-Ann Heng Qi Dou MedIm 20 72 0 23 Jun 2023
Ladder Fine-tuning approach for SAM integrating complementary network Shurong Chai R. Jain Shiyu Teng Jiaqing Liu Yinhao Li T. Tateyama Yen-wei Chen MedIm 22 31 0 22 Jun 2023
Parameter-efficient is not sufficient: Exploring Parameter, Memory, and Time Efficient Adapter Tuning for Dense Predictions Dongshuo Yin Xueting Han Bin Li Hao Feng Jinghua Bai VPVLM 31 17 0 16 Jun 2023