v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 959 papers shown

Title
ImageBind-LLM: Multi-modality Instruction Tuning Jiaming Han Renrui Zhang Wenqi Shao Shiyang Feng Peng Xu ... Yafei Wen Xiaoxin Chen Xiangyu Yue Jiaming Song Yu Qiao MLLM 232 148 0 07 Sep 2023
Delta-LoRA: Fine-Tuning High-Rank Parameters with the Delta of Low-Rank Matrices Bojia Zi Xianbiao Qi Lingzhi Wang Jianan Wang Kam-Fai Wong Lei Zhang 179 67 0 05 Sep 2023
MultiWay-Adapater: Adapting large-scale multi-modal models for scalable image-text retrievalIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023 Zijun Long George Killick R. McCreadie Gerardo Aragon Camarasa 162 2 0 04 Sep 2023
Parameter and Computation Efficient Transfer Learning for Vision-Language Pre-trained ModelsNeural Information Processing Systems (NeurIPS), 2023 Qiong Wu Wei Yu Weihao Ye Shubin Huang Xiaoshuai Sun Rongrong Ji VLM 199 10 0 04 Sep 2023
Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following Ziyu Guo Renrui Zhang Xiangyang Zhu Yiwen Tang Xianzheng Ma ... Ke Chen Shiyang Feng Xianzhi Li Jiaming Song Pheng-Ann Heng MLLM 296 184 0 01 Sep 2023
CEFHRI: A Communication Efficient Federated Learning Framework for Recognizing Industrial Human-Robot InteractionIEEE/RJS International Conference on Intelligent RObots and Systems (IROS), 2023 Umar Khalid Hasan Iqbal Saeed Vahidian Jing Hua Chong Chen 111 5 0 29 Aug 2023
AutoProSAM: Automated Prompting SAM for 3D Multi-Organ SegmentationIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2023 Chengyin Li Prashant Khanduri Yao Qiang Rafi Ibn Sultan I. Chetty D. Zhu MedIm 308 19 0 28 Aug 2023
Fine-Tuning Llama 2 Large Language Models for Detecting Online Sexual Predatory Chats and Abusive TextsThe European Symposium on Artificial Neural Networks (ESANN), 2023 Thanh Thi Nguyen Campbell Wilson Janis Dalins 107 32 0 28 Aug 2023
Mobile Foundation Model as FirmwareACM/IEEE International Conference on Mobile Computing and Networking (MobiCom), 2023 Jinliang Yuan Chenchen Yang Dongqi Cai Shihe Wang Xin Yuan ... Di Zhang Hanzi Mei Xianqing Jia Shangguang Wang Mengwei Xu 294 38 0 28 Aug 2023
MetaWeather: Few-Shot Weather-Degraded Image RestorationEuropean Conference on Computer Vision (ECCV), 2023 Youngrae Kim Younggeol Cho Thanh-Tung Nguyen Seunghoon Hong Dongman Lee 245 3 0 28 Aug 2023
UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and MemoryComputer Vision and Pattern Recognition (CVPR), 2023 Haiwen Diao Bo Wan Yanzhe Zhang Xuecong Jia Huchuan Lu Long Chen VLM 177 25 0 28 Aug 2023
FwdLLM: Efficient FedLLM using Forward Gradient Mengwei Xu Dongqi Cai Yaozong Wu Xiang Li Shangguang Wang FedML 206 34 0 26 Aug 2023
DR-Tune: Improving Fine-tuning of Pretrained Visual Models by Distribution Regularization with Semantic CalibrationIEEE International Conference on Computer Vision (ICCV), 2023 Nana Zhou Jiaxin Chen Di Huang 157 5 0 23 Aug 2023
IncreLoRA: Incremental Parameter Allocation Method for Parameter-Efficient Fine-tuning Feiyu F. Zhang Liangzhi Li Jun-Cheng Chen Zhouqian Jiang Bowen Wang Yiming Qian 183 39 0 23 Aug 2023
Instruction Tuning for Large Language Models: A Survey Shengyu Zhang Linfeng Dong Xiaoya Li Sen Zhang Xiaofei Sun ... Jiwei Li Runyi Hu Tianwei Zhang Leilei Gan Guoyin Wang LM&MA 646 743 0 21 Aug 2023
VLN-PETL: Parameter-Efficient Transfer Learning for Vision-and-Language NavigationIEEE International Conference on Computer Vision (ICCV), 2023 Yanyuan Qiao Zheng Yu Qi Wu VLM 143 24 0 20 Aug 2023
UniAP: Towards Universal Animal Perception in Vision via Few-shot LearningAAAI Conference on Artificial Intelligence (AAAI), 2023 Meiqi Sun Zhonghan Zhao Wenhao Chai Hanjun Luo Shidong Cao Yanting Zhang Lei Li Gaoang Wang 134 9 0 19 Aug 2023
Tensor-Compressed Back-Propagation-Free Training for (Physics-Informed) Neural Networks Yequan Zhao Xinling Yu Zhixiong Chen Ziyue Liu Sijia Liu Zheng Zhang PINN 161 13 0 18 Aug 2023
VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity ControlIEEE International Conference on Computer Vision (ICCV), 2023 Zi-Yuan Hu Yanyang Li Michael R. Lyu Liwei Wang VLM 149 23 0 18 Aug 2023
SimDA: Simple Diffusion Adapter for Efficient Video GenerationComputer Vision and Pattern Recognition (CVPR), 2023 Zhen Xing Jingdong Sun Hang-Rui Hu Zuxuan Wu Yu-Gang Jiang VGen DiffM 158 102 0 18 Aug 2023
PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose EstimationACM Multimedia (ACM MM), 2023 Han Liu Ju He Zhi-Qi Cheng Wangmeng Xiang Q. Yang ... Gaoang Wang Xueting Bao Bin Luo Yifeng Geng Xuansong Xie DiffM 178 26 0 18 Aug 2023
V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation ModelsAAAI Conference on Artificial Intelligence (AAAI), 2023 Heng Wang Jianbo Ma Santiago Pascual Richard Cartwright Weidong (Tom) Cai VGen 305 69 0 18 Aug 2023
ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse Yi-Kai Zhang Lu Ren Chao Yi Qiwen Wang De-Chuan Zhan Han-Jia Ye 119 3 0 17 Aug 2023
Comparison between parameter-efficient techniques and full fine-tuning: A case study on multilingual news article classificationPLoS ONE (PLoS ONE), 2023 Olesya Razuvayevskaya Ben Wu João A. Leite Freddy Heppell Ivan Srba Carolina Scarton Kalina Bontcheva Xingyi Song 200 17 0 14 Aug 2023
SLoRA: Federated Parameter Efficient Fine-Tuning of Language Models Sara Babakniya A. Elkordy Yahya H. Ezzeldin Qingfeng Liu Kee-Bong Song Mostafa El-Khamy Salman Avestimehr 147 105 0 12 Aug 2023
AdaptiveSAM: Towards Efficient Tuning of SAM for Surgical Scene SegmentationAnnual Conference on Medical Image Understanding and Analysis (MIUA), 2023 Jay N. Paranjape Nithin Gopalakrishnan Nair S. Sikder S. Vedula Vishal M. Patel MedIm 147 56 0 07 Aug 2023
LoRA-FA: Memory-efficient Low-rank Adaptation for Large Language Models Fine-tuning Longteng Zhang Lin Zhang Shaoshuai Shi Xiaowen Chu Yue Liu AI4CE 158 157 0 07 Aug 2023
Multimodal Adaptation of CLIP for Few-Shot Action RecognitionPattern Recognition (Pattern Recogn.), 2023 Jiazheng Xing Mengmeng Wang Xiaojun Hou Guangwen Dai Jingdong Wang Yong-Jin Liu VLM 153 1 0 03 Aug 2023
Revisiting the Parameter Efficiency of Adapters from the Perspective of Precision RedundancyIEEE International Conference on Computer Vision (ICCV), 2023 Shibo Jie Haoqing Wang Zhiwei Deng 149 40 0 31 Jul 2023
Bridging Vision and Language Encoders: Parameter-Efficient Tuning for Referring Image SegmentationIEEE International Conference on Computer Vision (ICCV), 2023 Zunnan Xu Zhihong Chen Yong Zhang Yibing Song Xiang Wan Guanbin Li VLM 164 68 0 21 Jul 2023
Tuning Pre-trained Model via Moment ProbingIEEE International Conference on Computer Vision (ICCV), 2023 Mingze Gao Qilong Wang Zhenyi Lin Pengfei Zhu Qinghua Hu Jingbo Zhou 184 14 0 21 Jul 2023
Exploring the Landscape of Natural Language Processing ResearchRecent Advances in Natural Language Processing (RANLP), 2023 Tim Schopf Karim Arabi Florian Matthes 323 18 0 20 Jul 2023
FinGPT: Democratizing Internet-scale Data for Financial Large Language Models Xiao-Yang Liu Guoxuan Wang Hongyang Yang Daochen Zha AIFin 200 84 0 19 Jul 2023
Tangent Transformers for Composition, Privacy and RemovalInternational Conference on Learning Representations (ICLR), 2023 Tian Yu Liu Aditya Golatkar Stefano Soatto 252 13 0 16 Jul 2023
MGit: A Model Versioning and Management SystemInternational Conference on Machine Learning (ICML), 2023 Wei Hao Daniel Mendoza Rafael Ferreira da Silva Deepak Narayanan Amar Phanishayee VLM 109 1 0 14 Jul 2023
A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and Technology (ACM TIST), 2023 Humza Naveed Asad Ullah Khan Shi Qiu Muhammad Saqib Saeed Anwar Muhammad Usman Naveed Akhtar Nick Barnes Lin Wang OffRL 688 1,078 0 12 Jul 2023
Scaling In-Context Demonstrations with Structured Attention Tianle Cai Kaixuan Huang Jason D. Lee Mengdi Wang LRM 142 9 0 05 Jul 2023
OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Shengding Hu Ning Ding Weilin Zhao Xingtai Lv Zhen Zhang Zhiyuan Liu Maosong Sun 110 9 0 05 Jul 2023
An Efficient General-Purpose Modular Vision Model via Multi-Task Heterogeneous Training Z. Chen Mingyu Ding Songlin Yang Wei Zhan Masayoshi Tomizuka Erik Learned-Miller Chuang Gan MoE 103 8 0 29 Jun 2023
Fauno: The Italian Large Language Model that will leave you senza parole!Italian Information Retrieval Workshop (IIR), 2023 Andrea Bacciu Giovanni Trappolini Andrea Santilli Emanuele Rodolà Fabrizio Silvestri 101 19 0 26 Jun 2023
3DSAM-adapter: Holistic Adaptation of SAM from 2D to 3D for Promptable Medical Image Segmentation Shizhan Gong Yuan Zhong Wenao Ma Jinpeng Li Zhao Wang Jingyang Zhang Pheng-Ann Heng Qi Dou MedIm 117 60 0 23 Jun 2023
Ladder Fine-tuning approach for SAM integrating complementary networkInternational Conference on Knowledge-Based Intelligent Information & Engineering Systems (KES), 2023 Shurong Chai R. Jain Shiyu Teng Jiaqing Liu Yinhao Li T. Tateyama Yen-wei Chen MedIm 131 45 0 22 Jun 2023
Parameter-efficient is not sufficient: Exploring Parameter, Memory, and Time Efficient Adapter Tuning for Dense PredictionsACM Multimedia (ACM MM), 2023 Dongshuo Yin Xueting Han Bin Li Hao Feng Jinghua Bai VPVLM 225 25 0 16 Jun 2023
One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning Arnav Chavan Zhuang Liu D. K. Gupta Eric P. Xing Zhiqiang Shen 248 106 0 13 Jun 2023
Morphosyntactic probing of multilingual BERT modelsNatural Language Engineering (NLE), 2023 Judit Ács Endre Hamerlik Roy Schwartz Noah A. Smith András Kornai 159 15 0 09 Jun 2023
Git-Theta: A Git Extension for Collaborative Development of Machine Learning ModelsInternational Conference on Machine Learning (ICML), 2023 Nikhil Kandpal Brian Lester Mohammed Muqeeth Anisha Mascarenhas Monty Evans Vishal Baskaran Tenghao Huang Haokun Liu Colin Raffel VLM 182 13 0 07 Jun 2023
ViDA: Homeostatic Visual Domain Adapter for Continual Test Time AdaptationInternational Conference on Learning Representations (ICLR), 2023 Jiaming Liu Senqiao Yang Peidong Jia Renrui Zhang Ming Lu Yandong Guo Wei Xue Shanghang Zhang TTA OOD VLM 329 55 0 07 Jun 2023
Inference-Time Intervention: Eliciting Truthful Answers from a Language ModelNeural Information Processing Systems (NeurIPS), 2023 Kenneth Li Oam Patel Fernanda Viégas Hanspeter Pfister Martin Wattenberg KELM HILM 575 792 0 06 Jun 2023
Sensitivity-Aware Finetuning for Accuracy Recovery on Deep Learning Hardware Lakshmi Nair D. Bunandar 111 0 0 05 Jun 2023
Cross-Lingual Transfer with Target Language-Ready Task AdaptersAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Marinela Parović Alan Ansell Ivan Vulić Anna Korhonen 167 14 0 05 Jun 2023