v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 959 papers shown

Title
IntLoRA: Integral Low-rank Adaptation of Quantized Diffusion Models Hang Guo Yawei Li Tao Dai Shu-Tao Xia Luca Benini MQ 285 5 0 29 Oct 2024
NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks Yongchang Hao Yanshuai Cao Lili Mou MQ 185 4 0 28 Oct 2024
GeoLoRA: Geometric integration for parameter efficient fine-tuningInternational Conference on Learning Representations (ICLR), 2024 Steffen Schotthöfer Emanuele Zangrando Gianluca Ceruti Francesco Tudisco J. Kusch AI4CE 130 6 0 24 Oct 2024
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies Liwen Wang Sheng Chen Linnan Jiang Shu Pan Runze Cai Sen Yang Fei Yang 429 14 0 24 Oct 2024
MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuningConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Jingfan Zhang Yi Zhao Dan Chen Xing Tian Huanran Zheng Wei Zhu MoE 295 34 0 23 Oct 2024
ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language TuningInternational Journal of Computer Vision (IJCV), 2024 Zhiwei Hao Jianyuan Guo Li Shen Yong Luo Han Hu Yonggang Wen VLM 255 2 0 23 Oct 2024
Cross-model Control: Improving Multiple Large Language Models in One-time TrainingNeural Information Processing Systems (NeurIPS), 2024 Jiayi Wu Hao Sun Hengyi Cai Lixin Su Shuaiqiang Wang D. Yin Xiang Li Ming Gao MU 164 3 0 23 Oct 2024
Understanding Layer Significance in LLM Alignment Guangyuan Shi Zexin Lu Xiaoyu Dong Wenlong Zhang Xuanyu Zhang Yujie Feng Xiao-Ming Wu 396 11 0 23 Oct 2024
PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers in a resource-limited Context Maximilian Augustin Syed Shakib Sarwar Mostafa Elhoushi Sai Qian Zhang Yuecheng Li B. D. Salvo 185 1 0 23 Oct 2024
Towards Real Zero-Shot Camouflaged Object Segmentation without Camouflaged AnnotationsIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024 Cheng Lei Jie Fan Xinran Li Tianzhu Xiang Ao Li Ce Zhu Le Zhang 241 3 0 22 Oct 2024
GSSF: Generalized Structural Sparse Function for Deep Cross-modal Metric LearningIEEE Transactions on Image Processing (TIP), 2024 Haiwen Diao Ying Zhang Shang Gao Jiawen Zhu Long Chen Huchuan Lu 195 9 0 20 Oct 2024
FiTv2: Scalable and Improved Flexible Vision Transformer for Diffusion Model ZiDong Wang Zeyu Lu Di Huang Cai Zhou Wanli Ouyang and Lei Bai 241 9 0 17 Oct 2024
LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for Parameter-Efficient Fine-Tuning Yiming Shi Jiwei Wei Yujia Wu Ran Ran Chengwei Sun Shiyuan He Yang Yang ALM 196 3 0 17 Oct 2024
Unlocking the Capabilities of Masked Generative Models for Image Synthesis via Self-GuidanceNeural Information Processing Systems (NeurIPS), 2024 Jiwan Hur Dong-Jae Lee Gyojin Han Jaehyun Choi Yunho Jeon Junmo Kim DiffM 258 4 0 17 Oct 2024
Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Sajjad Ghiasvand Yifan Yang Zhiyu Xue Mahnoosh Alizadeh Zheng Zhang Ramtin Pedarsani FedML 500 6 0 16 Oct 2024
LoKO: Low-Rank Kalman Optimizer for Online Fine-Tuning of Large Models Hossein Abdi Mingfei Sun Andi Zhang Samuel Kaski Wei Pan 187 1 0 15 Oct 2024
Domain-Conditioned Transformer for Fully Test-time AdaptationACM Multimedia (MM), 2024 Yushun Tang Shuoshuo Chen Jiyuan Jia Yi Zhang Zhihai He 275 3 0 14 Oct 2024
Is Parameter Collision Hindering Continual Learning in LLMs?International Conference on Computational Linguistics (COLING), 2024 Shuo Yang Hai-Jian Ke Yu-Yang Liu Jia-Yu Yao Yong-Hong Tian Yi-Bing Song Li Yuan MoMe CLL 215 10 0 14 Oct 2024
RoCoFT: Efficient Finetuning of Large Language Models with Row-Column UpdatesAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Md. Kowsher Tara Esmaeilbeig Chun-Nam Yu Chen Chen Mojtaba Soltanalian Niloofar Yousefi 298 2 0 14 Oct 2024
Understanding Robustness of Parameter-Efficient Tuning for Image Classification Jiacheng Ruan Xian Gao Suncheng Xiang Mingye Xie Ting Liu Yuzhuo Fu AAML VLM 160 0 0 13 Oct 2024
t-READi: Transformer-Powered Robust and Efficient Multimodal Inference for Autonomous DrivingIEEE Transactions on Mobile Computing (IEEE TMC), 2024 Pengfei Hu Yuhang Qian Tianyue Zheng Ang Li Zhe Chen Yue Gao Xiuzhen Cheng Jun Luo 258 3 0 13 Oct 2024
ELICIT: LLM Augmentation via External In-Context CapabilityInternational Conference on Learning Representations (ICLR), 2024 Futing Wang Jianhao Yan Yue Zhang Tao Lin 298 5 0 12 Oct 2024
QEFT: Quantization for Efficient Fine-Tuning of LLMsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Changhun Lee Jun-gyu Jin Jun-gyu Jin Eunhyeok Park MQ 152 4 0 11 Oct 2024
Parameter-Efficient Fine-Tuning of Large Language Models using Semantic Knowledge TuningScientific Reports (Sci Rep), 2024 Nusrat Jahan Prottasha Asif Mahmud Md. Shohanur Islam Sobuj Prakash Bhat Md. Kowsher Niloofar Yousefi O. Garibay 272 15 0 11 Oct 2024
Parameter-Efficient Fine-Tuning of State Space Models Kevin Galim Wonjun Kang Yuchen Zeng H. Koo Kangwook Lee 351 6 0 11 Oct 2024
AdaShadow: Responsive Test-time Model Adaptation in Non-stationary Mobile EnvironmentsACM International Conference on Embedded Networked Sensor Systems (SenSys), 2024 Cheng Fang Sicong Liu Zimu Zhou Bin Guo Jiaqi Tang Ke Ma Zhiwen Yu TTA 155 5 0 10 Oct 2024
Packing Analysis: Packing Is More Appropriate for Large Models or Datasets in Supervised Fine-tuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Shuhe Wang Guoyin Wang Yucheng Wang Jiwei Li Eduard H. Hovy Chen Guo 279 11 0 10 Oct 2024
ACCEPT: Adaptive Codebook for Composite and Efficient Prompt TuningConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Yu-Chen Lin Wei-Hua Li Jun-Cheng Chen Chu-Song Chen 167 2 0 10 Oct 2024
Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud LearningIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024 Dingkang Liang Tianrui Feng Xin Zhou Yumeng Zhang Zhikang Zou Xiang Bai 290 25 0 10 Oct 2024
QuAILoRA: Quantization-Aware Initialization for LoRA Neal Lawton Aishwarya Padmakumar Judith Gaspers Jack FitzGerald Anoop Kumar Greg Ver Steeg Aram Galstyan MQ 109 0 0 09 Oct 2024
SparseGrad: A Selective Method for Efficient Fine-tuning of MLP LayersConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Viktoriia Chekalina Anna Rudenko Gleb Mezentsev Alexander Mikhalev Sergey Petrakov Ivan Oseledets 73 1 0 09 Oct 2024
OD-Stega: LLM-Based Near-Imperceptible Steganography via Optimized Distributions Yu-Shin Huang Peter Just Krishna Narayanan Chao Tian 250 15 0 06 Oct 2024
Implicit to Explicit Entropy Regularization: Benchmarking ViT Fine-tuning under Noisy Labels Maria Marrium Arif Mahmood Mohammed Bennamoun NoLa AAML 213 0 0 05 Oct 2024
LoRTA: Low Rank Tensor Adaptation of Large Language Models Ignacio Hounie Charilaos I. Kanatsoulis Arnuv Tandon Alejandro Ribeiro 421 2 0 05 Oct 2024
Learning from Offline Foundation Features with Tensor AugmentationsNeural Information Processing Systems (NeurIPS), 2024 Emir Konuk Christos Matsoukas Moein Sorkhei Phitchapha Lertsiravaramet Kevin Smith OffRL 139 1 0 03 Oct 2024
Revisiting Prefix-tuning: Statistical Benefits of Reparameterization among PromptsInternational Conference on Learning Representations (ICLR), 2024 Minh Le Chau Nguyen Huy Nguyen Quyen Tran Trung Le Nhat Ho 589 12 0 03 Oct 2024
Differentially Private Parameter-Efficient Fine-tuning for Large ASR Models Hongbin Liu Lun Wang Om Thakkar Abhradeep Thakurta Arun Narayanan 219 2 0 02 Oct 2024
PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakers Yibo Zhong Haoxiang Jiang Lincan Li Ryumei Nakada Tianci Liu Linjun Zhang Huaxiu Yao Haoyu Wang 472 6 0 02 Oct 2024
PrivTuner with Homomorphic Encryption and LoRA: A P3EFT Scheme for Privacy-Preserving Parameter-Efficient Fine-Tuning of AI Foundation ModelsIEEE Transactions on Wireless Communications (IEEE TWC), 2024 Yang Li Wenhan Yu Jun Zhao 478 5 0 01 Oct 2024
HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR ModelsIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024 Bingshen Mu Kun Wei Qijie Shao Yong Xu Lei Xie MoE 396 11 0 30 Sep 2024
Pear: Pruning and Sharing Adapters in Visual Parameter-Efficient Fine-Tuning Yibo Zhong Yao Zhou 130 0 0 29 Sep 2024
Vision-Language Models are Strong Noisy Label DetectorsNeural Information Processing Systems (NeurIPS), 2024 Tong Wei Haoyang Li Chun-Shu Li Jiang-Xin Shi Yu-Feng Li Min-Ling Zhang VLM 185 13 0 29 Sep 2024
Harnessing Frozen Unimodal Encoders for Flexible Multimodal AlignmentComputer Vision and Pattern Recognition (CVPR), 2024 Mayug Maniparambil Raiymbek Akshulakov Y. A. D. Djilali Sanath Narayan Ankit Singh Noel E. O'Connor VLM MLLM 96 0 0 28 Sep 2024
PEDRO: Parameter-Efficient Fine-tuning with Prompt DEpenDent Representation MOdificationInternational Conference on Neural Information Processing (ICONIP), 2024 Tianfang Xie Tianjing Li Wei Zhu Wei Han Yi Zhao 216 7 0 26 Sep 2024
On the Implicit Relation Between Low-Rank Adaptation and Differential Privacy Saber Malekmohammadi G. Farnadi 430 2 0 26 Sep 2024
Parameter-efficient Bayesian Neural Networks for Uncertainty-aware Depth Estimation Richard D. Paul Alessio Quercia Vincent Fortuin Katharina Nöh Hanno Scharr UQCV BDL 127 2 0 25 Sep 2024
Vision-Language Model Fine-Tuning via Simple Parameter-Efficient ModificationConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Ming Li J. Zhong Chenxin Li Liuzhuozheng Li Nie Lin Masashi Sugiyama CLIP VLM 156 20 0 25 Sep 2024
Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual RecognitionComputer Vision and Pattern Recognition (CVPR), 2024 Zheda Mai Ping Zhang Cheng-Hao Tu Hong-You Chen Li Zhang Wei-Lun Chao 186 0 0 24 Sep 2024
Multiple-Exit Tuning: Towards Inference-Efficient Adaptation for Vision Transformer Zheng Liu Jinchao Zhu Nannan Li Gao Huang 201 0 0 21 Sep 2024
HUT: A More Computation Efficient Fine-Tuning Method With Hadamard Updated Transformation Geyuan Zhang Xiaofei Zhou Chuheng Chen 102 0 0 20 Sep 2024