v1v2v3v4v5 (latest)

BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

Annual Meeting of the Association for Computational Linguistics (ACL), 2021

18 June 2021

Papers citing "BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models"

50 / 965 papers shown

Title
Rethinking Weight Decay for Robust Fine-Tuning of Foundation ModelsNeural Information Processing Systems (NeurIPS), 2024 Junjiao Tian Chengyue Huang Z. Kira 152 3 0 03 Nov 2024
Bayesian-guided Label Mapping for Visual ReprogrammingNeural Information Processing Systems (NeurIPS), 2024 C. Cai Zesheng Ye Bingquan Shen Jianzhong Qi Feng Liu 375 8 0 31 Oct 2024
CleaR: Towards Robust and Generalized Parameter-Efficient Fine-Tuning for Noisy Label LearningAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Yeachan Kim Junho Kim SangKeun Lee NoLa AAML 312 4 0 31 Oct 2024
Efficient Adaptation of Pre-trained Vision Transformer via Householder TransformationNeural Information Processing Systems (NeurIPS), 2024 Wei Dong Yuan Sun Yiting Yang Xing Zhang Zhijun Lin Qingsen Yan Han Zhang Peng Wang Yang Yang Hengtao Shen 182 3 0 30 Oct 2024
Capacity Control is an Effective Memorization Mitigation Mechanism in Text-Conditional Diffusion Models Raman Dutt Pedro Sanchez Ondrej Bohdal Sotirios A. Tsaftaris Timothy M. Hospedales 255 1 0 29 Oct 2024
IntLoRA: Integral Low-rank Adaptation of Quantized Diffusion Models Hang Guo Yawei Li Tao Dai Shu-Tao Xia Luca Benini MQ 289 5 0 29 Oct 2024
NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks Yongchang Hao Yanshuai Cao Lili Mou MQ 185 4 0 28 Oct 2024
GeoLoRA: Geometric integration for parameter efficient fine-tuningInternational Conference on Learning Representations (ICLR), 2024 Steffen Schotthöfer Emanuele Zangrando Gianluca Ceruti Francesco Tudisco J. Kusch AI4CE 146 6 0 24 Oct 2024
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies Liwen Wang Sheng Chen Linnan Jiang Shu Pan Runze Cai Sen Yang Fei Yang 449 41 0 24 Oct 2024
MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuningConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Jingfan Zhang Yi Zhao Dan Chen Xing Tian Huanran Zheng Wei Zhu MoE 303 34 0 23 Oct 2024
ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language TuningInternational Journal of Computer Vision (IJCV), 2024 Zhiwei Hao Jianyuan Guo Li Shen Yong Luo Han Hu Yonggang Wen VLM 255 3 0 23 Oct 2024
Cross-model Control: Improving Multiple Large Language Models in One-time TrainingNeural Information Processing Systems (NeurIPS), 2024 Jiayi Wu Hao Sun Hengyi Cai Lixin Su Shuaiqiang Wang D. Yin Xiang Li Ming Gao MU 164 3 0 23 Oct 2024
Understanding Layer Significance in LLM Alignment Guangyuan Shi Zexin Lu Xiaoyu Dong Wenlong Zhang Xuanyu Zhang Yujie Feng Xiao-Ming Wu 420 11 0 23 Oct 2024
PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers in a resource-limited Context Maximilian Augustin Syed Shakib Sarwar Mostafa Elhoushi Sai Qian Zhang Yuecheng Li B. D. Salvo 197 1 0 23 Oct 2024
Towards Real Zero-Shot Camouflaged Object Segmentation without Camouflaged AnnotationsIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024 Cheng Lei Jie Fan Xinran Li Tianzhu Xiang Ao Li Ce Zhu Le Zhang 245 4 0 22 Oct 2024
GSSF: Generalized Structural Sparse Function for Deep Cross-modal Metric LearningIEEE Transactions on Image Processing (TIP), 2024 Haiwen Diao Ying Zhang Shang Gao Jiawen Zhu Long Chen Huchuan Lu 199 9 0 20 Oct 2024
FiTv2: Scalable and Improved Flexible Vision Transformer for Diffusion Model ZiDong Wang Zeyu Lu Di Huang Cai Zhou Wanli Ouyang and Lei Bai 249 9 0 17 Oct 2024
LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for Parameter-Efficient Fine-Tuning Yiming Shi Jiwei Wei Yujia Wu Ran Ran Chengwei Sun Shiyuan He Yang Yang ALM 200 3 0 17 Oct 2024
Unlocking the Capabilities of Masked Generative Models for Image Synthesis via Self-GuidanceNeural Information Processing Systems (NeurIPS), 2024 Jiwan Hur Dong-Jae Lee Gyojin Han Jaehyun Choi Yunho Jeon Junmo Kim DiffM 266 4 0 17 Oct 2024
Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Sajjad Ghiasvand Yifan Yang Zhiyu Xue Mahnoosh Alizadeh Zheng Zhang Ramtin Pedarsani FedML 524 6 0 16 Oct 2024
LoKO: Low-Rank Kalman Optimizer for Online Fine-Tuning of Large Models Hossein Abdi Mingfei Sun Andi Zhang Samuel Kaski Wei Pan 187 1 0 15 Oct 2024
Domain-Conditioned Transformer for Fully Test-time AdaptationACM Multimedia (MM), 2024 Yushun Tang Shuoshuo Chen Jiyuan Jia Yi Zhang Zhihai He 287 3 0 14 Oct 2024
Is Parameter Collision Hindering Continual Learning in LLMs?International Conference on Computational Linguistics (COLING), 2024 Shuo Yang Hai-Jian Ke Yu-Yang Liu Jia-Yu Yao Yong-Hong Tian Yi-Bing Song Li Yuan MoMe CLL 215 10 0 14 Oct 2024
RoCoFT: Efficient Finetuning of Large Language Models with Row-Column UpdatesAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Md. Kowsher Tara Esmaeilbeig Chun-Nam Yu Chen Chen Mojtaba Soltanalian Niloofar Yousefi 310 2 0 14 Oct 2024
Understanding Robustness of Parameter-Efficient Tuning for Image Classification Jiacheng Ruan Xian Gao Suncheng Xiang Mingye Xie Ting Liu Yuzhuo Fu AAML VLM 160 0 0 13 Oct 2024
t-READi: Transformer-Powered Robust and Efficient Multimodal Inference for Autonomous DrivingIEEE Transactions on Mobile Computing (IEEE TMC), 2024 Pengfei Hu Yuhang Qian Tianyue Zheng Ang Li Zhe Chen Yue Gao Xiuzhen Cheng Jun Luo 266 3 0 13 Oct 2024
ELICIT: LLM Augmentation via External In-Context CapabilityInternational Conference on Learning Representations (ICLR), 2024 Futing Wang Jianhao Yan Yue Zhang Tao Lin 310 5 0 12 Oct 2024
QEFT: Quantization for Efficient Fine-Tuning of LLMsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Changhun Lee Jun-gyu Jin Jun-gyu Jin Eunhyeok Park MQ 152 4 0 11 Oct 2024
Parameter-Efficient Fine-Tuning of Large Language Models using Semantic Knowledge TuningScientific Reports (Sci Rep), 2024 Nusrat Jahan Prottasha Asif Mahmud Md. Shohanur Islam Sobuj Prakash Bhat Md. Kowsher Niloofar Yousefi O. Garibay 280 17 0 11 Oct 2024
Parameter-Efficient Fine-Tuning of State Space Models Kevin Galim Wonjun Kang Yuchen Zeng H. Koo Kangwook Lee 351 6 0 11 Oct 2024
AdaShadow: Responsive Test-time Model Adaptation in Non-stationary Mobile EnvironmentsACM International Conference on Embedded Networked Sensor Systems (SenSys), 2024 Cheng Fang Sicong Liu Zimu Zhou Bin Guo Jiaqi Tang Ke Ma Zhiwen Yu TTA 155 5 0 10 Oct 2024
Packing Analysis: Packing Is More Appropriate for Large Models or Datasets in Supervised Fine-tuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Shuhe Wang Guoyin Wang Yucheng Wang Jiwei Li Eduard H. Hovy Chen Guo 299 11 0 10 Oct 2024
ACCEPT: Adaptive Codebook for Composite and Efficient Prompt TuningConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Yu-Chen Lin Wei-Hua Li Jun-Cheng Chen Chu-Song Chen 195 2 0 10 Oct 2024
Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud LearningIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024 Dingkang Liang Tianrui Feng Xin Zhou Yumeng Zhang Zhikang Zou Xiang Bai 290 25 0 10 Oct 2024
QuAILoRA: Quantization-Aware Initialization for LoRA Neal Lawton Aishwarya Padmakumar Judith Gaspers Jack FitzGerald Anoop Kumar Greg Ver Steeg Aram Galstyan MQ 109 1 0 09 Oct 2024
SparseGrad: A Selective Method for Efficient Fine-tuning of MLP LayersConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Viktoriia Chekalina Anna Rudenko Gleb Mezentsev Alexander Mikhalev Sergey Petrakov Ivan Oseledets 93 1 0 09 Oct 2024
OD-Stega: LLM-Based Near-Imperceptible Steganography via Optimized Distributions Yu-Shin Huang Peter Just Krishna Narayanan Chao Tian 254 15 0 06 Oct 2024
Implicit to Explicit Entropy Regularization: Benchmarking ViT Fine-tuning under Noisy Labels Maria Marrium Arif Mahmood Mohammed Bennamoun NoLa AAML 225 0 0 05 Oct 2024
LoRTA: Low Rank Tensor Adaptation of Large Language Models Ignacio Hounie Charilaos I. Kanatsoulis Arnuv Tandon Alejandro Ribeiro 441 2 0 05 Oct 2024
Learning from Offline Foundation Features with Tensor AugmentationsNeural Information Processing Systems (NeurIPS), 2024 Emir Konuk Christos Matsoukas Moein Sorkhei Phitchapha Lertsiravaramet Kevin Smith OffRL 151 1 0 03 Oct 2024
Revisiting Prefix-tuning: Statistical Benefits of Reparameterization among PromptsInternational Conference on Learning Representations (ICLR), 2024 Minh Le Chau Nguyen Huy Nguyen Quyen Tran Trung Le Nhat Ho 597 12 0 03 Oct 2024
Differentially Private Parameter-Efficient Fine-tuning for Large ASR Models Hongbin Liu Lun Wang Om Thakkar Abhradeep Thakurta Arun Narayanan 227 2 0 02 Oct 2024
PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakers Yibo Zhong Haoxiang Jiang Lincan Li Ryumei Nakada Tianci Liu Linjun Zhang Huaxiu Yao Haoyu Wang 480 6 0 02 Oct 2024
PrivTuner with Homomorphic Encryption and LoRA: A P3EFT Scheme for Privacy-Preserving Parameter-Efficient Fine-Tuning of AI Foundation ModelsIEEE Transactions on Wireless Communications (IEEE TWC), 2024 Yang Li Wenhan Yu Jun Zhao 490 5 0 01 Oct 2024
HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR ModelsIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2024 Bingshen Mu Kun Wei Qijie Shao Yong Xu Lei Xie MoE 400 11 0 30 Sep 2024
Pear: Pruning and Sharing Adapters in Visual Parameter-Efficient Fine-Tuning Yibo Zhong Yao Zhou 138 0 0 29 Sep 2024
Vision-Language Models are Strong Noisy Label DetectorsNeural Information Processing Systems (NeurIPS), 2024 Tong Wei Haoyang Li Chun-Shu Li Jiang-Xin Shi Yu-Feng Li Min-Ling Zhang VLM 185 13 0 29 Sep 2024
Harnessing Frozen Unimodal Encoders for Flexible Multimodal AlignmentComputer Vision and Pattern Recognition (CVPR), 2024 Mayug Maniparambil Raiymbek Akshulakov Y. A. D. Djilali Sanath Narayan Ankit Singh Noel E. O'Connor VLM MLLM 108 0 0 28 Sep 2024
PEDRO: Parameter-Efficient Fine-tuning with Prompt DEpenDent Representation MOdificationInternational Conference on Neural Information Processing (ICONIP), 2024 Tianfang Xie Tianjing Li Wei Zhu Wei Han Yi Zhao 224 7 0 26 Sep 2024
On the Implicit Relation Between Low-Rank Adaptation and Differential Privacy Saber Malekmohammadi G. Farnadi 486 2 0 26 Sep 2024