On the Effectiveness of Parameter-Efficient Fine-Tuning

AAAI Conference on Artificial Intelligence (AAAI), 2022

28 November 2022

Haoran Yang

Papers citing "On the Effectiveness of Parameter-Efficient Fine-Tuning"

50 / 105 papers shown

Title
On the Convergence and Stability of Distributed Sub-model Training Yuyang Deng Fuli Qiao M. Mahdavi FedML 162 0 0 08 Nov 2025
Random Initialization of Gated Sparse Adapters Vi Retault Yohaï-Eliel Berreby CLL MoE 148 0 0 03 Nov 2025
FedLoDrop: Federated LoRA with Dropout for Generalized LLM Fine-tuning Sijing Xie Dingzhu Wen Changsheng You Qimei Chen Mehdi Bennis Kaibin Huang 87 0 0 14 Oct 2025
LLMs are All You Need? Improving Fuzz Testing for MOJO with Large Language Models Linghan Huang Peizhou Zhao Huaming Chen 118 0 0 11 Oct 2025
Adaptive Policy Backbone via Shared Network Bumgeun Park Donghwan Lee OffRL OnRL 136 0 0 26 Sep 2025
Distribution-Aligned Decoding for Efficient LLM Task Adaptation Senkang Hu Xudong Han Jinqi Jiang Yihang Tao Zihan Fang Yong Dai Sam Kwong Yuguang Fang 141 0 0 19 Sep 2025
Adaptive LoRA Experts Allocation and Selection for Federated Fine-Tuning Lei Wang Jieming Bian Letian Zhang Jie Xu 142 2 0 18 Sep 2025
HEFT: A Coarse-to-Fine Hierarchy for Enhancing the Efficiency and Accuracy of Language Model Reasoning Brennen Hill 52 0 0 11 Sep 2025
Routing Distilled Knowledge via Mixture of LoRA Experts for Large Language Model based Bundle Generation Kaidong Feng Zhu Sun Hui Fang Jie Yang Wenyuan Liu Yew-Soon Ong MoE 44 0 0 24 Aug 2025
Preserving Domain Generalization in Fine-Tuning via Joint Parameter Selection Bin Pan Shiyu Shen Zongbin Wang Zhenwei Shi Xia Xu 56 0 0 23 Aug 2025
LoRAtorio: An intrinsic approach to LoRA Skill Composition Niki Foteinopoulou Ignas Budvytis Stephan Liwicki MoMe 93 0 0 15 Aug 2025
FedDPG: An Adaptive Yet Efficient Prompt-tuning Approach in Federated Learning SettingsPacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2025 A. Shakeri Wei Zhang Amin Beheshti Weitong Chen Jian Yang L. Yang FedML 81 0 0 22 Jul 2025
SemRAG: Semantic Knowledge-Augmented RAG for Improved Question-Answering Kezhen Zhong Basem Suleiman Abdelkarim Erradi Shijing Chen VLM 103 1 0 10 Jul 2025
Intrinsic Training Signals for Federated Learning Aggregation Cosimo Fiorini Matteo Mosconi Pietro Buzzega Riccardo Salami Simone Calderara FedML 120 0 0 09 Jul 2025
Towards Artificial General or Personalized Intelligence? A Survey on Foundation Models for Personalized Federated Intelligence Yu Qiao Huy Q. Le Avi Deb Raha Phuong-Nam Tran Apurba Adhikary Mengchun Zhang Loc X. Nguyen Eui-nam Huh Zhu Han Choong Seon Hong AI4CE 331 5 0 11 May 2025
X-Cross: Dynamic Integration of Language Models for Cross-Domain Sequential RecommendationAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2025 Guy Hadad Haggai Roitman Yotam Eshel Bracha Shapira Lior Rokach BDL VLM LRM 191 0 0 29 Apr 2025
What Lurks Within? Concept Auditing for Shared Diffusion Models at Scale Xiaoyong Yuan Xiaolong Ma Linke Guo Lan Zhang DiffM 250 0 0 21 Apr 2025
Parameter-Efficient Continual Fine-Tuning: A Survey Eric Nuertey Coleman Luigi Quarantiello Ziyue Liu Qinwen Yang Samrat Mukherjee J. Hurtado Vincenzo Lomonaco CLL 279 4 0 18 Apr 2025
PATFinger: Prompt-Adapted Transferable Fingerprinting against Unauthorized Multimodal Dataset UsageAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2025 Weinan Zhang Ju Jia Yang Liu Yihao Huang Xuzhao Li Cong Wu Lina Wang AAML 212 1 0 15 Apr 2025
Task-Aware Parameter-Efficient Fine-Tuning of Large Pre-Trained Models at the Edge Senkang Hu Yanan Ma Yihang Tao Zhengru Fang Zihan Fang Yiqin Deng Sam Kwong Yuguang Fang 179 2 0 29 Mar 2025
PartialLoading: User Scheduling and Bandwidth Allocation for Parameter-sharing Edge Inference Guanqiao Qu Qian Chen Xianhao Chen Kaibin Huang Yuguang Fang 212 2 0 29 Mar 2025
FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA Jieming Bian Lei Wang Letian Zhang Jie Xu 310 6 0 14 Mar 2025
Statistical Deficiency for Task Inclusion EstimationAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Loïc Fosse Frédéric Béchet Benoit Favre Géraldine Damnati Gwénolé Lecorvé Maxime Darrin Philippe Formont Pablo Piantanida 1.0K 1 0 07 Mar 2025
Parameter-Efficient Fine-Tuning of Large Language Models via Deconvolution in SubspaceInternational Conference on Computational Linguistics (COLING), 2025 Jia-Chen Zhang Yu-Jie Xiong Chun-Ming Xia Dong-Hai Zhu Xi-He Qiu 202 6 0 03 Mar 2025
Dynamic Gradient Sparsification Training for Few-Shot Fine-tuning of CT Lymph Node Segmentation Foundation ModelInternational Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2025 Zihao Luo Zijun Gao Wenjun Liao Shichuan Zhang Guotai Wang Xiangde Luo 195 0 0 02 Mar 2025
TabPFN Unleashed: A Scalable and Effective Solution to Tabular Classification Problems Si-Yang Liu Han-Jia Ye 290 19 0 04 Feb 2025
Toward Realistic Camouflaged Object Detection: Benchmarks and Method Zhimeng Xin Tianxu Wu Shiming Chen Shuo Ye Zijing Xie Yixiong Zou Xinge You Yufei Guo 147 0 0 13 Jan 2025
NAT-NL2GQL: A Novel Multi-Agent Framework for Translating Natural Language to Graph Query Language Yuanyuan Liang Tingyu Xie Gan Peng Zihao Huang Yunshi Lan Weining Qian LLMAG 221 5 0 11 Dec 2024
Gradient dynamics for low-rank fine-tuning beyond kernels Arif Kerem Dayi Sitan Chen 221 2 0 23 Nov 2024
Expanding Sparse Tuning for Low Memory UsageNeural Information Processing Systems (NeurIPS), 2024 Shufan Shen Junshu Sun Xiangyang Ji Qingming Huang Shuhui Wang 269 9 0 04 Nov 2024
CleaR: Towards Robust and Generalized Parameter-Efficient Fine-Tuning for Noisy Label LearningAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Yeachan Kim Junho Kim SangKeun Lee NoLa AAML 300 4 0 31 Oct 2024
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies Liwen Wang Sheng Chen Linnan Jiang Shu Pan Runze Cai Sen Yang Fei Yang 413 14 0 24 Oct 2024
The effect of fine-tuning on language model toxicity Will Hawkins Brent Mittelstadt Chris Russell 151 9 0 21 Oct 2024
DARE the Extreme: Revisiting Delta-Parameter Pruning For Fine-Tuned ModelsInternational Conference on Learning Representations (ICLR), 2024 Wenlong Deng Yize Zhao V. Vakilian Minghui Chen Xiaoxiao Li Christos Thrampoulidis 387 8 0 12 Oct 2024
Few Exemplar-Based General Medical Image Segmentation via Domain-Aware Selective AdaptationAsian Conference on Computer Vision (ACCV), 2024 Chen Xu Qiming Huang Yuqi Hou Jiangxing Wu Fan Zhang Hyung Jin Chang Jianbo Jiao 73 0 0 11 Oct 2024
QEFT: Quantization for Efficient Fine-Tuning of LLMsConference on Empirical Methods in Natural Language Processing (EMNLP), 2024 Changhun Lee Jun-gyu Jin Jun-gyu Jin Eunhyeok Park MQ 144 4 0 11 Oct 2024
LoRTA: Low Rank Tensor Adaptation of Large Language Models Ignacio Hounie Charilaos I. Kanatsoulis Arnuv Tandon Alejandro Ribeiro 421 2 0 05 Oct 2024
AutoLoRA: AutoGuidance Meets Low-Rank Adaptation for Diffusion Models Artur Kasymov Marcin Sendera Michał Stypułkowski Maciej Ziȩba Przemysław Spurek 264 6 0 04 Oct 2024
Resource Allocation for Stable LLM Training in Mobile Edge ComputingACM Interational Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), 2024 Chang Liu Jun Zhao 128 11 0 30 Sep 2024
Scrambled text: training Language Models to correct OCR errors using synthetic data Jonathan Bourne SyDa 193 3 0 29 Sep 2024
PACE: Marrying generalization in PArameter-efficient fine-tuning with Consistency rEgularizationNeural Information Processing Systems (NeurIPS), 2024 Yao Ni Shan Zhang Piotr Koniusz 988 14 0 25 Sep 2024
Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual RecognitionComputer Vision and Pattern Recognition (CVPR), 2024 Zheda Mai Ping Zhang Cheng-Hao Tu Hong-You Chen Li Zhang Wei-Lun Chao 182 0 0 24 Sep 2024
Propulsion: Steering LLM with Tiny Fine-TuningInternational Conference on Computational Linguistics (COLING), 2024 Md. Kowsher Nusrat Jahan Prottasha Prakash Bhat 191 10 0 17 Sep 2024
AlpaPICO: Extraction of PICO Frames from Clinical Trial Documents Using LLMs Madhusudan Ghosh Shrimon Mukherjee Asmit Ganguly Partha Basuchowdhuri S. Naskar Debasis Ganguly 206 14 0 15 Sep 2024
Risks When Sharing LoRA Fine-Tuned Diffusion Model Weights Dixi Yao 144 3 0 13 Sep 2024
SSFam: Scribble Supervised Salient Object Detection FamilyIEEE transactions on multimedia (IEEE TMM), 2024 Zhengyi Liu Sheng Deng Xinrui Wang Linbo Wang Xianyong Fang Bin Tang 199 3 0 07 Sep 2024
LoRA $^2$ : Multi-Scale Low-Rank Approximations for Fine-Tuning Large Language Models Jia-Chen Zhang Yu-Jie Xiong He-Xi Qiu Dong-Hai Zhu Chun-Ming Xia MoE 149 0 0 13 Aug 2024
Leveraging the Power of LLMs: A Fine-Tuning Approach for High-Quality Aspect-Based Summarization Ankan Mullick Sombit Bose Rounak Saha Ayan Kumar Bhowmick Aditya Vempaty Pawan Goyal Niloy Ganguly Prasenjit Dey Ravi Kokku 166 4 0 05 Aug 2024
Segment anything model 2: an application to 2D and 3D medical images Haoyu Dong Han Gu Yaqian Chen Jichen Yang Yuwen Chen Maciej A. Mazurowski VLM MedIm 260 26 0 01 Aug 2024
Parameter-Efficient Fine-Tuning via Circular Convolution Chenyi Zi Jiashun Cheng Zijing Liu Ziqi Gao Fugee Tsung Yu-Feng Li Jia Li 320 4 0 27 Jul 2024