Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2301.01821
Cited By
Parameter-Efficient Fine-Tuning Design Spaces
International Conference on Learning Representations (ICLR), 2023
4 January 2023
Jiaao Chen
Aston Zhang
Xingjian Shi
Mu Li
Alexander J. Smola
Diyi Yang
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Parameter-Efficient Fine-Tuning Design Spaces"
50 / 53 papers shown
Contrastive Knowledge Transfer and Robust Optimization for Secure Alignment of Large Language Models
Jiasen Zheng
Huajun Zhang
Xu Yan
Ran Hao
Chong Peng
168
6
0
31 Oct 2025
PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint
Bhoomit Vasani
Jack FitzGerald
Anjie Fang
Sushmit Vaish
161
2
0
13 Sep 2025
Orthogonal Finetuning Made Scalable
Zeju Qiu
Weiyang Liu
Adrian Weller
Bernhard Schölkopf
254
3
0
24 Jun 2025
PrunePEFT: Iterative Hybrid Pruning for Parameter-Efficient Fine-tuning of LLMs
Tongzhou Yu
Zhuhao Zhang
Guanghui Zhu
Shen Jiang
Meikang Qiu
Yihua Huang
163
1
0
09 Jun 2025
Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets
Annual Meeting of the Association for Computational Linguistics (ACL), 2025
Dongyue Li
Ziniu Zhang
Lu Wang
Hongyang R. Zhang
219
7
0
28 May 2025
Look Within or Look Beyond? A Theoretical Comparison Between Parameter-Efficient and Full Fine-Tuning
Yongkang Liu
Xingle Xu
Ercong Nie
Zijing Wang
Shi Feng
Daling Wang
Qian Li
Hinrich Schutze
227
1
0
28 May 2025
On the Robustness Tradeoff in Fine-Tuning
Kunyang Li
Jean-Charles Noirot Ferrand
Ryan Sheatsley
Blaine Hoak
Yohan Beugin
Eric Pauley
Patrick McDaniel
335
2
0
19 Mar 2025
LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning
International Conference on Learning Representations (ICLR), 2025
Zhekai Du
Yinjie Min
Jingjing Li
Ke Lu
Changliang Zou
Liuhua Peng
Tingjin Chu
Mingming Gong
936
4
0
05 Feb 2025
TabPFN Unleashed: A Scalable and Effective Solution to Tabular Classification Problems
Si-Yang Liu
Han-Jia Ye
473
26
0
04 Feb 2025
Parameter-Efficient Fine-Tuning for Foundation Models
Dan Zhang
Tao Feng
Lilong Xue
Yuandong Wang
Yuxiao Dong
J. Tang
639
42
0
23 Jan 2025
A Simple Recipe for Contrastively Pre-training Video-First Encoders Beyond 16 Frames
Computer Vision and Pattern Recognition (CVPR), 2023
Pinelopi Papalampidi
Skanda Koppula
Shreya Pathak
Celine Lee
Joseph Heyward
Viorica Patraucean
Jiajun Shen
Antoine Miech
Andrew Zisserman
Aida Nematzdeh
VLM
302
41
0
31 Dec 2024
MambaPEFT: Exploring Parameter-Efficient Fine-Tuning for Mamba
International Conference on Learning Representations (ICLR), 2024
Masakazu Yoshimura
Teruaki Hayashi
Yota Maeda
Mamba
742
11
0
06 Nov 2024
CleaR: Towards Robust and Generalized Parameter-Efficient Fine-Tuning for Noisy Label Learning
Annual Meeting of the Association for Computational Linguistics (ACL), 2024
Yeachan Kim
Junho Kim
SangKeun Lee
NoLa
AAML
397
5
0
31 Oct 2024
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies
Liwen Wang
Sheng Chen
Linnan Jiang
Shu Pan
Runze Cai
Sen Yang
Fei Yang
579
14
0
24 Oct 2024
Towards Optimal Adapter Placement for Efficient Transfer Learning
Aleksandra I. Nowak
Otniel-Bogdan Mercea
Anurag Arnab
Jonas Pfeiffer
Yann N. Dauphin
Utku Evci
355
2
0
21 Oct 2024
Understanding Forgetting in LLM Supervised Fine-Tuning and Preference Learning - A Convex Optimization Perspective
H. Fernando
Han Shen
Parikshit Ram
Yi Zhou
Horst Samulowitz
Nathalie Baracaldo
Tianyi Chen
CLL
539
10
0
20 Oct 2024
Layer-wise Importance Matters: Less Memory for Better Performance in Parameter-efficient Fine-tuning of Large Language Models
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Kai Yao
P. Gao
Lichun Li
Yuan Zhao
Xiaofeng Wang
Wei Wang
Jianke Zhu
170
7
0
15 Oct 2024
PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakers
Yibo Zhong
Haoxiang Jiang
Lincan Li
Ryumei Nakada
Tianci Liu
Linjun Zhang
Huaxiu Yao
Haoyu Wang
602
6
0
02 Oct 2024
AI Act for the Working Programmer
Holger Hermanns
Anne Lauber-Rönsberg
Philip Meinel
Sarah Sterz
Hanwei Zhang
216
1
0
23 Jul 2024
Foundation Model Engineering: Engineering Foundation Models Just as Engineering Software
Dezhi Ran
Mengzhou Wu
Wei Yang
Tao Xie
AI4CE
298
9
0
11 Jul 2024
Towards Minimal Targeted Updates of Language Models with Targeted Negative Training
Lily H. Zhang
Rajesh Ranganath
Arya Tafvizi
353
1
0
19 Jun 2024
SuperPos-Prompt: Enhancing Soft Prompt Tuning of Language Models with Superposition of Multi Token Embeddings
MohammadAli SadraeiJavaeri
Ehsaneddin Asgari
A. Mchardy
Hamid R. Rabiee
VLM
AAML
193
4
0
07 Jun 2024
Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Vision
Minglei Li
Peng Ye
Yongqi Huang
Lin Zhang
Tao Chen
Tong He
Jiayuan Fan
Wanli Ouyang
MoE
370
13
0
05 Jun 2024
ETHER: Efficient Finetuning of Large-Scale Models with Hyperplane Reflections
Massimo Bini
Karsten Roth
Zeynep Akata
Anna Khoreva
204
10
0
30 May 2024
Efficient Prompt Tuning by Multi-Space Projection and Prompt Fusion
Pengxiang Lan
Enneng Yang
Yuting Liu
Guibing Guo
Linying Jiang
Jianzhe Zhao
Xingwei Wang
VLM
AAML
272
4
0
19 May 2024
Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuning
International Conference on Machine Learning (ICML), 2024
Jing Xu
Jingzhao Zhang
257
14
0
04 May 2024
RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization
Dongqi Pu
Vera Demberg
399
11
0
01 May 2024
Towards Incremental Learning in Large Language Models: A Critical Review
M. Jovanovic
Peter Voss
ELM
CLL
KELM
684
10
0
28 Apr 2024
Facial Affective Behavior Analysis with Instruction Tuning
Jiayi Zhang
Anh Dao
Wentao Bao
Zhen Tan
Tianlong Chen
Huan Liu
Yu Kong
CVBM
273
25
0
07 Apr 2024
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
Xinyu Ma
Xu Chu
Zhibang Yang
Yang Lin
Xin Gao
Junfeng Zhao
392
18
0
05 Apr 2024
Query-driven Relevant Paragraph Extraction from Legal Judgments
Santosh T.Y.S.S
Elvin Quero Hernandez
Matthias Grabmair
AILaw
247
5
0
31 Mar 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey
Zeyu Han
Chao Gao
Jinyang Liu
Jeff Zhang
Sai Qian Zhang
869
808
0
21 Mar 2024
HiFT: A Hierarchical Full Parameter Fine-Tuning Strategy
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Yongkang Liu
Yiqun Zhang
Qian Li
Tong Liu
Shi Feng
Daling Wang
Yifei Zhang
Hinrich Schütze
347
17
0
26 Jan 2024
Design Principles for Generative AI Applications
International Conference on Human Factors in Computing Systems (CHI), 2024
Justin D. Weisz
Jessica He
Michael J. Muller
Gabriela Hoefer
Rachel Miles
Werner Geyer
AI4CE
190
229
0
25 Jan 2024
PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation
Findings (Findings), 2024
Nadav Benedek
Lior Wolf
198
9
0
20 Jan 2024
MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models
Annual Meeting of the Association for Computational Linguistics (ACL), 2024
Divyanshu Aggarwal
Ashutosh Sathe
Ishaan Watts
Sunayana Sitaram
254
5
0
15 Jan 2024
PEFT for Speech: Unveiling Optimal Placement, Merging Strategies, and Ensemble Techniques
Tzu-Han Lin
How-Shing Wang
Hao-Yung Weng
Kuang-Chen Peng
Zih-Ching Chen
Hung-yi Lee
273
9
0
04 Jan 2024
Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment
Lingling Xu
Haoran Xie
S. J. Qin
Xiaohui Tao
F. Wang
354
300
0
19 Dec 2023
Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization
International Conference on Learning Representations (ICLR), 2023
Weiyang Liu
Zeju Qiu
Yao Feng
Yuliang Xiu
Yuxuan Xue
...
Songyou Peng
Yandong Wen
Michael J. Black
Adrian Weller
Bernhard Schölkopf
505
100
0
10 Nov 2023
Unlearn What You Want to Forget: Efficient Unlearning for LLMs
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Jiaao Chen
Diyi Yang
MU
454
234
0
31 Oct 2023
Non-Intrusive Adaptation: Input-Centric Parameter-efficient Fine-Tuning for Versatile Multimodal Modeling
Yaqing Wang
Jialin Wu
T. Dabral
Jiageng Zhang
Geoff Brown
...
Frederick Liu
Yi Liang
Bo Pang
Michael Bendersky
Radu Soricut
VLM
200
20
0
18 Oct 2023
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning
International Conference on Learning Representations (ICLR), 2023
Ted Zadouri
Ahmet Üstün
Arash Ahmadian
Beyza Ermics
Acyr Locatelli
Sara Hooker
MoE
267
149
0
11 Sep 2023
Efficient Finetuning Large Language Models For Vietnamese Chatbot
International Conference on Multimedia Analysis and Pattern Recognition (ICMAPR), 2023
Vu-Thuan Doan
Quoc-Truong Truong
Duc-Vu Nguyen
Vinh-Tiep Nguyen
Thuy-Ngan Nguyen Luu
ALM
111
8
0
09 Sep 2023
IncreLoRA: Incremental Parameter Allocation Method for Parameter-Efficient Fine-tuning
Feiyu F. Zhang
Liangzhi Li
Jun-Cheng Chen
Zhouqian Jiang
Bowen Wang
Yiming Qian
257
44
0
23 Aug 2023
PRISMA-DFLLM: An Extension of PRISMA for Systematic Literature Reviews using Domain-specific Finetuned Large Language Models
Teo Susnjak
151
16
0
15 Jun 2023
Artificial General Intelligence for Medical Imaging
IEEE Reviews in Biomedical Engineering (RBME), 2023
Xiang Li
Lu Zhang
Zihao Wu
Zheng Liu
Lin Zhao
...
Pingkuan Yan
Shijie Zhao
Wen Liu
Tianming Liu
Hongtu Zhu
LM&MA
AI4CE
320
58
0
08 Jun 2023
Exploring the Impact of Model Scaling on Parameter-Efficient Tuning
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Yusheng Su
Chi-Min Chan
Jiali Cheng
Yujia Qin
Yankai Lin
...
Ning Ding
Xingzhi Sun
Guotong Xie
Zhiyuan Liu
Maosong Sun
288
9
0
04 Jun 2023
BiomedGPT: A Unified and Generalist Biomedical Generative Pre-trained Transformer for Vision, Language, and Multimodal Tasks
Nature Network Boston (NNB), 2023
Kai Zhang
Jun Yu
Eashan Adhikarla
Rong Zhou
Zhilin Yan
...
Hang Zhang
Yong Chen
Shijie Zhao
Hongfang Liu
Lichao Sun
LM&MA
MedIm
346
11
0
26 May 2023
Automated Few-shot Classification with Instruction-Finetuned Language Models
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Rami Aly
Xingjian Shi
Kaixiang Lin
Aston Zhang
A. Wilson
314
11
0
21 May 2023
G-Adapter: Towards Structure-Aware Parameter-Efficient Transfer Learning for Graph Transformer Networks
AAAI Conference on Artificial Intelligence (AAAI), 2023
Anchun Gui
Jinqiang Ye
Han Xiao
213
31
0
17 May 2023
1
2
Next
Page 1 of 2
