Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2310.17513
Cited By
v1
v2
v3 (latest)
The Expressive Power of Low-Rank Adaptation
International Conference on Learning Representations (ICLR), 2023
26 October 2023
Yuchen Zeng
Kangwook Lee
Re-assign community
ArXiv (abs)
PDF
HTML
Github (20★)
Papers citing
"The Expressive Power of Low-Rank Adaptation"
50 / 63 papers shown
Beyond Higher Rank: Token-wise Input-Output Projections for Efficient Low-Rank Adaptation
Shiwei Li
Xiandi Luo
Haozhao Wang
Xing Tang
Ziqiang Cui
Dugang Liu
Yuhua Li
Xiuqiang He
Ruixuan Li
170
4
0
27 Oct 2025
Fine-Tuning Robot Policies While Maintaining User Privacy
Benjamin A. Christie
Sagar Parekh
Dylan P. Losey
178
0
0
22 Sep 2025
The Anatomy of Alignment: Decomposing Preference Optimization by Steering Sparse Features
Jeremias Lino Ferrao
Matthijs van der Lende
Ilija Lichkovski
Clement Neo
LLMSV
349
1
0
16 Sep 2025
MoLEx: Mixture of LoRA Experts in Speech Self-Supervised Models for Audio Deepfake Detection
Zihan Pan
Sailor Hardik Bhupendra
Jinyang Wu
MoE
252
4
0
11 Sep 2025
Curvature Learning for Generalization of Hyperbolic Neural Networks
International Journal of Computer Vision (IJCV), 2025
Xiaomeng Fan
Yuwei Wu
Zhi Gao
Mehrtash Harandi
Yunde Jia
347
3
0
24 Aug 2025
BoRA: Towards More Expressive Low-Rank Adaptation with Block Diversity
Shiwei Li
Xiandi Luo
Haozhao Wang
Xing Tang
Ziqiang Cui
Dugang Liu
Yuhua Li
Xiuqiang He
Ruixuan Li
146
5
0
09 Aug 2025
SAS: Simulated Attention Score
Chuanyang Zheng
J. Sun
Yihang Gao
Yuehao Wang
Peihao Wang
...
Atlas Wang
Mac Schwager
Anderson Schneider
Xiaodong Liu
Jianfeng Gao
AI4TS
307
3
0
10 Jul 2025
Joint Tensor-Train Parameterization for Efficient and Expressive Low-Rank Adaptation
Jun Qi
Chen-Yu Liu
Sabato Marco Siniscalchi
Chao-Han Huck Yang
Min-hsiu Hsieh
244
0
0
19 Jun 2025
Sharp Generalization Bounds for Foundation Models with Asymmetric Randomized Low-Rank Adapters
Anastasis Kratsios
Tin Sum Cheng
Aurelien Lucchi
Haitz Sáez de Ocáriz Borde
239
3
0
17 Jun 2025
Position: Pause Recycling LoRAs and Prioritize Mechanisms to Uncover Limits and Effectiveness
Mei-Yen Chen
Thi Thu Uyen Hoang
Michael Hahn
M. Sarfraz
MoMe
300
0
0
16 Jun 2025
SLICK: Selective Localization and Instance Calibration for Knowledge-Enhanced Car Damage Segmentation in Automotive Insurance
Teerapong Panboonyuen
370
35
0
12 Jun 2025
PoLAR: Polar-Decomposed Low-Rank Adapter Representation
Kai Lion
Liang Zhang
Bingcong Li
Niao He
355
9
0
03 Jun 2025
Probabilistic Forecasting for Building Energy Systems using Time-Series Foundation Models
Energy and Buildings (Energy Build.), 2025
Young-Jin Park
François Germain
Jing Liu
Ye Wang
T. Koike-Akino
Gordon Wichern
Navid Azizan
C. Laughman
Ankush Chakrabarty
AI4TS
AI4CE
224
3
0
31 May 2025
Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
Babak Barazandeh
Subhabrata Majumdar
Om Rajyaguru
George Michailidis
247
0
0
30 May 2025
PDE-Transformer: Efficient and Versatile Transformers for Physics Simulations
Benjamin Holzschuh
Qiang Liu
Georg Kohl
Nils Thuerey
AI4CE
310
14
0
30 May 2025
Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics
Shiwei Li
Xiandi Luo
Xing Tang
Haozhao Wang
Hao Chen
Weihong Luo
Yuhua Li
Xiuqiang He
Ruixuan Li
AI4CE
313
12
0
29 May 2025
FedHL: Federated Learning for Heterogeneous Low-Rank Adaptation via Unbiased Aggregation
Zihao Peng
Jiandian Zeng
Boyuan Li
Guo Li
Shengbo Chen
Tian Wang
FedML
471
2
0
24 May 2025
Only Large Weights (And Not Skip Connections) Can Prevent the Perils of Rank Collapse
Josh Alman
Zhao Song
438
13
0
22 May 2025
Does Low Rank Adaptation Lead to Lower Robustness against Training-Time Attacks?
Zi Liang
Haibo Hu
Qingqing Ye
Yaxin Xiao
Ronghua Li
AAML
532
5
0
19 May 2025
Fast RoPE Attention: Combining the Polynomial Method and Fast Fourier Transform
Josh Alman
Zhao Song
395
27
0
17 May 2025
Diffusion Model Quantization: A Review
Qian Zeng
Chenggong Hu
Weilong Dai
Jie Song
MQ
517
5
0
08 May 2025
Distillation-Enabled Knowledge Alignment Protocol for Semantic Communication in AI Agent Networks
IEEE Communications Letters (IEEE Commun. Lett.), 2025
Jingzhi Hu
Geoffrey Ye Li
198
3
0
07 May 2025
Fast and Low-Cost Genomic Foundation Models via Outlier Removal
Haozheng Luo
Chenghao Qiu
Maojiang Su
Zhihan Zhou
Zoe Mehta
Guo Ye
Jerry Yao-Chieh Hu
Han Liu
AAML
502
7
0
01 May 2025
Theoretical Foundation of Flow-Based Time Series Generation: Provable Approximation, Generalization, and Efficiency
Jiangxuan Long
Zhao Song
Chiwun Yang
AI4TS
994
2
0
18 Mar 2025
RaSA: Rank-Sharing Low-Rank Adaptation
International Conference on Learning Representations (ICLR), 2025
Zhiwei He
Zhaopeng Tu
Xing Wang
Xingyu Chen
Zhaoxiang Wang
Jiahao Xu
Tian Liang
Wenxiang Jiao
Zizhuo Zhang
Rui Wang
ALM
415
4
0
16 Mar 2025
AdaptSR: Low-Rank Adaptation for Efficient and Scalable Real-World Super-Resolution
Cansu Korkmaz
Nancy Mehta
Radu Timofte
353
0
0
10 Mar 2025
Understanding the Learning Dynamics of LoRA: A Gradient Flow Perspective on Low-Rank Adaptation in Matrix Factorization
International Conference on Artificial Intelligence and Statistics (AISTATS), 2025
Ziqing Xu
Hancheng Min
Lachlan Ewen MacDonald
Jinqi Luo
Salma Tarmoun
Enrique Mallada
Rene Vidal
AI4CE
476
7
0
10 Mar 2025
GBT-SAM: A Parameter-Efficient Depth-Aware Model for Generalizable Brain tumour Segmentation on mp-MRI
Cecilia Diana-Albelda
Roberto Alcover-Couso
Álvaro García-Martín
Jesús Bescós
Marcos Escudero-Viñolo
418
1
0
06 Mar 2025
The impact of allocation strategies in subset learning on the expressive power of neural networks
International Conference on Learning Representations (ICLR), 2025
Ofir Schlisselberg
Ran Darshan
371
0
0
10 Feb 2025
Tensor Product Attention Is All You Need
Yifan Zhang
Yifeng Liu
Huizhuo Yuan
Zhen Qin
Yang Yuan
Q. Gu
Andrew Chi-Chih Yao
880
39
0
11 Jan 2025
GraphLoRA: Structure-Aware Contrastive Low-Rank Adaptation for Cross-Graph Transfer Learning
Knowledge Discovery and Data Mining (KDD), 2024
Zhe-Rui Yang
Jindong Han
Chang-Dong Wang
Hao Liu
OffRL
404
16
0
08 Jan 2025
YOLO-UniOW: Efficient Universal Open-World Object Detection
Lihao Liu
Juexiao Feng
Hui Chen
Ao Wang
Lin Song
Jiawei Han
Guiguang Ding
ObjD
VLM
376
6
0
31 Dec 2024
LoRA-Mini : Adaptation Matrices Decomposition and Selective Training
Ayush Singh
Rajdeep Aher
Shivank Garg
329
1
0
24 Nov 2024
The effect of fine-tuning on language model toxicity
Will Hawkins
Brent Mittelstadt
Chris Russell
230
15
0
21 Oct 2024
On Fine-Grained I/O Complexity of Attention Backward Passes
Xiaoyu Li
Yingyu Liang
Zhenmei Shi
Zhao Song
Yufa Zhou
Jiahao Zhang
338
19
0
12 Oct 2024
Parameter-Efficient Fine-Tuning of State Space Models
Kevin Galim
Wonjun Kang
Yuchen Zeng
H. Koo
Kangwook Lee
484
8
0
11 Oct 2024
How Much Can RAG Help the Reasoning of LLM?
Jingyu Liu
Jiaen Lin
Yong Liu
LRM
331
35
0
03 Oct 2024
Differentially Private Kernel Density Estimation
Erzhi Liu
Jerry Yao-Chieh Hu
Alex Reneau
Zhao Song
Han Liu
534
8
0
03 Sep 2024
MoRe Fine-Tuning with 10x Fewer Parameters
Wenxuan Tan
Nicholas Roberts
Tzu-Heng Huang
Jitian Zhao
John Cooper
Samuel Guo
Chengyu Duan
Frederic Sala
399
2
0
30 Aug 2024
LBC: Language-Based-Classifier for Out-Of-Variable Generalization
North American Chapter of the Association for Computational Linguistics (NAACL), 2024
Kangjun Noh
Baekryun Seong
Hoyoon Byun
Youngjun Choi
Sungjin Song
Kyungwoo Song
381
0
0
20 Aug 2024
Memorization Capacity for Additive Fine-Tuning with Small ReLU Networks
Conference on Uncertainty in Artificial Intelligence (UAI), 2024
Jy-yong Sohn
Dohyun Kwon
Seoyeon An
Kangwook Lee
405
0
0
01 Aug 2024
Parameter-Efficient Fine-Tuning via Circular Convolution
Chenyi Zi
Jiashun Cheng
Zijing Liu
Ziqi Gao
Fugee Tsung
Yu-Feng Li
Jia Li
583
5
0
27 Jul 2024
Do Large Language Models Have Compositional Ability? An Investigation into Limitations and Scalability
Zhuoyan Xu
Zhenmei Shi
Yingyu Liang
CoGe
LRM
431
55
0
22 Jul 2024
Enhancing Parameter Efficiency and Generalization in Large-Scale Models: A Regularized and Masked Low-Rank Adaptation Approach
Yuzhu Mao
Siqi Ping
Zihao Zhao
Yang Liu
Wenbo Ding
300
2
0
16 Jul 2024
A Survey on LoRA of Large Language Models
Yuren Mao
Yuhang Ge
Yijiang Fan
Wenyi Xu
Yu Mi
Zhonghao Hu
Yunjun Gao
ALM
716
131
0
08 Jul 2024
Compress then Serve: Serving Thousands of LoRA Adapters with Little Overhead
Rickard Brüel-Gabrielsson
Jiacheng Zhu
Onkar Bhardwaj
Leshem Choshen
Kristjan Greenewald
Mikhail Yurochkin
Justin Solomon
899
21
0
17 Jun 2024
Exploring Training on Heterogeneous Data with Mixture of Low-rank Adapters
International Conference on Machine Learning (ICML), 2024
Yuhang Zhou
Zihua Zhao
Haolin Li
Siyuan Du
Jiangchao Yao
Ya Zhang
Yanfeng Wang
MoMe
MoE
310
9
0
14 Jun 2024
Trans-LoRA
\textit{Trans-LoRA}
Trans-LoRA
: towards data-free Transferable Parameter Efficient Finetuning
Runqian Wang
Soumya Ghosh
David D. Cox
Diego Antognini
Aude Oliva
Rogerio Feris
Leonid Karlinsky
329
8
0
27 May 2024
Understanding Linear Probing then Fine-tuning Language Models from NTK Perspective
Akiyoshi Tomihari
Issei Sato
343
17
0
27 May 2024
LoRA Learns Less and Forgets Less
D. Biderman
Jose Javier Gonzalez Ortiz
Jacob P. Portes
Mansheej Paul
Philip Greengard
...
Sam Havens
Vitaliy Chiley
Jonathan Frankle
Cody Blakeney
John P. Cunningham
CLL
400
291
0
15 May 2024
1
2
Next
Page 1 of 2
