Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2106.09685
Cited By
v1
v2 (latest)
LoRA: Low-Rank Adaptation of Large Language Models
International Conference on Learning Representations (ICLR), 2021
17 June 2021
J. E. Hu
Yelong Shen
Phillip Wallis
Zeyuan Allen-Zhu
Yuanzhi Li
Shean Wang
Lu Wang
Weizhu Chen
OffRL
AI4TS
AI4CE
ALM
AIMat
Re-assign community
ArXiv (abs)
PDF
HTML
HuggingFace (49 upvotes)
Github (11998★)
Papers citing
"LoRA: Low-Rank Adaptation of Large Language Models"
50 / 8,615 papers shown
AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Models
Findings (Findings), 2023
Alexandra Chronopoulou
Matthew E. Peters
Kangyang Luo
Jesse Dodge
MoMe
419
87
0
14 Feb 2023
UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling
International Conference on Learning Representations (ICLR), 2023
Haoyu Lu
Yuqi Huo
Guoxing Yang
Zhiwu Lu
Wei Zhan
Masayoshi Tomizuka
Mingyu Ding
183
53
0
13 Feb 2023
Less is More: Selective Layer Finetuning with SubTuning
Gal Kaplun
Andrey Gurevich
Tal Swisa
Mazor David
Shai Shalev-Shwartz
Eran Malach
227
11
0
13 Feb 2023
Generalized Few-Shot Continual Learning with Contrastive Mixture of Adapters
Yawen Cui
Zitong Yu
Rizhao Cai
Xuna Wang
Alex C. Kot
Tianpeng Liu
CLL
219
8
0
12 Feb 2023
Adding Conditional Control to Text-to-Image Diffusion Models
IEEE International Conference on Computer Vision (ICCV), 2023
Lvmin Zhang
Anyi Rao
Maneesh Agrawala
AI4CE
942
5,843
1
10 Feb 2023
Is This Loss Informative? Faster Text-to-Image Customization by Tracking Objective Dynamics
Neural Information Processing Systems (NeurIPS), 2023
Anton Voronov
Mikhail Khoroshikh
Artem Babenko
Max Ryabinin
258
8
0
09 Feb 2023
UDApter -- Efficient Domain Adaptation Using Adapters
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
Bhavitvya Malik
Abhinav Ramesh Kashyap
MingSung Kan
Soujanya Poria
257
18
0
07 Feb 2023
AIM: Adapting Image Models for Efficient Video Action Recognition
International Conference on Learning Representations (ICLR), 2023
Taojiannan Yang
Yi Zhu
Yusheng Xie
Aston Zhang
Chong Chen
Mu Li
ViT
421
219
0
06 Feb 2023
On the Efficacy of Differentially Private Few-shot Image Classification
Marlon Tobaben
Aliaksandra Shysheya
J. Bronskill
Andrew Paverd
Shruti Tople
Santiago Zanella Béguelin
Richard Turner
Antti Honkela
412
16
0
02 Feb 2023
A Survey on Efficient Training of Transformers
International Joint Conference on Artificial Intelligence (IJCAI), 2023
Bohan Zhuang
Jing Liu
Zizheng Pan
Haoyu He
Yuetian Weng
Chunhua Shen
407
73
0
02 Feb 2023
An Empirical Study on the Transferability of Transformer Modules in Parameter-Efficient Fine-Tuning
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Mohammad AkbarTajari
S. Rajaee
Mohammad Taher Pilehvar
241
2
0
01 Feb 2023
FLAME: A small language model for spreadsheet formulas
AAAI Conference on Artificial Intelligence (AAAI), 2023
Harshit Joshi
Abishai Ebenezer
J. Cambronero
Sumit Gulwani
Aditya Kanade
Vu Le
Ivan Radivcek
Gust Verbruggen
LMTD
317
19
0
31 Jan 2023
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
International Conference on Machine Learning (ICML), 2023
Shayne Longpre
Le Hou
Tu Vu
Albert Webson
Hyung Won Chung
...
Denny Zhou
Quoc V. Le
Barret Zoph
Jason W. Wei
Adam Roberts
ALM
409
853
0
31 Jan 2023
Differentiable Entailment for Parameter Efficient Few Shot Learning
Ethan Kim
Jerry Yang
97
0
0
31 Jan 2023
Composer's Assistant: An Interactive Transformer for Multi-Track MIDI Infilling
International Society for Music Information Retrieval Conference (ISMIR), 2023
Martin E. Malandro
221
10
0
29 Jan 2023
AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
Transactions of the Association for Computational Linguistics (TACL), 2023
Han Zhou
Xingchen Wan
Ivan Vulić
Anna Korhonen
249
50
0
28 Jan 2023
Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases
International Conference on Machine Learning (ICML), 2023
Xiaoxia Wu
Cheng-rong Li
Reza Yazdani Aminabadi
Z. Yao
Yuxiong He
MQ
197
35
0
27 Jan 2023
Minimax Optimal Rate for Parameter Estimation in Multivariate Deviated Models
Neural Information Processing Systems (NeurIPS), 2023
Dat Do
Huy Nguyen
Khai Nguyen
Nhat Ho
165
5
0
27 Jan 2023
Probing Out-of-Distribution Robustness of Language Models with Parameter-Efficient Transfer Learning
Hyunsoo Cho
Choonghyun Park
Junyeop Kim
Sungmin Cho
Kang Min Yoo
Sang-goo Lee
OODD
296
3
0
27 Jan 2023
Low-Rank Winograd Transformation for 3D Convolutional Neural Networks
Science China Information Sciences (Sci China Inf Sci), 2023
Ziran Qin
Mingbao Lin
Weiyao Lin
3DPC
181
3
0
26 Jan 2023
BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation
AAAI Conference on Artificial Intelligence (AAAI), 2023
Xiangyu Qin
Zhiyu Wu
J. Cui
Ting Zhang
Yanran Li
Jian Luan
Bin Wang
L. xilinx Wang
180
39
0
17 Jan 2023
Recommending Root-Cause and Mitigation Steps for Cloud Incidents using Large Language Models
International Conference on Software Engineering (ICSE), 2023
Toufique Ahmed
Supriyo Ghosh
Chetan Bansal
Thomas Zimmermann
Xuchao Zhang
Saravan Rajmohan
AI4CE
177
80
0
10 Jan 2023
A Survey on Transformers in Reinforcement Learning
Wenzhe Li
Hao Luo
Zichuan Lin
Chongjie Zhang
Zongqing Lu
Deheng Ye
OffRL
MU
AI4CE
545
72
0
08 Jan 2023
ANNA: Abstractive Text-to-Image Synthesis with Filtered News Captions
Aashish Anantha Ramakrishnan
Sharon X. Huang
Dongwon Lee
270
6
0
05 Jan 2023
Parameter-Efficient Fine-Tuning Design Spaces
International Conference on Learning Representations (ICLR), 2023
Jiaao Chen
Aston Zhang
Xingjian Shi
Mu Li
Alexander J. Smola
Diyi Yang
280
77
0
04 Jan 2023
Principled and Efficient Transfer Learning of Deep Models via Neural Collapse
Xiao Li
Sheng Liu
Jin-li Zhou
Xin Lu
C. Fernandez‐Granda
Zhihui Zhu
Q. Qu
AAML
439
22
0
23 Dec 2022
Infrared Image Super-Resolution: Systematic Review, and Future Trends
Y. Huang
Tomo Miyazaki
Xiao-Fang Liu
S. Omachi
SupR
665
17
0
22 Dec 2022
SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning
M Saiful Bari
Aston Zhang
Shuai Zheng
Xingjian Shi
Yi Zhu
Shafiq Joty
Mu Li
RALM
VLM
VPVLM
LRM
198
5
0
21 Dec 2022
KronA: Parameter Efficient Tuning with Kronecker Adapter
Ali Edalati
Marzieh S. Tahaei
I. Kobyzev
V. Nia
J. Clark
Mehdi Rezagholizadeh
231
136
0
20 Dec 2022
Evaluating Psychological Safety of Large Language Models
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Xingxuan Li
Yutong Li
Linlin Liu
Shafiq Joty
Lidong Bing
LM&MA
232
32
0
20 Dec 2022
Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Kelly Marchisio
Patrick Lewis
Yihong Chen
Mikel Artetxe
265
28
0
20 Dec 2022
HINT: Hypernetwork Instruction Tuning for Efficient Zero- & Few-Shot Generalisation
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Michal Guerquin
Akshita Bhagia
Yizhong Wang
Hannaneh Hajishirzi
Matthew E. Peters
302
24
0
20 Dec 2022
Large Language Models Are Reasoning Teachers
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Namgyu Ho
Laura Schmid
Se-Young Yun
ReLM
ELM
LRM
359
439
0
20 Dec 2022
When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning Methods
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Zhuo Zhang
Yuanhang Yang
Yong Dai
Zhuang Li
Zenglin Xu
FedML
406
113
0
20 Dec 2022
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Zheng-Xin Yong
Hailey Schoelkopf
Niklas Muennighoff
Alham Fikri Aji
David Ifeoluwa Adelani
...
Genta Indra Winata
Stella Biderman
Edward Raff
Dragomir R. Radev
Vassilina Nikoulina
CLL
VLM
AI4CE
LRM
386
106
0
19 Dec 2022
An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text Generation
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Xuancheng Huang
Zijun Liu
Peng Li
Tao Li
Maosong Sun
Yang Liu
218
12
0
19 Dec 2022
Decoder Tuning: Efficient Language Understanding as Decoding
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Ganqu Cui
Wentao Li
Ning Ding
Longtao Huang
Zhiyuan Liu
Maosong Sun
203
7
0
16 Dec 2022
Vision Transformers are Parameter-Efficient Audio-Visual Learners
Computer Vision and Pattern Recognition (CVPR), 2022
Yan-Bo Lin
Yi-Lin Sung
Jie Lei
Joey Tianyi Zhou
Gedas Bertasius
321
108
0
15 Dec 2022
Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining
International Conference on Machine Learning (ICML), 2022
Florian Tramèr
Gautam Kamath
Nicholas Carlini
SILM
400
96
0
13 Dec 2022
Towards Practical Plug-and-Play Diffusion Models
Computer Vision and Pattern Recognition (CVPR), 2022
Hyojun Go
Yunsung Lee
Jin-Young Kim
Seunghyun Lee
Myeongho Jeong
Hyun Seung Lee
Seungtaek Choi
DiffM
312
21
0
12 Dec 2022
Parameter-Efficient Finetuning of Transformers for Source Code
Shamil Ayupov
Nadezhda Chirkova
80
22
0
12 Dec 2022
Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarization
Yiwei Qin
Graham Neubig
Pengfei Liu
155
4
0
12 Dec 2022
Multi-Concept Customization of Text-to-Image Diffusion
Computer Vision and Pattern Recognition (CVPR), 2022
Nupur Kumari
Bin Zhang
Richard Y. Zhang
Eli Shechtman
Jun-Yan Zhu
737
1,168
0
08 Dec 2022
FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer
AAAI Conference on Artificial Intelligence (AAAI), 2022
Shibo Jie
Zhi-Hong Deng
240
162
0
06 Dec 2022
ADIR: Adaptive Diffusion for Image Reconstruction
Shady Abu Hussein
Tom Tirer
Raja Giryes
DiffM
254
25
0
06 Dec 2022
Exploring the Limits of Differentially Private Deep Learning with Group-wise Clipping
International Conference on Learning Representations (ICLR), 2022
Jiyan He
Xuechen Li
Da Yu
Huishuai Zhang
Janardhan Kulkarni
Y. Lee
A. Backurs
Nenghai Yu
Jiang Bian
350
58
0
03 Dec 2022
SumREN: Summarizing Reported Speech about Events in News
AAAI Conference on Artificial Intelligence (AAAI), 2022
R. Reddy
Heba Elfardy
Hou Pong Chan
Kevin Small
Chenhui Xu
209
5
0
02 Dec 2022
Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning
North American Chapter of the Association for Computational Linguistics (NAACL), 2022
Shih-Cheng Huang
Shi Wang
Min-Han Shih
Saurav Sahay
Hung-yi Lee
141
0
0
02 Dec 2022
Data-Efficient Finetuning Using Cross-Task Nearest Neighbors
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Michal Guerquin
Noah A. Smith
Hannaneh Hajishirzi
Pradeep Dasigi
328
30
0
01 Dec 2022
Learning Label Modular Prompts for Text Classification in the Wild
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Hailin Chen
Amrita Saha
Shafiq Joty
Steven C. H. Hoi
OOD
VLM
255
5
0
30 Nov 2022
Previous
1
2
3
...
168
169
170
171
172
173
Next
Page 169 of 173
Page
of 173
Go
