Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2012.13255
Cited By
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning
Annual Meeting of the Association for Computational Linguistics (ACL), 2020
22 December 2020
Armen Aghajanyan
Luke Zettlemoyer
Sonal Gupta
Re-assign community
ArXiv (abs)
PDF
HTML
HuggingFace (5 upvotes)
Papers citing
"Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning"
50 / 423 papers shown
Decomposed Trust: Exploring Privacy, Adversarial Robustness, Fairness, and Ethics of Low-Rank LLMs
Daniel Agyei Asante
Md Mokarram Chowdhury
Yang Li
152
0
0
27 Nov 2025
Geometry of Decision Making in Language Models
Abhinav Joshi
Divyanshu Bhatt
Ashutosh Modi
AI4CE
LRM
332
3
0
25 Nov 2025
Unveiling Intrinsic Dimension of Texts: from Academic Abstract to Creative Story
Vladislav Pedashenko
Laida Kushnareva
Yana Khassan Nibal
Eduard Tulchinskii
Kristian Kuznetsov
Vladislav Zharchinskii
Yury Maximov
Irina Piontkovskaya
240
0
0
19 Nov 2025
FPS: Feedforward-based Parameter Selection For Efficient Fine-Tuning
Kenneth Yang
Wen-Li Wei
Jen-Chun Lin
151
0
0
31 Oct 2025
1+1>2: A Synergistic Sparse and Low-Rank Compression Method for Large Language Models
Zeliang Zong
Kai Zhang
Zheyang Li
Wenming Tan
Ye Ren
Yiyan Zhai
Jilin Hu
170
0
0
30 Oct 2025
Sequences of Logits Reveal the Low Rank Structure of Language Models
Noah Golowich
Allen Liu
Abhishek Shetty
117
4
0
28 Oct 2025
Beyond Hidden-Layer Manipulation: Semantically-Aware Logit Interventions for Debiasing LLMs
Wei Xia
130
0
0
25 Oct 2025
Emotions Where Art Thou: Understanding and Characterizing the Emotional Latent Space of Large Language Models
Benjamin Z. Reichman
Adar Avsian
Larry Heck
192
3
0
24 Oct 2025
REx86: A Local Large Language Model for Assisting in x86 Assembly Reverse Engineering
Darrin Lea
James M Ghawaly
Golden Richard III
Aisha Ali-Gombe
Andrew Case
146
0
0
23 Oct 2025
GaLLoP: Gradient-based Sparse Learning on Low-Magnitude Parameters
Anand Choudhary
Yasser Sulaıman
Lukas Mauch
G. B. Hacene
Fabien Cardinaux
Antoine Bosselut
211
0
0
22 Oct 2025
Latent Space Factorization in LoRA
Shashi Kumar
Yacouba Kaloga
John Mitros
P. Motlícek
Ina Kodrasi
141
0
0
22 Oct 2025
A Guardrail for Safety Preservation: When Safety-Sensitive Subspace Meets Harmful-Resistant Null-Space
Bingjie Zhang
Yibo Yang
Renzhe
Dandan Guo
Jindong Gu
Philip Torr
Bernard Ghanem
327
3
0
16 Oct 2025
Where to Search: Measure the Prior-Structured Search Space of LLM Agents
Zhuo-Yang Song
294
0
0
16 Oct 2025
Narrow Finetuning Leaves Clearly Readable Traces in Activation Differences
Julian Minder
Clement Dumas
Stewart Slocum
Helena Casademunt
Cameron Holmes
Robert West
Neel Nanda
191
6
0
14 Oct 2025
Compressibility Measures Complexity: Minimum Description Length Meets Singular Learning Theory
Einar Urdshals
Edmund Lau
Jesse Hoogland
Stan van Wingerden
Daniel Murfet
149
3
0
14 Oct 2025
LightSAE: Parameter-Efficient and Heterogeneity-Aware Embedding for IoT Multivariate Time Series Forecasting
Yi Ren
Xinjie Yu
AI4TS
131
0
0
12 Oct 2025
ADEPT: Continual Pretraining via Adaptive Expansion and Dynamic Decoupled Tuning
Jinyang Zhang
Yue Fang
Hongxin Ding
Weibin Liao
Muyang Ye
Xu Chu
Junfeng Zhao
Yasha Wang
CLL
176
0
0
11 Oct 2025
Efficient Resource-Constrained Training of Transformers via Subspace Optimization
Le-Trung Nguyen
Enzo Tartaglione
Van-Tam Nguyen
184
0
0
10 Oct 2025
FedQS: Optimizing Gradient and Model Aggregation for Semi-Asynchronous Federated Learning
Yunbo Li
Jiaping Gui
Zhihang Deng
Fanchao Meng
Yue Wu
FedML
401
12
0
09 Oct 2025
Gold-Switch: Training-Free Superposition of Slow- and Fast- Thinking LLMs
Jaeseong Lee
Dayoung Kwon
Seung-won Hwang
OffRL
LRM
123
0
0
08 Oct 2025
FT-MDT: Extracting Decision Trees from Medical Texts via a Novel Low-rank Adaptation Method
Yuheng Li
Jiechao Gao
Wei Han
Wenwen Ouyang
Wei Zhu
Hui Yi Leong
OffRL
AI4CE
293
6
0
06 Oct 2025
Adapting SAM with Dynamic Similarity Graphs for Few-Shot Parameter-Efficient Small Dense Object Detection: A Case Study of Chickpea Pods in Field Conditions
Xintong Jiang
Yixue Liu
Mohamed Debbagh
Yu Tian
Valerio Hoyos-Villegas
Viacheslav Adamchuk
Shangpeng Sun
162
0
0
30 Sep 2025
Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning
Xin Qiu
Yulu Gan
Conor F. Hayes
Qiyao Liang
Elliot Meyerson
Babak Hodjat
Risto Miikkulainen
Babak Hodjat
Risto Miikkulainen
275
13
0
29 Sep 2025
Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs
Hao Ban
Kaiyi Ji
MoE
204
1
0
29 Sep 2025
Towards Understanding the Shape of Representations in Protein Language Models
Kosio Beshkov
Anders Malthe-Sørenssen
248
1
0
29 Sep 2025
Does Weak-to-strong Generalization Happen under Spurious Correlations?
Chenruo Liu
Yijun Dong
Qi Lei
191
0
0
28 Sep 2025
Dynamic Orthogonal Continual Fine-tuning for Mitigating Catastrophic Forgettings
Zhixin Zhang
Zeming Wei
Meng Sun
CLL
213
0
0
28 Sep 2025
Rule-Based Reinforcement Learning for Document Image Classification with Vision Language Models
Michael Jungo
Andreas Fischer
115
0
0
26 Sep 2025
DEFT: Decompositional Efficient Fine-Tuning for Text-to-Image Models
Komal Kumar
Rao Muhammad Anwer
Fahad Shahbaz Khan
Salman Khan
Ivan Laptev
Hisham Cholakkal
139
0
0
26 Sep 2025
Enhancing Low-Rank Adaptation with Structured Nonlinear Transformations
Guanzhi Deng
Mingyang Liu
Dapeng Wu
Y. Li
Linqi Song
AI4CE
163
1
0
26 Sep 2025
Fine-tuning of Large Language Models for Domain-Specific Cybersecurity Knowledge
Yuan Huang
123
1
0
25 Sep 2025
MORPH: PDE Foundation Models with Arbitrary Data Modality
Mahindra Singh Rautela
Alexander Buschmann Most
Siddharth Mansingh
Bradley Love
Ayan Biswas
Diane Oyen
Earl Lawrence
Earl Lawrence
Ayan Biswas
AI4TS
AI4CE
379
0
0
25 Sep 2025
CR-Net: Scaling Parameter-Efficient Training with Cross-Layer Low-Rank Structure
Boao Kong
Junzhu Liang
Yuxi Liu
Renjia Deng
Kun Yuan
215
2
0
23 Sep 2025
HyperAdapt: Simple High-Rank Adaptation
Abel Gurung
Joseph Campbell
202
0
0
23 Sep 2025
Distribution-Aligned Decoding for Efficient LLM Task Adaptation
Senkang Hu
Xudong Han
Jinqi Jiang
Yihang Tao
Zihan Fang
Yong Dai
Sam Kwong
Yuguang Fang
287
5
0
19 Sep 2025
Explicit vs. Implicit Biographies: Evaluating and Adapting LLM Information Extraction on Wikidata-Derived Texts
Alessandra Stramiglio
Andrea Schimmenti
Valentina Pasqual
M. Erp
Francesco Sovrano
F. Vitali
117
0
0
18 Sep 2025
Trade-offs in Cross-Domain Generalization of Foundation Model Fine-Tuned for Biometric Applications
Tahar Chettaoui
Naser Damer
Fadi Boutros
CVBM
VLM
283
0
0
18 Sep 2025
Investigating ReLoRA: Effects on the Learning Dynamics of Small Language Models
Yuval Weiss
David Demitri Africa
P. Buttery
Richard Diehl Martinez
301
0
0
16 Sep 2025
Sensitivity-LoRA: Low-Load Sensitivity-Based Fine-Tuning for Large Language Models
Hao Zhang
Bo Huang
Ruoyao Xiao
Xi Xiao
Hui Yi Leong
Zumeng Zhang
Xinwei Long
Tianyang Wang
Hao Xu
172
15
0
11 Sep 2025
RL Fine-Tuning Heals OOD Forgetting in SFT
Hangzhan Jin
Sitao Luan
Sicheng Lyu
Guillaume Rabusseau
Reihaneh Rabbany
Doina Precup
Mohammad Hamdaqa
CLL
LRM
218
10
0
08 Sep 2025
Singular Value Few-shot Adaptation of Vision-Language Models
Taha Koleilat
H. Rivaz
Yiming Xiao
VLM
303
1
0
03 Sep 2025
FediLoRA: Heterogeneous LoRA for Federated Multimodal Fine-tuning under Missing Modalities
L. Yang
Nam Kha Nguygen
Po Hu
Wei Emma Zhang
Yanjun Shu
Mong Yuan Sim
Weitong Chen
195
2
0
01 Sep 2025
Rethinking Layer-wise Model Merging through Chain of Merges
Pietro Buzzega
Riccardo Salami
Angelo Porrello
Simone Calderara
MoMe
AI4CE
234
1
0
29 Aug 2025
Weights-Rotated Preference Optimization for Large Language Models
Chenxu Yang
Ruipeng Jia
Mingyu Zheng
Naibin Gu
Zheng Lin
Siyuan Chen
Weichong Yin
Hua Wu
Weiping Wang
178
1
0
25 Aug 2025
EndoUFM: Utilizing Foundation Models for Monocular depth estimation of endoscopic images
Dan Si
Bo Liu
Bojian Li
Jingjing Wang
Jinghua Yue
F. Zhou
MDE
120
1
0
25 Aug 2025
Exploring Efficient Learning of Small BERT Networks with LoRA and DoRA
Daniel Frees
Aditri Bhagirath
Moritz Bolling
OffRL
88
0
0
25 Aug 2025
Unbiased Reasoning for Knowledge-Intensive Tasks in Large Language Models via Conditional Front-Door Adjustment
Bo Zhao
Yinghao Zhang
Ziqi Xu
Yongli Ren
Xiuzhen Zhang
R. Luo
Zaiwen Feng
Feng Xia
KELM
LRM
233
5
0
23 Aug 2025
RL Is Neither a Panacea Nor a Mirage: Understanding Supervised vs. Reinforcement Learning Fine-Tuning for LLMs
Hangzhan Jin
Sicheng Lv
Sifan Wu
Mohammad Hamdaqa
195
11
0
22 Aug 2025
Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules
Yilun Liu
Yunpu Ma
Yuetian Lu
Shuo Chen
Zifeng Ding
Volker Tresp
MoE
150
0
0
04 Aug 2025
The Impact of Fine-tuning Large Language Models on Automated Program Repair
Roman Macháček
Anastasiia Grishina
Max Hort
Leon Moonen
274
1
0
26 Jul 2025
1
2
3
4
5
6
7
8
9
Next
Page 1 of 9
