ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2305.17446
  4. Cited By
Fine-tuning Happens in Tiny Subspaces: Exploring Intrinsic Task-specific
  Subspaces of Pre-trained Language Models
v1v2 (latest)

Fine-tuning Happens in Tiny Subspaces: Exploring Intrinsic Task-specific Subspaces of Pre-trained Language Models

Annual Meeting of the Association for Computational Linguistics (ACL), 2023
27 May 2023
Zhong Zhang
Bang Liu
Junming Shao
ArXiv (abs)PDFHTML

Papers citing "Fine-tuning Happens in Tiny Subspaces: Exploring Intrinsic Task-specific Subspaces of Pre-trained Language Models"

7 / 7 papers shown
Title
Shared Parameter Subspaces and Cross-Task Linearity in Emergently Misaligned Behavior
Shared Parameter Subspaces and Cross-Task Linearity in Emergently Misaligned Behavior
Daniel Aarao Reis Arturi
Eric Zhang
Andrew Ansah
Kevin Zhu
Ashwinee Panda
Aishwarya Balwani
65
0
0
03 Nov 2025
DREAM: Scalable Red Teaming for Text-to-Image Generative Systems via Distribution Modeling
DREAM: Scalable Red Teaming for Text-to-Image Generative Systems via Distribution Modeling
Boheng Li
Junjie Wang
Yiming Li
Zhiyang Hu
Leyi Qi
Jianshuo Dong
Run Wang
Han Qiu
Zhan Qin
Tianwei Zhang
142
1
0
22 Jul 2025
Parameter Efficient Fine-tuning via Explained Variance Adaptation
Parameter Efficient Fine-tuning via Explained Variance Adaptation
Fabian Paischer
Lukas Hauzenberger
Thomas Schmied
Benedikt Alkin
Marc Peter Deisenroth
Sepp Hochreiter
265
3
0
09 Oct 2024
Geometric Signatures of Compositionality Across a Language Model's Lifetime
Geometric Signatures of Compositionality Across a Language Model's LifetimeAnnual Meeting of the Association for Computational Linguistics (ACL), 2024
Jin Hwa Lee
Thomas Jiralerspong
Lei Yu
Yoshua Bengio
Emily Cheng
CoGe
529
8
0
02 Oct 2024
Unlocking Efficiency: Adaptive Masking for Gene Transformer Models
Unlocking Efficiency: Adaptive Masking for Gene Transformer ModelsEuropean Conference on Artificial Intelligence (ECAI), 2024
Soumyadeep Roy
S. Sural
Niloy Ganguly
MedIm
149
2
0
13 Aug 2024
Compressible Dynamics in Deep Overparameterized Low-Rank Learning &
  Adaptation
Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation
Can Yaras
Peng Wang
Laura Balzano
Qing Qu
AI4CE
174
21
0
06 Jun 2024
Emergence of a High-Dimensional Abstraction Phase in Language Transformers
Emergence of a High-Dimensional Abstraction Phase in Language Transformers
Emily Cheng
Diego Doimo
Corentin Kervadec
Iuri Macocco
Jade Yu
Alessandro Laio
Marco Baroni
573
28
0
24 May 2024
1