 PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuningInternational Conference on Computational Linguistics (COLING), 2024 |
 Improving Model Fusion by Training-time Neuron Alignment with Fixed Neuron AnchorsIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024 |
 Identifying Policy Gradient SubspacesInternational Conference on Learning Representations (ICLR), 2024 |
 Fine-tuning Happens in Tiny Subspaces: Exploring Intrinsic Task-specific
Subspaces of Pre-trained Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 |
 PGrad: Learning Principal Gradients For Domain GeneralizationInternational Conference on Learning Representations (ICLR), 2023 |
 Kernel Modulation: A Parameter-Efficient Method for Training
Convolutional Neural NetworksInternational Conference on Pattern Recognition (ICPR), 2022 |
