Title
LARGO: Low-Rank Regulated Gradient Projection for Robust Parameter Efficient Fine-Tuning Haotian Zhang Liu Liu Baosheng Yu Jiayan Qiu Yanwei Ren Xianglong Liu 186 0 0 14 Jun 2025
SOFT: Selective Data Obfuscation for Protecting LLM Fine-tuning against Membership Inference Attacks Kaiyuan Zhang Siyuan Cheng Hanxi Guo Yuetian Chen Zian Su ... Yuntao Du Charles Fleming Jayanth Srinivasa Xiangyu Zhang Ninghui Li AAML 364 6 0 12 Jun 2025
Inverting Black-Box Face Recognition Systems via Zero-Order Optimization in Eigenface Space Anton Razzhigaev Matvey Mikhalchuk Klim Kireev Igor Udovichenko Andrey Kuznetsov Aleksandr Petiushko 250 9 0 11 Jun 2025
MLorc: Momentum Low-rank Compression for Memory Efficient Large Language Model Adaptation Wei Shen Zhang Yaxiang Minhui Huang Mengfan Xu Jiawei Zhang Cong Shen AI4CE 313 1 0 02 Jun 2025
Diff2Flow: Training Flow Matching Models via Diffusion Model AlignmentComputer Vision and Pattern Recognition (CVPR), 2025 Johannes Schusterbauer Ming Gui Frank Fundel Bjorn Ommer 215 10 0 02 Jun 2025
LIFT the Veil for the Truth: Principal Weights Emerge after Rank Reduction for Reasoning-Focused Supervised Fine-Tuning Zihang Liu Tianyu Pang Oleg Balabanov Chaoqun Yang Tianjin Huang L. Yin Yaoqing Yang Shiwei Liu LRM 208 4 0 01 Jun 2025
Leave it to the Specialist: Repair Sparse LLMs with Sparse Fine-Tuning via Sparsity Evolution Q. Xiao Alan Ansell Boqian Wu Lu Yin Mykola Pechenizkiy Shiwei Liu Decebal Constantin Mocanu 259 2 0 29 May 2025
LoFT: Low-Rank Adaptation That Behaves Like Full Fine-Tuning Nurbek Tastan Stefanos Laskaridis Martin Takáč Karthik Nandakumar Samuel Horváth AI4CE 204 4 0 27 May 2025
GraLoRA: Granular Low-Rank Adaptation for Parameter-Efficient Fine-Tuning Yeonjoon Jung Daehyun Ahn Hyungjun Kim Taesu Kim Eunhyeok Park 166 1 0 26 May 2025
Context-Free Synthetic Data Mitigates Forgetting Parikshit Bansal Sujay Sanghavi CLL 336 1 0 20 May 2025
Shadow-FT: Tuning Instruct Model via Training on Paired Base Model Taiqiang Wu Runming Yang Jiayi Li Pengfei Hu Ngai Wong Ngai Wong Yujiu Yang 671 1 0 19 May 2025
PSC: Extending Context Window of Large Language Models via Phase Shift CalibrationConference on Empirical Methods in Natural Language Processing (EMNLP), 2025 Wenqiao Zhu Chao Xu Lulu Wang Jun Wu 234 2 0 18 May 2025
ExpertSteer: Intervening in LLMs through Expert Knowledge Weixuan Wang Minghao Wu Barry Haddow Alexandra Birch LLMSV 491 1 0 18 May 2025
Achieving Scalable Robot Autonomy via neurosymbolic planning using lightweight local LLM Nicholas Attolino Alessio Capitanelli Fulvio Mastrogiovanni 325 0 0 13 May 2025
Memorization and Knowledge Injection in Gated LLMs Xu Pan Ely Hahami Zechen Zhang H. Sompolinsky KELM CLL RALM 313 3 0 30 Apr 2025
KETCHUP: K-Step Return Estimation for Sequential Knowledge Distillation Jiabin Fan Guoqing Luo Michael Bowling Lili Mou OffRL 399 0 0 26 Apr 2025
CSPLADE: Learned Sparse Retrieval with Causal Language Models Zhichao Xu Aosong Feng Yijun Tian Haibo Ding Lin Leee Cheong RALM 426 7 0 15 Apr 2025
GeoUni: A Unified Model for Generating Geometry Diagrams, Problems and Problem Solutions Jo-Ku Cheng Zeren Zhang Ran Chen Jingyang Deng Ziran Qin Jinwen Ma 315 6 0 14 Apr 2025
Revisiting Funnel Transformers for Modern LLM Architectures with Comprehensive Ablations in Training and Inference Configurations DongHyun Choi Lucas Spangher Chris Hidey Peter Grabowski Ramy Eskander AI4CE 267 2 0 02 Apr 2025
Reasoning Beyond Limits: Advances and Open Problems for LLMsICT express (ICT Express), 2025 M. Ferrag Norbert Tihanyi Merouane Debbah OffRL LRM AI4CE ELM 796 17 0 26 Mar 2025
DeLoRA: Decoupling Angles and Strength in Low-rank AdaptationInternational Conference on Learning Representations (ICLR), 2025 Massimo Bini Leander Girrbach Zeynep Akata 463 5 0 23 Mar 2025
LoRASculpt: Sculpting LoRA for Harmonizing General and Specialized Knowledge in Multimodal Large Language ModelsComputer Vision and Pattern Recognition (CVPR), 2025 Jian Liang Wenke Huang Guancheng Wan Qu Yang Mang Ye MoMe CLL AI4CE 308 11 0 21 Mar 2025
Towards Automatic Continual Learning: A Self-Adaptive Framework for Continual Instruction Tuning Peiyi Lin Fukai Zhang Kai Niu Hao Fu CLL 289 0 0 20 Mar 2025
ClusComp: A Simple Paradigm for Model Compression and Efficient FinetuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Baohao Liao Christian Herold Seyyed Hadi Hashemi Stefan Vasilev Shahram Khadivi Christof Monz MQ 332 1 0 17 Mar 2025
RaSA: Rank-Sharing Low-Rank AdaptationInternational Conference on Learning Representations (ICLR), 2025 Zhiwei He Zhaopeng Tu Xing Wang Xingyu Chen Zhaoxiang Wang Jiahao Xu Tian Liang Wenxiang Jiao Zizhuo Zhang Rui Wang ALM 317 4 0 16 Mar 2025
KSOD: Knowledge Supplement for LLMs On Demand Haoran Li Junfeng Hu 289 0 0 10 Mar 2025
From Style to Facts: Mapping the Boundaries of Knowledge Injection with Finetuning Eric Zhao Pranjal Awasthi Nika Haghtalab 172 4 0 07 Mar 2025
Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Model Wenke Huang Jian Liang Xianda Guo Yiyang Fang Guancheng Wan ... Bin Yang He Li Jiawei Shao Mang Ye Di Lin OffRL LRM MLLM KELM VLM 330 8 0 06 Mar 2025
LoRA-Null: Low-Rank Adaptation via Null Space for Large Language Models Pengwei Tang Zichen Liu Dongjie Zhang Xing Wu Debing Zhang 287 5 0 04 Mar 2025
Privacy and Accuracy-Aware AI/ML Model Deduplication Hong Guan Lei Yu Lixi Zhou Li Xiong Kanchan Chowdhury Lulu Xie Xusheng Xiao Jia Zou 216 1 0 04 Mar 2025
Towards hyperparameter-free optimization with differential privacyInternational Conference on Learning Representations (ICLR), 2025 Zhiqi Bu Ruixuan Liu 242 7 0 02 Mar 2025
Chitranuvad: Adapting Multi-Lingual LLMs for Multimodal TranslationConference on Machine Translation (WMT), 2025 Shaharukh Khan Ayush Tarun Ali Faraz Palash Kamble Vivek Dahiya Praveen Kumar Pokala Ashish Kulkarni Chandra Khatri Abhinav Ravi Shubham Agarwal 878 6 0 27 Feb 2025
Norm Growth and Stability Challenges in Localized Sequential Knowledge Editing Akshat Gupta Christine Fang Atahan Ozdemir Maochuan Lu Ahmed Alaa Thomas Hartvigsen Gopala Anumanchipalli KELM 271 0 0 26 Feb 2025
Pastiche Novel Generation Creating: Fan Fiction You Love in Your Favorite Author's Style Xueran Han Yuhan Liu Mingzhe Li Wen Liu Sen Hu Rui Yan Zhiqiang Xu Preslav Nakov 228 0 0 24 Feb 2025
Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignment Chenghao Fan Zhenyi Lu Sichen Liu Xiaoye Qu Xiaoye Qu Wei Wei Yu Cheng MoE 1.1K 9 0 24 Feb 2025
Multi-Attribute Steering of Language Models via Targeted InterventionAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Duy Nguyen Archiki Prasad Elias Stengel-Eskin Joey Tianyi Zhou LLMSV 369 12 0 18 Feb 2025
Vision-Language In-Context Learning Driven Few-Shot Visual Inspection Model Shiryu Ueno Yoshikazu Hayashi Shunsuke Nakatsuka Yusei Yamada Hiroaki Aizawa K. Kato MLLM VLM 374 1 0 13 Feb 2025
GoRA: Gradient-driven Adaptive Low Rank Adaptation Haonan He Peng Ye Yuchen Ren Yuan Yuan Luyang Zhou Shucun Ju Lei Chen AI4TS AI4CE 1.1K 3 0 13 Feb 2025
Unleashing the Potential of Pre-Trained Diffusion Models for Generalizable Person Re-IdentificationItalian National Conference on Sensors (INS), 2025 Jiachen Li Xiaojin Gong DiffM 571 3 0 10 Feb 2025
Fine Tuning without Catastrophic Forgetting via Selective Low Rank Adaptation Reza Akbarian Bafghi Carden Bagwell Avinash Ravichandran Ashish Shrivastava M. Raissi 240 4 0 28 Jan 2025
AgroGPT: Efficient Agricultural Vision-Language Model with Expert TuningIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024 Muhammad Awais Ali Husain Salem Abdulla Alharthi Amandeep Kumar Hisham Cholakkal Rao Muhammad Anwer VLM 387 18 0 10 Jan 2025
Domain-adaptative Continual Learning for Low-resource Tasks: Evaluation on Nepali Sharad Duwal Suraj Prasai Suresh Manandhar CLL 267 3 0 18 Dec 2024
SusGen-GPT: A Data-Centric LLM for Financial NLP and Sustainability Report Generation Qilong Wu Xiaoneng Xiang Hejia Huang Xuan Wang Yeo Wei Jie Frank Xing Ricardo Shirota Filho Bharadwaj Veeravalli 339 7 0 14 Dec 2024
Distillation of Diffusion Features for Semantic CorrespondenceIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024 Frank Fundel Johannes Schusterbauer Vincent Tao Hu Bjorn Ommer DiffM 431 12 0 04 Dec 2024
Adaptive Rank, Reduced Forgetting: Knowledge Retention in Continual Learning Vision-Language Models with Dynamic Rank-Selective LoRA Haodong Lu Chongyang Zhao Jason Xue Lina Yao Kristen Moore Dong Gong CLL KELM VLM 795 16 0 01 Dec 2024
COAP: Memory-Efficient Training with Correlation-Aware Gradient ProjectionComputer Vision and Pattern Recognition (CVPR), 2024 Jinqi Xiao S. Sang Tiancheng Zhi Jing Liu Qing Yan Linjie Luo Bo Yuan Bo Yuan VLM 395 6 0 26 Nov 2024
Efficient and Private: Memorisation under differentially private parameter-efficient fine-tuning in language models Olivia Ma Jonathan Passerat-Palmbach Dmitrii Usynin 346 2 0 24 Nov 2024
Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptation Ayan Sengupta Vaibhav Seth Arinjay Pathak Aastha Verma Natraj Raman Sriram Gopalakrishnan Niladri Chatterjee Tanmoy Chakraborty BDL 438 3 0 07 Nov 2024
Is Multiple Object Tracking a Matter of Specialization?Neural Information Processing Systems (NeurIPS), 2024 Gianluca Mancusi Mattia Bernardi Aniello Panariello Angelo Porrello Rita Cucchiara Simone Calderara MoMe 301 4 0 01 Nov 2024
LoRA vs Full Fine-tuning: An Illusion of Equivalence Reece Shuttleworth Jacob Andreas Antonio Torralba Pratyusha Sharma 440 51 0 28 Oct 2024

All Papers

LoRA Learns Less and Forgets Less

Papers citing "LoRA Learns Less and Forgets Less"