ThanoRA: Task Heterogeneity-Aware Multi-Task Low-Rank Adaptation

v1v2 (latest)

ThanoRA: Task Heterogeneity-Aware Multi-Task Low-Rank Adaptation

24 May 2025

ArXiv (abs)PDF HTML Github (10★)

Papers citing "ThanoRA: Task Heterogeneity-Aware Multi-Task Low-Rank Adaptation"

5 / 5 papers shown

Title
Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs Hao Ban Kaiyi Ji MoE 109 0 0 29 Sep 2025
LoRASculpt: Sculpting LoRA for Harmonizing General and Specialized Knowledge in Multimodal Large Language ModelsComputer Vision and Pattern Recognition (CVPR), 2025 Jian Liang Wenke Huang Guancheng Wan Qu Yang Mang Ye MoMe CLL AI4CE 236 11 0 21 Mar 2025
Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning Ziyu Zhao Yixiao Zhou Didi Zhu Zhenyuan Zhang Xinze Wang ... Leilei Gan Minqin Zhu Zhongyu Wei Fei Wu Yu Cheng MoE MoMe 302 9 0 25 Jan 2025
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuningNeural Information Processing Systems (NeurIPS), 2024 Yibo Yang Xiaojie Li Zhongzhu Zhou Shuaiwen Leon Song Yue Yu Liqiang Nie Guohao Li 247 24 0 07 Jun 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language ModelsNeural Information Processing Systems (NeurIPS), 2024 Fanxu Meng Zhaohui Wang Muhan Zhang VLM 412 184 0 03 Apr 2024