AdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learning

28 November 2022

Ximei Wang

Li Shen

Papers citing "AdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learning"

21 / 21 papers shown

Title
CAT Merging: A Training-Free Approach for Resolving Conflicts in Model Merging Wenju Sun Qingyong Li Yangli-ao Geng Boyang Li MoMe 26 0 0 11 May 2025
xMTF: A Formula-Free Model for Reinforcement-Learning-Based Multi-Task Fusion in Recommender Systems Yang Cao Changhao Zhang Xiaoshuang Chen Kaiqiao Zhan Ben Wang 21 0 0 08 Apr 2025
PiKE: Adaptive Data Mixing for Multi-Task Learning Under Low Gradient Conflicts Zeman Li Yuan Deng Peilin Zhong Meisam Razaviyayn Vahab Mirrokni MoMe 75 1 0 10 Feb 2025
Task Arithmetic in Trust Region: A Training-Free Model Merging Approach to Navigate Knowledge Conflicts Wenju Sun Qingyong Li Wen Wang Yangli-ao Geng Boyang Li 36 2 0 28 Jan 2025
Commute Your Domains: Trajectory Optimality Criterion for Multi-Domain Learning Alexey Rukhovich Alexander Podolskiy Irina Piontkovskaya 43 0 0 28 Jan 2025
SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery Enneng Yang Li Shen Zhenyi Wang G. Guo Xingwei Wang Xiaocun Cao Jie Zhang Dacheng Tao MoMe 31 4 0 18 Oct 2024
A Parameter Update Balancing Algorithm for Multi-task Ranking Models in Recommendation Systems Jun Yuan Guohao Cai Zhenhua Dong 18 0 0 08 Oct 2024
Symmetric Graph Contrastive Learning against Noisy Views for Recommendation Chu Zhao Enneng Yang Yuliang Liang Jianzhe Zhao Guibing Guo Xingwei Wang 20 1 0 03 Aug 2024
Continual Panoptic Perception: Towards Multi-modal Incremental Interpretation of Remote Sensing Images Bo Yuan Danpei Zhao Zhuoran Liu Wentao Li Tian Li CLL VLM 28 2 0 19 Jul 2024
MetaGPT: Merging Large Language Models Using Model Exclusive Task Arithmetic Yuyan Zhou Liang Song Bingning Wang Weipeng Chen MoMe 30 15 0 17 Jun 2024
M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework Zijian Zhang Shuchang Liu Jiaao Yu Qingpeng Cai Xiangyu Zhao ... Qidong Liu Hongwei Zhao Lantao Hu Peng Jiang Kun Gai 29 16 0 29 Apr 2024
Ads Recommendation in a Collapsed and Entangled World Junwei Pan Wei Xue Ximei Wang Haibin Yu Xun Liu Shijie Quan Xueming Qiu Dapeng Liu Lei Xiao Jie Jiang 40 5 0 22 Feb 2024
Representation Surgery for Multi-Task Model Merging Enneng Yang Li Shen Zhenyi Wang Guibing Guo Xiaojun Chen Xingwei Wang Dacheng Tao MoMe 54 37 0 05 Feb 2024
One Size Fits All for Semantic Shifts: Adaptive Prompt Tuning for Continual Learning Doyoung Kim Susik Yoon Dongmin Park Youngjun Lee Hwanjun Song Jihwan Bang Jae-Gil Lee VLM 49 3 0 18 Nov 2023
Examining Common Paradigms in Multi-Task Learning Cathrin Elich Lukas Kirchdorfer Jan M. Kohler Lukas Schott 24 0 0 08 Nov 2023
AdaMerging: Adaptive Model Merging for Multi-Task Learning Enneng Yang Zhenyi Wang Li Shen Shiwei Liu Guibing Guo Xingwei Wang Dacheng Tao MoMe 33 94 0 04 Oct 2023
STEM: Unleashing the Power of Embeddings for Multi-task Recommendation Liangcai Su Junwei Pan Ximei Wang Xi Xiao Shijie Quan Xihua Chen Jie Jiang 17 15 0 16 Aug 2023
Learning Task-preferred Inference Routes for Gradient De-conflict in Multi-output DNNs Yi Sun Xin Xu J. Li Xiaochang Hu Yifei Shi L. Zeng 19 2 0 31 May 2023
Cross-Task Knowledge Distillation in Multi-Task Recommendation Chenxiao Yang Junwei Pan Xiaofeng Gao Tingyu Jiang Dapeng Liu Guihai Chen 34 44 0 20 Feb 2022
Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration Congliang Chen Li Shen Fangyu Zou Wei Liu 38 27 0 14 Jan 2021
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation Vijay Badrinarayanan Alex Kendall R. Cipolla SSeg 435 15,595 0 02 Nov 2015