Conflict-Averse Gradient Descent for Multi-task Learning

26 October 2021

Papers citing "Conflict-Averse Gradient Descent for Multi-task Learning"

50 / 189 papers shown

Title
Long-Sequence Recommendation Models Need Decoupled Embeddings Ningya Feng Junwei Pan Jialong Wu Baixu Chen Ximei Wang Qian Li Xian Hu Jie Jiang Mingsheng Long AI4TS 40 2 0 03 Oct 2024
Dual Cone Gradient Descent for Training Physics-Informed Neural Networks Youngsik Hwang Dong-Young Lim AI4CE 28 2 0 27 Sep 2024
Learning Representation for Multitask learning through Self Supervised Auxiliary learning Seokwon Shin Hyungrok Do Youngdoo Son SSL 21 1 0 25 Sep 2024
Perceptual-Distortion Balanced Image Super-Resolution is a Multi-Objective Optimization Problem Qiwen Zhu Yanjie Wang Shilv Cai Liqun Chen Jiahuan Zhou Luxin Yan Sheng Zhong Xu Zou 34 3 0 05 Sep 2024
Task Weighting through Gradient Projection for Multitask Learning Christian Bohn Ido Freeman Hasan Tercan Tobias Meisen 22 1 0 03 Sep 2024
MTMamba++: Enhancing Multi-Task Dense Scene Understanding via Mamba-Based Decoders Baijiong Lin Weisen Jiang Pengguang Chen Shu Liu Ying-Cong Chen Mamba 25 1 0 27 Aug 2024
Can Optimization Trajectories Explain Multi-Task Transfer? David Mueller Mark Dredze Nicholas Andrews 53 1 0 26 Aug 2024
Thresholded Lexicographic Ordered Multiobjective Reinforcement Learning Alperen Tercan Vinayak S. Prabhu 19 1 0 24 Aug 2024
Analytical Uncertainty-Based Loss Weighting in Multi-Task Learning Lukas Kirchdorfer Cathrin Elich Simon Kutsche Heiner Stuckenschmidt Lukas Schott Jan M. Kohler 31 5 0 15 Aug 2024
Gradient Harmonization in Unsupervised Domain Adaptation Fuxiang Huang Suqi Song Lei Zhang 22 7 0 01 Aug 2024
Efficient Pareto Manifold Learning with Low-Rank Structure Weiyu Chen James T. Kwok 28 6 0 30 Jul 2024
Deep Feature Surgery: Towards Accurate and Efficient Multi-Exit Networks Cheng Gong Yao Chen Qiuyang Luo Ye Lu Tao Li Yuzhi Zhang Yufei Sun Le Zhang 36 0 0 19 Jul 2024
LIMT: Language-Informed Multi-Task Visual World Models Elie Aljalbout Nikolaos Sotirakis Patrick van der Smagt Maximilian Karl Nutan Chen 32 5 0 18 Jul 2024
GRIDS: Grouped Multiple-Degradation Restoration with Image Degradation Similarity Shuo Cao Yihao Liu Wenlong Zhang Yu Qiao Chao Dong 36 4 0 17 Jul 2024
Towards stable training of parallel continual learning Li Yuepan Fan Lyu Yuyang Li Wei Feng Guangcan Liu Fanhua Shang 43 0 0 11 Jul 2024
Pareto Low-Rank Adapters: Efficient Multi-Task Learning with Preferences Nikolaos Dimitriadis Pascal Frossard F. Fleuret MoE 59 6 0 10 Jul 2024
CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community Yan Liu Bin Guo Nuo Li Yasan Ding Zhouyangzi Zhang Zhiwen Yu 37 1 0 09 Jul 2024
DMTG: One-Shot Differentiable Multi-Task Grouping Yuan Gao Shuguo Jiang Moran Li Jin-Gang Yu Gui-Song Xia 50 1 0 06 Jul 2024
MTMamba: Enhancing Multi-Task Dense Scene Understanding by Mamba-Based Decoders Baijiong Lin Weisen Jiang Pengguang Chen Yu Zhang Shu Liu Ying-Cong Chen Mamba 41 9 0 02 Jul 2024
MT2ST: Adaptive Multi-Task to Single-Task Learning Dong Liu Meng Jiang 29 0 0 26 Jun 2024
Jacobian Descent for Multi-Objective Optimization Pierre Quinton Valérian Rey 34 3 0 23 Jun 2024
DataFreeShield: Defending Adversarial Attacks without Training Data Hyeyoon Lee Kanghyun Choi Dain Kwon Sunjong Park Mayoore S. Jaiswal Noseong Park Jonghyun Choi Jinho Lee 28 0 0 21 Jun 2024
Hybrid Alignment Training for Large Language Models Chenglong Wang Hang Zhou Kaiyan Chang Bei Li Yongyu Mu Tong Xiao Tongran Liu Jingbo Zhu 33 4 0 21 Jun 2024
MetaGPT: Merging Large Language Models Using Model Exclusive Task Arithmetic Yuyan Zhou Liang Song Bingning Wang Weipeng Chen MoMe 30 15 0 17 Jun 2024
Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging Zhenyi Lu Chenghao Fan Wei Wei Xiaoye Qu Dangyang Chen Yu Cheng MoMe 42 48 0 17 Jun 2024
UniZero: Generalized and Efficient Planning with Scalable Latent World Models Yuan Pu Yazhe Niu Jiyuan Ren Zhenjie Yang Hongsheng Li Yu Liu OffRL 41 1 0 15 Jun 2024
Exploring Training on Heterogeneous Data with Mixture of Low-rank Adapters Yuhang Zhou Zihua Zhao Haolin Li Siyuan Du Jiangchao Yao Ya Zhang Yanfeng Wang MoMe MoE 40 3 0 14 Jun 2024
Enhancing Domain Adaptation through Prompt Gradient Alignment Hoang Phan Lam C. Tran Quyen Tran Trung Le 52 0 0 13 Jun 2024
Fairness-Aware Meta-Learning via Nash Bargaining Yi Zeng Xuelin Yang Li Chen Cristian Canton Ferrer Ming Jin Michael I. Jordan Ruoxi Jia 37 2 0 11 Jun 2024
From Basic to Extra Features: Hypergraph Transformer Pretrain-then-Finetuning for Balanced Clinical Predictions on EHR Ran Xu Yiwen Lu Chang Liu Yong Chen Yan Sun Xiao Hu Joyce C. Ho Carl Yang 38 1 0 09 Jun 2024
Quantifying Task Priority for Multi-Task Optimization Wooseong Jeong Kuk-Jin Yoon 25 3 0 05 Jun 2024
Enhancing Efficiency of Safe Reinforcement Learning via Sample Manipulation Shangding Gu Laixi Shi Yuhao Ding Alois Knoll C. Spanos Adam Wierman Ming Jin OffRL 30 2 0 31 May 2024
Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimization Xi Lin Yilu Liu Xiao-Yan Zhang Fei Liu Zhenkun Wang Qingfu Zhang 32 4 0 30 May 2024
Adapting Differential Molecular Representation with Hierarchical Prompts for Multi-label Property Prediction Linjia Kang Songhua Zhou Shuyan Fang Shichao Liu Wen Zhang AI4CE 44 3 0 29 May 2024
HarmoDT: Harmony Multi-Task Decision Transformer for Offline Reinforcement Learning Shengchao Hu Ziqing Fan Li Shen Ya-Qin Zhang Yanfeng Wang Dacheng Tao OffRL 33 9 0 28 May 2024
Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learning Shangding Gu Bilgehan Sel Yuhao Ding Lu Wang Qingwei Lin Alois Knoll Ming Jin 40 1 0 26 May 2024
GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Minghao Xu Yunteng Geng Yihang Zhang Ling Yang Jian Tang Wentao Zhang 38 2 0 25 May 2024
Preparing for Black Swans: The Antifragility Imperative for Machine Learning Ming Jin 34 2 0 18 May 2024
Aux-NAS: Exploiting Auxiliary Labels with Negligibly Extra Inference Cost Yuan Gao Weizhong Zhang Wenhan Luo Lin Ma Jin-Gang Yu Gui-Song Xia Jiayi Ma 29 1 0 09 May 2024
Balance Reward and Safety Optimization for Safe Reinforcement Learning: A Perspective of Gradient Manipulation Shangding Gu Bilgehan Sel Yuhao Ding Lu Wang Qingwei Lin Ming Jin Alois Knoll 52 9 0 02 May 2024
AdaDemo: Data-Efficient Demonstration Expansion for Generalist Robotic Agent Tongzhou Mu Yijie Guo Jie Xu Ankit Goyal Hao Su Dieter Fox Animesh Garg LM&Ro 34 0 0 11 Apr 2024
GO4Align: Group Optimization for Multi-Task Alignment Jiayi Shen Cheems Wang Zehao Xiao N. V. Noord M. Worring 32 2 0 09 Apr 2024
Efficient Multi-Task Reinforcement Learning via Task-Specific Action Correction Jinyuan Feng Min Chen Zhiqiang Pu Tenghai Qiu Jianqiang Yi 27 2 0 09 Apr 2024
Multi-Task Learning as enabler for General-Purpose AI-native RAN Hasan Farooq Julien Forgeat Shruti Bothe K. Čyras Md Moin 34 0 0 05 Apr 2024
MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning Ahmed A. Agiza Marina Neseem Sherief Reda MoE 35 12 0 29 Mar 2024
FastCAR: Fast Classification And Regression Multi-Task Learning via Task Consolidation for Modelling a Continuous Property Variable of Object Classes Anoop Kini A. Jansche T. Bernthaler Gerhard Schneider 15 0 0 26 Mar 2024
Multi-Task Learning with Multi-Task Optimization Lu Bai Abhishek Gupta Yew-Soon Ong 18 2 0 24 Mar 2024
DiffusionMTL: Learning Multi-Task Denoising Diffusion Model from Partially Annotated Data Hanrong Ye Dan Xu DiffM 52 4 0 22 Mar 2024
CoTBal: Comprehensive Task Balancing for Multi-Task Visual Instruction Tuning Yanqi Dai Dong Jing Nanyi Fei Zhiwu Lu Nanyi Fei Guoxing Yang Zhiwu Lu 48 3 0 07 Mar 2024
Joint multi-task learning improves weakly-supervised biomarker prediction in computational pathology Omar S. M. El Nahhas Georg Wolflein M. Ligero Tim Lenz M. Treeck Firas Khader Daniel Truhn Jakob Nikolas Kather 24 1 0 06 Mar 2024