Conflict-Averse Gradient Descent for Multi-task Learning

26 October 2021

Papers citing "Conflict-Averse Gradient Descent for Multi-task Learning"

50 / 189 papers shown

Title
Uniform Loss vs. Specialized Optimization: A Comparative Analysis in Multi-Task Learning Gabriel S. Gama Valdir Grassi Jr MoMe 35 0 0 15 May 2025
JointDistill: Adaptive Multi-Task Distillation for Joint Depth Estimation and Scene Segmentation Tiancong Cheng Ying Zhang Y. Liang R. Zimmermann Zhiwen Yu Bin Guo VLM 7 0 0 15 May 2025
MoKD: Multi-Task Optimization for Knowledge Distillation Zeeshan Hayder A. Cheraghian Lars Petersson Mehrtash Harandi VLM 49 0 0 13 May 2025
$Simple Semi-supervised Knowledge Distillation from Vision-Language Models via $\mathbf{\texttt{D}}$ual-$\mathbf{\texttt{H}}$ead $\mathbf{\texttt{O}}$ptimization$ Simple Semi-supervised Knowledge Distillation from Vision-Language Models via $\mathbf{\texttt{D}}$ ual- $\mathbf{\texttt{H}}$ ead $\mathbf{\texttt{O}}$ ptimization Seongjae Kang Dong Bok Lee Hyungjoon Jang Sung Ju Hwang VLM 46 0 0 12 May 2025
CAT Merging: A Training-Free Approach for Resolving Conflicts in Model Merging Wenju Sun Qingyong Li Yangli-ao Geng Boyang Li MoMe 29 0 0 11 May 2025
Dynamic Domain Information Modulation Algorithm for Multi-domain Sentiment Analysis Chunyi Yue Ang Li 21 0 0 10 May 2025
Locating and Mitigating Gradient Conflicts in Point Cloud Domain Adaptation via Saliency Map Skewness Jiaqi Tang Yinsong Xu Qingchao Chen 3DPC 27 0 0 22 Apr 2025
Learning Compatible Multi-Prize Subnetworks for Asymmetric Retrieval Yushuai Sun Zikun Zhou D. Jiang Yaowei Wang Jun Yu Guangming Lu Wenjie Pei 29 0 0 16 Apr 2025
Balancing Task-invariant Interaction and Task-specific Adaptation for Unified Image Fusion Xingyu Hu Junjun Jiang Chenyang Wang Kui Jiang Xianming Liu Jiayi Ma 21 0 0 07 Apr 2025
Injecting Imbalance Sensitivity for Multi-Task Learning Zhipeng Zhou Liu Liu Peilin Zhao Wei Gong 53 0 0 11 Mar 2025
MoE-Loco: Mixture of Experts for Multitask Locomotion Runhan Huang Shaoting Zhu Yilun Du Hang Zhao MoE 41 0 0 11 Mar 2025
Universal Incremental Learning: Mitigating Confusion from Inter- and Intra-task Distribution Randomness Sheng Luo Yi Zhou Tao Zhou CLL 47 0 0 10 Mar 2025
Joint Explainability-Performance Optimization With Surrogate Models for AI-Driven Edge Services Foivos Charalampakos Thomas Tsouparopoulos Iordanis Koutsopoulos 49 1 0 10 Mar 2025
Continual Optimization with Symmetry Teleportation for Multi-Task Learning Zhipeng Zhou Ziqiao Meng Pengcheng Wu Peilin Zhao Chunyan Miao 47 0 0 06 Mar 2025
Gradient Deconfliction via Orthogonal Projections onto Subspaces For Multi-task Learning Shijie Zhu Hui Zhao Tianshu Wu Pengjie Wang Hongbo Deng Jian Xu Bo Zheng 48 1 0 05 Mar 2025
Go Beyond Your Means: Unlearning with Per-Sample Gradient Orthogonalization Aviv Shamsian E. Shaar Aviv Navon Gal Chechik Ethan Fetaya MU 58 0 0 04 Mar 2025
No Plan but Everything Under Control: Robustly Solving Sequential Tasks with Dynamically Composed Gradient Descent Vito Mengers Oliver Brock 57 1 0 03 Mar 2025
BodyGen: Advancing Towards Efficient Embodiment Co-Design Haofei Lu Zhe Wu Junliang Xing Jianshu Li Ruoyu Li Zhe Li Yuanchun Shi 39 0 0 01 Mar 2025
Balanced Rate-Distortion Optimization in Learned Image Compression Yichi Zhang Z. Duan Yuning Huang F. Zhu 34 1 0 27 Feb 2025
A Physics-Informed Blur Learning Framework for Imaging Systems Liqun Chen Yuxuan Li Jun Dai Jinwei Gu Tianfan Xue 70 0 0 17 Feb 2025
MaZO: Masked Zeroth-Order Optimization for Multi-Task Fine-Tuning of Large Language Models Zhen Zhang Y. Yang Kai Zhen Nathan Susanj Athanasios Mouchtaris Siegfried Kunzmann Zheng Zhang 54 0 0 17 Feb 2025
PiKE: Adaptive Data Mixing for Multi-Task Learning Under Low Gradient Conflicts Zeman Li Yuan Deng Peilin Zhong Meisam Razaviyayn Vahab Mirrokni MoMe 75 1 0 10 Feb 2025
Skill Expansion and Composition in Parameter Space Tenglong Liu J. Li Yinan Zheng Haoyi Niu Yixing Lan Xin Xu Xianyuan Zhan 56 4 0 09 Feb 2025
Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspective Sifan Wang Ananyae Kumar Bhartari Bowen Li P. Perdikaris PINN 54 4 0 02 Feb 2025
Task Arithmetic in Trust Region: A Training-Free Model Merging Approach to Navigate Knowledge Conflicts Wenju Sun Qingyong Li Wen Wang Yangli-ao Geng Boyang Li 36 2 0 28 Jan 2025
E2E-MFD: Towards End-to-End Synchronous Multimodal Fusion Detection Jiaqing Zhang Mingxiang Cao Weiying Xie Jie Lei Daixun Li Wenbo Huang Yunsong Li Xue Yang 48 4 0 28 Jan 2025
Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyond Weiyu Chen Xiaoyuan Zhang Baijiong Lin Xi Victoria Lin Han Zhao Qingfu Zhang James T. Kwok 73 2 0 19 Jan 2025
Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learning Hanwen Zhong Jiaxin Chen Yutong Zhang Di Huang Yunhong Wang MoE 42 0 0 12 Jan 2025
Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic Yifei He Yuzheng Hu Yong Lin Tong Zhang Han Zhao FedML MoMe 64 17 0 08 Jan 2025
Multi-Task Reinforcement Learning for Quadrotors Jiaxu Xing Ismail Geles Yunlong Song Elie Aljalbout Davide Scaramuzza 77 8 0 17 Dec 2024
A Flexible Plug-and-Play Module for Generating Variable-Length Liyang He Yuren Zhang Rui Li Zhenya Huang Runze Wu Enhong Chen 70 0 0 12 Dec 2024
Preventing Conflicting Gradients in Neural Marked Temporal Point Processes T. Bosser Souhaib Ben Taieb AI4TS 69 0 0 11 Dec 2024
FERERO: A Flexible Framework for Preference-Guided Multi-Objective Learning Lisha Chen A. F. M. Saif Yanning Shen Tianyi Chen 71 2 0 02 Dec 2024
MUNBa: Machine Unlearning via Nash Bargaining Jing Wu Mehrtash Harandi MU 71 3 0 23 Nov 2024
AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers Jake Grigsby Justin Sasek Samyak Parajuli Daniel Adebi Amy Zhang Yuke Zhu OffRL 26 2 0 17 Nov 2024
AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment Y. Fu Zhongzhi Yu Junwei Li Jiayi Qian Yongan Zhang Xiangchi Yuan Dachuan Shi Roman Yakunin Y. Lin 29 2 0 15 Nov 2024
A Bayesian Approach to Data Point Selection Xinnuo Xu Minyoung Kim Royson Lee Brais Martínez Timothy M. Hospedales 33 0 0 06 Nov 2024
Task-Aware Harmony Multi-Task Decision Transformer for Offline Reinforcement Learning Ziqing Fan Shengchao Hu Yuhang Zhou Li Shen Ya-Qin Zhang Yanfeng Wang Dacheng Tao OffRL 34 0 0 02 Nov 2024
Online Mirror Descent for Tchebycheff Scalarization in Multi-Objective Optimization Meitong Liu Xiaoyuan Zhang Chulin Xie Kate Donahue Han Zhao 18 1 0 29 Oct 2024
Conflict-Aware Adversarial Training Zhiyu Xue Haohan Wang Yao Qin Ramtin Pedarsani AAML 23 0 0 21 Oct 2024
Enabling Asymmetric Knowledge Transfer in Multi-Task Learning with Self-Auxiliaries Olivier Graffeuille Yun Sing Koh Joerg Wicker Moritz Lehmann 21 0 0 21 Oct 2024
Federated Communication-Efficient Multi-Objective Optimization Baris Askin Pranay Sharma Gauri Joshi Carlee Joe-Wong FedML 64 1 0 21 Oct 2024
A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trends Junjun Jiang Zengyuan Zuo Gang Wu Kui Jiang Xianming Liu 46 10 0 19 Oct 2024
MENTOR: Mixture-of-Experts Network with Task-Oriented Perturbation for Visual Reinforcement Learning Suning Huang Zheyu Zhang Tianhai Liang Yihan Xu Zhehao Kou Chenhao Lu Guowei Xu Zhengrong Xue Huazhe Xu MoE 44 2 0 19 Oct 2024
SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery Enneng Yang Li Shen Zhenyi Wang G. Guo Xingwei Wang Xiaocun Cao Jie Zhang Dacheng Tao MoMe 37 4 0 18 Oct 2024
Swiss Army Knife: Synergizing Biases in Knowledge from Vision Foundation Models for Multi-Task Learning Yuxiang Lu Shengcao Cao Yu-xiong Wang 45 1 0 18 Oct 2024
radarODE-MTL: A Multi-Task Learning Framework with Eccentric Gradient Alignment for Robust Radar-Based ECG Reconstruction Y. Zhang Rui Yang Yutao Yue Eng Gee Lim 31 1 0 11 Oct 2024
CoBa: Convergence Balancer for Multitask Finetuning of Large Language Models Zi Gong Hang Yu Cong Liao Bingchang Liu Chaoyu Chen Jianguo Li MoMe 21 4 0 09 Oct 2024
A Parameter Update Balancing Algorithm for Multi-task Ranking Models in Recommendation Systems Jun Yuan Guohao Cai Zhenhua Dong 23 0 0 08 Oct 2024
Towards Layer-Wise Personalized Federated Learning: Adaptive Layer Disentanglement via Conflicting Gradients Minh Duong Nguyen Khanh Le Khoi Do Nguyen H. Tran Duc Nguyen Chien Trinh Zhaohui Yang FedML 34 2 0 03 Oct 2024