v1v2v3v4 (latest)

Gradient Surgery for Multi-Task Learning

19 January 2020

Abhishek Gupta

Papers citing "Gradient Surgery for Multi-Task Learning"

50 / 684 papers shown

Title
Structured Multi-task Learning for Molecular Property Prediction Shengchao Liu Meng Qu Zuobai Zhang Huiyu Cai Jian Tang 109 26 0 22 Feb 2022
Cross-Task Knowledge Distillation in Multi-Task Recommendation Chenxiao Yang Junwei Pan Xiaofeng Gao Tingyu Jiang Dapeng Liu Guihai Chen 140 52 0 20 Feb 2022
Orthogonalising gradients to speed up neural network optimisation Mark Tuddenham Adam Prugel-Bennett Jonathan Hare ODL 96 7 0 14 Feb 2022
Robust Policy Learning over Multiple Uncertainty Sets Annie Xie Shagun Sodhani Chelsea Finn Joelle Pineau Amy Zhang OOD OffRL 140 19 0 14 Feb 2022
Auto-Lambda: Disentangling Dynamic Task Relationships Shikun Liu Stephen James Andrew J. Davison Edward Johns 172 83 0 07 Feb 2022
Multi-Task Learning as a Bargaining Game Aviv Navon Aviv Shamsian Idan Achituve Haggai Maron Kenji Kawaguchi Gal Chechik Ethan Fetaya 151 180 0 02 Feb 2022
Dissecting the impact of different loss functions with gradient surgery Hong Xuan Robert Pless 60 1 0 27 Jan 2022
Gap Minimization for Knowledge Sharing and Transfer Boyu Wang Jorge Armando Mendez Mendez Changjian Shui Fan Zhou Di Wu Gezheng Xu Christian Gagné Eric Eaton 174 10 0 26 Jan 2022
A Multi-modal Fusion Framework Based on Multi-task Correlation Learning for Cancer Prognosis Prediction Kaiwen Tan Weixian Huang Xiaofeng Liu Jinlong Hu Shoubin Dong 85 43 0 22 Jan 2022
A Novel Framework to Jointly Compress and Index Remote Sensing Images for Efficient Content-Based Retrieval Gencer Sumbul Jun Xiang Nimisha Thekke Madam Begüm Demir 130 1 0 17 Jan 2022
GradTail: Learning Long-Tailed Data Using Gradient-based Sample Weighting Zhao Chen Vincent Casser Henrik Kretzschmar Dragomir Anguelov 92 5 0 16 Jan 2022
In Defense of the Unitary Scalarization for Deep Multi-Task Learning Vitaly Kurin Alessandro De Palma Ilya Kostrikov Shimon Whiteson M. P. Kumar 178 80 0 11 Jan 2022
Operator Deep Q-Learning: Zero-Shot Reward Transferring in Reinforcement Learning Ziyang Tang Yihao Feng Qiang Liu OffRL 113 1 0 01 Jan 2022
Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments A. Iyer Karan Grewal Akash Velu Lucas O. Souza Jérémy Forest Subutai Ahmad AI4CE 138 49 0 31 Dec 2021
Parameter Differentiation based Multilingual Neural Machine Translation Qian Wang Jiajun Zhang 104 21 0 27 Dec 2021
Manifold embedding data-driven mechanics B. Bahmani WaiChing Sun PINN AI4CE 104 9 0 18 Dec 2021
Improving evidential deep learning via multi-task learning Dongpin Oh Bonggun Shin EDL UQCV 124 26 0 17 Dec 2021
Meta-CPR: Generalize to Unseen Large Number of Agents with Communication Pattern Recognition Module Wei-Cheng Tseng Wei Wei Da-Cheng Juan Min Sun 113 2 0 14 Dec 2021
E-CRF: Embedded Conditional Random Field for Boundary-caused Class Weights Confusion in Semantic Segmentation Jie Zhu Huabin Huang Banghuai Li Leye Wang 95 14 0 14 Dec 2021
Towards a Unified Foundation Model: Jointly Pre-Training Transformers on Unpaired Images and Text Qing Li Boqing Gong Huayu Chen Dan Kondratyuk Xianzhi Du Ming-Hsuan Yang Matthew A. Brown ViT 69 17 0 14 Dec 2021
Bootstrapping ViTs: Towards Liberating Vision Transformers from Pre-training Haofei Zhang Jiarui Duan Mengqi Xue Mingli Song Li Sun Xiuming Zhang ViT AI4CE 149 16 0 07 Dec 2021
A generic physics-informed neural network-based framework for reliability assessment of multi-state systems Taotao Zhou Xiaoge Zhang E. Droguett A. Mosleh AI4CE 149 34 0 01 Dec 2021
Learning Multiple Dense Prediction Tasks from Partially Annotated Data Weihong Li Xialei Liu Hakan Bilen 158 43 0 29 Nov 2021
Cross-Task Consistency Learning Framework for Multi-Task Learning Akihiro Nakano Shi Chen K. Demachi CVBM 141 3 0 28 Nov 2021
PolyViT: Co-training Vision Transformers on Images, Videos and Audio Valerii Likhosherstov Anurag Arnab K. Choromanski Mario Lucic Yi Tay Adrian Weller Mostafa Dehghani ViT 128 78 0 25 Nov 2021
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning V. Aribandi Yi Tay Tal Schuster J. Rao H. Zheng ... Jianmo Ni Jai Gupta Kai Hui Sebastian Ruder Donald Metzler MoE 188 219 0 22 Nov 2021
Reasonable Effectiveness of Random Weighting: A Litmus Test for Multi-Task Learning Xiaoyuan Zhang Feiyang Ye Yu Zhang Ivor W. Tsang 153 108 0 20 Nov 2021
Deep Safe Multi-Task Learning Zhixiong Yue Feiyang Ye Yu Zhang Christy Jie Liang Ivor W. Tsang 74 3 0 20 Nov 2021
SUB-Depth: Self-distillation and Uncertainty Boosting Self-supervised Monocular Depth Estimation Hang Zhou Sarah Taylor David Greenwood Michal Mackiewicz UQCV MDE 153 11 0 18 Nov 2021
Multi-Task Neural Processes Jiayi Shen Xiantong Zhen M. Worring Ling Shao BDL 99 8 0 10 Nov 2021
Variational Multi-Task Learning with Gumbel-Softmax Priors Jiayi Shen Xiantong Zhen M. Worring Ling Shao 98 32 0 09 Nov 2021
Generalization in Dexterous Manipulation via Geometry-Aware Multi-Task Learning Wenlong Huang Igor Mordatch Pieter Abbeel Deepak Pathak 168 65 0 04 Nov 2021
An Empirical Study of Training End-to-End Vision-and-Language Transformers Zi-Yi Dou Yichong Xu Zhe Gan Jianfeng Wang Shuohang Wang ... Pengchuan Zhang Lu Yuan Nanyun Peng Zicheng Liu Michael Zeng VLM 169 395 0 03 Nov 2021
Towards Fairness-Aware Federated Learning Yuxin Shi Han Yu Cyril Leung FedML 126 93 0 02 Nov 2021
Meta-Learning to Improve Pre-Training Aniruddh Raghu Jonathan Lorraine Simon Kornblith Matthew B. A. McDermott David Duvenaud 109 33 0 02 Nov 2021
Procedural Generalization by Planning with Self-Supervised World Models Ankesh Anand Jacob Walker Yazhe Li Eszter Vértes Julian Schrittwieser Sherjil Ozair T. Weber Jessica B. Hamrick 97 32 0 02 Nov 2021
Conflict-Averse Gradient Descent for Multi-task Learning Bo Liu Xingchao Liu Xiaojie Jin Peter Stone Qiang Liu 184 364 0 26 Oct 2021
AutoMTL: A Programming Framework for Automating Efficient Multi-Task Learning Lijun Zhang Xiao Liu Hui Guan 183 24 0 25 Oct 2021
Game of Gradients: Mitigating Irrelevant Clients in Federated Learning Lokesh Nagalapatti Mahdi S. Hosseini FedML 111 82 0 23 Oct 2021
Speech Representation Learning Through Self-supervised Pretraining And Multi-task Finetuning Yi-Chen Chen Shu-Wen Yang Cheng-Kuang Lee Simon See Hung-yi Lee SSL 66 13 0 18 Oct 2021
Pareto Navigation Gradient Descent: a First-Order Algorithm for Optimization in Pareto Set Mao Ye Qiang Liu 183 12 0 17 Oct 2021
Semi-supervised Multi-task Learning for Semantics and Depth Yufeng Wang Yi-Hsuan Tsai Wei-Chih Hung Wenrui Ding Shuo Liu Ming-Hsuan Yang 113 26 0 14 Oct 2021
Balancing Average and Worst-case Accuracy in Multitask Learning Paul Michel Sebastian Ruder Dani Yogatama 85 12 0 12 Oct 2021
Learning Temporally-Consistent Representations for Data-Efficient Reinforcement Learning Trevor A. McInroe Lukas Schafer Stefano V. Albrecht OffRL 88 8 0 11 Oct 2021
Learning Multi-Objective Curricula for Robotic Policy Learning Jikun Kang Miao Liu Abhinav Gupta C. Pal Xue Liu Jie Fu 120 5 0 06 Oct 2021
ClimateGAN: Raising Climate Change Awareness by Generating Images of Floods Victor Schmidt A. Luccioni Mélisande Teng Tianyu Zhang Alexia Reynaud ... Gautier Cosne Adrien Juraver V. Vardanyan Alex Hernandez-Garcia Yoshua Bengio GAN AI4CE 95 22 0 06 Oct 2021
Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learning Seanie Lee Haebeom Lee Juho Lee Sung Ju Hwang MoMe CLL 200 19 0 06 Oct 2021
Fast Line Search for Multi-Task Learning A. Filatov D. Merkulov 55 0 0 02 Oct 2021
Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets F. Ebert Yanlai Yang Karl Schmeckpeper Bernadette Bucher G. Georgakis Kostas Daniilidis Chelsea Finn Sergey Levine 305 253 0 27 Sep 2021
Improved optimization strategies for deep Multi-Task Networks Lucas Pascal Pietro Michiardi Xavier Bost B. Huet Maria A. Zuluaga 152 6 0 21 Sep 2021