Gradient Surgery for Multi-Task Learning

19 January 2020

Abhishek Gupta

Papers citing "Gradient Surgery for Multi-Task Learning"

50 / 190 papers shown

Title
Progressive Learning without Forgetting Tao Feng Hangjie Yuan Mang Wang Ziyuan Huang Ang Bian Jianzhou Zhang CLL KELM 44 4 0 28 Nov 2022
AdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learning Enneng Yang Junwei Pan Ximei Wang Haibin Yu Li Shen Xihua Chen Lei Xiao Jie Jiang G. Guo 38 43 0 28 Nov 2022
Gradient Imitation Reinforcement Learning for General Low-Resource Information Extraction Xuming Hu Shiao Meng Chenwei Zhang Xiangli Yang Lijie Wen Irwin King Philip S. Yu 49 0 0 11 Nov 2022
Curriculum-based Asymmetric Multi-task Reinforcement Learning H. Huang Deheng Ye Li Shen W. Liu 27 12 0 07 Nov 2022
Learning to Grasp the Ungraspable with Emergent Extrinsic Dexterity Wen-Min Zhou David Held OffRL 11 59 0 02 Nov 2022
Data-Efficient Cross-Lingual Transfer with Language-Specific Subnetworks Rochelle Choenni Dan Garrette Ekaterina Shutova 24 2 0 31 Oct 2022
M $^3$ ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design Hanxue Liang Zhiwen Fan Rishov Sarkar Ziyu Jiang Tianlong Chen Kai Zou Yu Cheng Cong Hao Zhangyang Wang MoE 31 81 0 26 Oct 2022
On the Feasibility of Cross-Task Transfer with Model-Based Reinforcement Learning Yifan Xu Nicklas Hansen Zirui Wang Yung-Chieh Chan H. Su Z. Tu OffRL 25 15 0 19 Oct 2022
Pareto Manifold Learning: Tackling multiple tasks via ensembles of single-task models Nikolaos Dimitriadis P. Frossard Franccois Fleuret 18 25 0 18 Oct 2022
PI-QT-Opt: Predictive Information Improves Multi-Task Robotic Reinforcement Learning at Scale Kuang-Huei Lee Ted Xiao A. Li Paul Wohlhart Ian S. Fischer Yao Lu 45 10 0 15 Oct 2022
Toward Edge-Efficient Dense Predictions with Synergistic Multi-Task Neural Architecture Search Thanh Vu Yan-Quan Zhou Chun-Yung Wen Yueqi Li Jan-Michael Frahm 32 4 0 04 Oct 2022
Learning Gradient-based Mixup towards Flatter Minima for Domain Generalization Danni Peng Sinno Jialin Pan 34 2 0 29 Sep 2022
Disentangling Transfer in Continual Reinforcement Learning Maciej Wołczyk Michal Zajkac Razvan Pascanu Lukasz Kuciñski Piotr Milo's CLL 62 27 0 28 Sep 2022
Highly Scalable Task Grouping for Deep Multi-Task Learning in Prediction of Epigenetic Events Mohammad Shiri Jiangwen Sun 13 1 0 24 Sep 2022
NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenes Zhiwen Fan Peihao Wang Yifan Jiang Xinyu Gong Dejia Xu Zhangyang Wang 99 63 0 19 Sep 2022
Curbing Task Interference using Representation Similarity-Guided Multi-Task Feature Sharing Naresh Gurulingan Elahe Arani Bahram Zonooz 22 1 0 19 Aug 2022
Personalizing Intervened Network for Long-tailed Sequential User Behavior Modeling Zheqi Lv Feng Wang Shengyu Zhang Kun Kuang Hongxia Yang Fei Wu 29 8 0 19 Aug 2022
Exploring the trade off between human driving imitation and safety for traffic simulation Yann Koeberle S. Sabatini D. Tsishkou C. Sabourin 27 4 0 09 Aug 2022
UFO: Unified Feature Optimization Teng Xi Yifan Sun Deli Yu Bi Li Nan Peng ... Haocheng Feng Junyu Han Jingtuo Liu Errui Ding Jingdong Wang 32 10 0 21 Jul 2022
Eliminating Gradient Conflict in Reference-based Line-Art Colorization Zekun Li Zhengyang Geng Zhao Kang Wenyu Chen Yibo Yang 21 35 0 13 Jul 2022
RobustAnalog: Fast Variation-Aware Analog Circuit Design Via Multi-task RL Wei Shi Hanrui Wang Jiaqi Gu Mingjie Liu D. Pan Song Han Nan Sun 11 14 0 13 Jul 2022
HLT-MT: High-resource Language-specific Training for Multilingual Neural Machine Translation Jian Yang Yuwei Yin Shuming Ma Dongdong Zhang Zhoujun Li Furu Wei 29 8 0 11 Jul 2022
Don't Start From Scratch: Leveraging Prior Data to Automate Robotic Reinforcement Learning Homer Walke Jonathan Yang Albert Yu Aviral Kumar Jedrzej Orbik Avi Singh Sergey Levine OffRL OnRL 25 32 0 11 Jul 2022
Improving Policy Optimization with Generalist-Specialist Learning Zhiwei Jia Xuanlin Li Z. Ling Shuang Liu Yiran Wu H. Su OffRL 26 24 0 26 Jun 2022
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge Linxi Fan Guanzhi Wang Yunfan Jiang Ajay Mandlekar Yuncong Yang Haoyi Zhu Andrew Tang De-An Huang Yuke Zhu Anima Anandkumar LM&Ro 42 348 0 17 Jun 2022
Switchable Representation Learning Framework with Self-compatibility Shengsen Wu Yan Bai Yihang Lou Xiongkun Linghu Jianzhong He Ling-yu Duan 22 1 0 16 Jun 2022
Contrastive Learning as Goal-Conditioned Reinforcement Learning Benjamin Eysenbach Tianjun Zhang Ruslan Salakhutdinov Sergey Levine SSL OffRL 25 138 0 15 Jun 2022
Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimization Adrián Javaloy Maryam Meghdadi Isabel Valera 19 26 0 09 Jun 2022
Prompt-aligned Gradient for Prompt Tuning Beier Zhu Yulei Niu Yucheng Han Yuehua Wu Hanwang Zhang VLM 183 271 0 30 May 2022
BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Driving Yunpeng Zhang Zheng Hua Zhu Wenzhao Zheng Junjie Huang Guan Huang Jie Zhou Jiwen Lu 30 187 0 19 May 2022
Explaining the Effectiveness of Multi-Task Learning for Efficient Knowledge Extraction from Spine MRI Reports Arijit Sehanobish M. Sandora Nabila Abraham Jayashri Pawar Danielle Torres Anasuya Das M. Becker Richard Herzog Benjamin Odry Ron Vianu 11 3 0 06 May 2022
Universal Representations: A Unified Look at Multiple Task and Domain Learning Wei-Hong Li Xialei Liu Hakan Bilen SSL OOD 28 27 0 06 Apr 2022
LibMTL: A Python Library for Multi-Task Learning Baijiong Lin Yu Zhang OffRL AI4CE 25 37 0 27 Mar 2022
X-Learner: Learning Cross Sources and Tasks for Universal Visual Representation Yinan He Gengshi Huang Siyu Chen Jianing Teng Wang Kun Zhen-fei Yin Lu Sheng Ziwei Liu Yu Qiao Jing Shao VLM SSL ViT 37 7 0 16 Mar 2022
Multi-Agent Policy Transfer via Task Relationship Modeling Rongjun Qin F. Chen Tonghan Wang Lei Yuan Xiaoran Wu Zongzhang Zhang Chongjie Zhang Yang Yu 30 19 0 09 Mar 2022
On Steering Multi-Annotations per Sample for Multi-Task Learning Yuan Li Yiwen Guo Qizhang Li Hongzhi Zhang W. Zuo 17 0 0 06 Mar 2022
Structured Multi-task Learning for Molecular Property Prediction Shengchao Liu Meng Qu Zuobai Zhang Huiyu Cai Jian Tang 15 24 0 22 Feb 2022
Auto-Lambda: Disentangling Dynamic Task Relationships Shikun Liu Stephen James Andrew J. Davison Edward Johns 26 75 0 07 Feb 2022
Dissecting the impact of different loss functions with gradient surgery Hong Xuan Robert Pless 20 1 0 27 Jan 2022
A Multi-modal Fusion Framework Based on Multi-task Correlation Learning for Cancer Prognosis Prediction Kaiwen Tan Weixian Huang Xiaofeng Liu Jinlong Hu Shoubin Dong 19 42 0 22 Jan 2022
GradTail: Learning Long-Tailed Data Using Gradient-based Sample Weighting Zhao Chen Vincent Casser Henrik Kretzschmar Dragomir Anguelov 26 5 0 16 Jan 2022
In Defense of the Unitary Scalarization for Deep Multi-Task Learning Vitaly Kurin Alessandro De Palma Ilya Kostrikov Shimon Whiteson M. P. Kumar 28 73 0 11 Jan 2022
Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments A. Iyer Karan Grewal Akash Velu Lucas O. Souza Jérémy Forest Subutai Ahmad AI4CE 27 41 0 31 Dec 2021
Meta-CPR: Generalize to Unseen Large Number of Agents with Communication Pattern Recognition Module Wei-Cheng Tseng Wei Wei Da-Cheng Juan Min Sun 36 2 0 14 Dec 2021
Learning Multiple Dense Prediction Tasks from Partially Annotated Data Weihong Li Xialei Liu Hakan Bilen 42 39 0 29 Nov 2021
Cross-Task Consistency Learning Framework for Multi-Task Learning Akihiro Nakano Shi Chen K. Demachi CVBM 14 3 0 28 Nov 2021
PolyViT: Co-training Vision Transformers on Images, Videos and Audio Valerii Likhosherstov Anurag Arnab K. Choromanski Mario Lucic Yi Tay Adrian Weller Mostafa Dehghani ViT 35 73 0 25 Nov 2021
Multi-Task Neural Processes Jiayi Shen Xiantong Zhen M. Worring Ling Shao BDL 16 8 0 10 Nov 2021
Generalization in Dexterous Manipulation via Geometry-Aware Multi-Task Learning Wenlong Huang Igor Mordatch Pieter Abbeel Deepak Pathak 15 63 0 04 Nov 2021
Towards Fairness-Aware Federated Learning Yuxin Shi Han Yu Cyril Leung FedML 21 79 0 02 Nov 2021