v1v2v3v4 (latest)

Gradient Surgery for Multi-Task Learning

19 January 2020

Abhishek Gupta

Papers citing "Gradient Surgery for Multi-Task Learning"

50 / 694 papers shown

Title
Fairness-aware Vision Transformer via Debiased Self-Attention Yao Qiang Chengyin Li Prashant Khanduri D. Zhu ViT 172 9 0 31 Jan 2023
Auxiliary Learning as an Asymmetric Bargaining Game Aviv Shamsian Aviv Navon Neta Glazer Kenji Kawaguchi Gal Chechik Ethan Fetaya 134 10 0 31 Jan 2023
GDOD: Effective Gradient Descent using Orthogonal Decomposition for Multi-Task Learning Xin Dong Ruize Wu Chao Xiong Hai Li Lei Cheng Yong He Shiyou Qian Jian Cao Linjian Mo 93 7 0 31 Jan 2023
Learning Vision-based Robotic Manipulation Tasks Sequentially in Offline Reinforcement Learning Settings Sudhir Pratap Yadav R. Nagar S. Shah OffRL 97 3 0 31 Jan 2023
ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning Junguang Jiang Baixu Chen Junwei Pan Ximei Wang Liu Dapeng Jie Jiang Mingsheng Long MoMe 138 27 0 30 Jan 2023
Trust Region-Based Safe Distributional Reinforcement Learning for Multiple Constraints Dohyeong Kim Kyungjae Lee Songhwai Oh 97 16 0 26 Jan 2023
tasksource: A Dataset Harmonization Framework for Streamlined NLP Multi-Task Learning and Evaluation Damien Sileo 122 12 0 14 Jan 2023
"It's a Match!" -- A Benchmark of Task Affinity Scores for Joint Learning Raphaël Azorin Massimo Gallo A. Finamore Dario Rossi Pietro Michiardi 150 1 0 07 Jan 2023
Wormhole MAML: Meta-Learning in Glued Parameter Space C. Chang Yuan Gao B. Lou 123 0 0 28 Dec 2022
Understanding the Complexity Gains of Single-Task RL with a Curriculum Qiyang Li Yuexiang Zhai Yi-An Ma Sergey Levine 190 16 0 24 Dec 2022
Mod-Squad: Designing Mixture of Experts As Modular Multi-Task Learners Zitian Chen Songlin Yang Mingyu Ding Zhenfang Chen Hengshuang Zhao E. Learned-Miller Chuang Gan MoE 62 15 0 15 Dec 2022
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers Kun Zhou Xiao Liu Yeyun Gong Wayne Xin Zhao Daxin Jiang Nan Duan Ji-Rong Wen 141 16 0 15 Dec 2022
Causes and Cures for Interference in Multilingual Translation Uri Shaham Maha Elbayad Vedanuj Goswami Omer Levy Shruti Bhosale 177 28 0 14 Dec 2022
FairRoad: Achieving Fairness for Recommender Systems with Optimized Antidote Data Minghong Fang Jia-Wei Liu Michinari Momma Yi Sun 91 5 0 13 Dec 2022
Do Text-to-Text Multi-Task Learners Suffer from Task Conflict? David Mueller Nicholas Andrews Mark Dredze 146 7 0 13 Dec 2022
PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Data Roei Herzig Ofir Abramovich Elad Ben-Avraham Assaf Arbelle Leonid Karlinsky Ariel Shamir Trevor Darrell Amir Globerson 212 19 0 08 Dec 2022
ColD Fusion: Collaborative Descent for Distributed Multitask Finetuning Shachar Don-Yehiya Elad Venezian Colin Raffel Noam Slonim Yoav Katz Leshem Choshen MoMe 132 57 0 02 Dec 2022
Improving Pareto Front Learning via Multi-Sample Hypernetworks L. P. Hoang Dung D. Le Tuan A. Tran Thang Tran Ngoc 258 27 0 02 Dec 2022
Progressive Learning without Forgetting Tao Feng Hangjie Yuan Mang Wang Ziyuan Huang Ang Bian Jianzhou Zhang CLL KELM 124 5 0 28 Nov 2022
Offline Q-Learning on Diverse Multi-Task Data Both Scales And Generalizes Aviral Kumar Rishabh Agarwal Xinyang Geng George Tucker Sergey Levine OffRL 184 61 0 28 Nov 2022
AdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learning Enneng Yang Junwei Pan Ximei Wang Haibin Yu Li Shen Xihua Chen Lei Xiao Jie Jiang G. Guo 160 56 0 28 Nov 2022
A System for Morphology-Task Generalization via Unified Representation and Behavior Distillation Hiroki Furuta Yusuke Iwasawa Yutaka Matsuo S. Gu 121 19 0 25 Nov 2022
Improving Multi-task Learning via Seeking Task-based Flat Regions Hoang Phan Lam C. Tran Ngoc N. Tran Nhat Ho Tuan Truong Qi Lei Nhat Ho Dinh Q. Phung Trung Le 340 13 0 24 Nov 2022
Gradient Imitation Reinforcement Learning for General Low-Resource Information Extraction Xuming Hu Shiao Meng Chenwei Zhang Xiangli Yang Lijie Wen Irwin King Philip S. Yu 127 0 0 11 Nov 2022
Pretraining in Deep Reinforcement Learning: A Survey Zhihui Xie Zichuan Lin Junyou Li Shuai Li Deheng Ye OffRL OnRL AI4CE 114 27 0 08 Nov 2022
Curriculum-based Asymmetric Multi-task Reinforcement Learning H. Huang Deheng Ye Li Shen Wen Liu 115 15 0 07 Nov 2022
Understanding and Mitigating Overfitting in Prompt Tuning for Vision-Language Models Cheng Ma Yang Liu Jiankang Deng Lingxi Xie Weiming Dong Changsheng Xu VLM VPVLM 118 52 0 04 Nov 2022
Scaling Multimodal Pre-Training via Cross-Modality Gradient Harmonization Junru Wu Yi Liang Feng Han Hassan Akbari Zhangyang Wang Cong Yu 91 12 0 03 Nov 2022
Losses Can Be Blessings: Routing Self-Supervised Speech Representations Towards Efficient Multilingual and Multitask Speech Processing Yonggan Fu Yang Zhang Kaizhi Qian Zhifan Ye Zhongzhi Yu Cheng-I Jeff Lai Yingyan Lin 204 10 0 02 Nov 2022
Learning to Grasp the Ungraspable with Emergent Extrinsic Dexterity Wen-Min Zhou David Held OffRL 130 65 0 02 Nov 2022
Data-Efficient Cross-Lingual Transfer with Language-Specific Subnetworks Rochelle Choenni Dan Garrette Ekaterina Shutova 151 2 0 31 Oct 2022
M $^3$ ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design Hanxue Liang Zhiwen Fan Rishov Sarkar Ziyu Jiang Tianlong Chen Kai Zou Yu Cheng Cong Hao Zhangyang Wang MoE 105 103 0 26 Oct 2022
Mitigating Gradient Bias in Multi-objective Learning: A Provably Convergent Stochastic Approach H. Fernando Han Shen Miao Liu Subhajit Chaudhury K. Murugesan Tianyi Chen 123 11 0 23 Oct 2022
Dissecting Deep Metric Learning Losses for Image-Text Retrieval Hong Xuan Xi Chen 114 2 0 21 Oct 2022
PaCo: Parameter-Compositional Multi-Task Reinforcement Learning Lingfeng Sun Haichao Zhang Wei Xu Masayoshi Tomizuka MoE 132 48 0 21 Oct 2022
Learning and Retrieval from Prior Data for Skill-based Imitation Learning Soroush Nasiriany Tian Gao Ajay Mandlekar Yuke Zhu SSL 179 59 0 20 Oct 2022
On the Feasibility of Cross-Task Transfer with Model-Based Reinforcement Learning Yifan Xu Nicklas Hansen Zirui Wang Yung-Chieh Chan H. Su Zhuowen Tu OffRL 111 18 0 19 Oct 2022
Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning Hongqiu Wu Ruixue Ding Haizhen Zhao Boli Chen Pengjun Xie Fei Huang Min Zhang MoMe 140 8 0 19 Oct 2022
Pareto Manifold Learning: Tackling multiple tasks via ensembles of single-task models Nikolaos Dimitriadis P. Frossard Franccois Fleuret 159 26 0 18 Oct 2022
Simple Emergent Action Representations from Multi-Task Policy Training Pu Hua Yubei Chen Huazhe Xu MLAU 97 7 0 18 Oct 2022
PI-QT-Opt: Predictive Information Improves Multi-Task Robotic Reinforcement Learning at Scale Kuang-Huei Lee Ted Xiao A. Li Paul Wohlhart Ian S. Fischer Yao Lu 137 10 0 15 Oct 2022
Association Graph Learning for Multi-Task Classification with Category Shifts Jiayi Shen Zehao Xiao Xiantong Zhen Cees G. M. Snoek Marcel Worring OOD 136 9 0 10 Oct 2022
Using Both Demonstrations and Language Instructions to Efficiently Learn Robotic Tasks Albert Yu Raymond J. Mooney LM&Ro 147 22 0 10 Oct 2022
On Neural Consolidation for Transfer in Reinforcement Learning Valentin Guillet Dennis G. Wilson Carlos Aguilar-Melchor Emmanuel Rachelson CLL 68 0 0 05 Oct 2022
Toward Edge-Efficient Dense Predictions with Synergistic Multi-Task Neural Architecture Search Thanh Tien Vu Yan-Quan Zhou Chun-Yung Wen Yueqi Li Jan-Michael Frahm 100 5 0 04 Oct 2022
A Multiagent Framework for the Asynchronous and Collaborative Extension of Multitask ML Systems Andrea Gesmundo 144 2 0 29 Sep 2022
Learning Gradient-based Mixup towards Flatter Minima for Domain Generalization Danni Peng Sinno Jialin Pan 89 3 0 29 Sep 2022
Disentangling Transfer in Continual Reinforcement Learning Maciej Wołczyk Michal Zajkac Razvan Pascanu Lukasz Kuciñski Piotr Milo's CLL 162 30 0 28 Sep 2022
Highly Scalable Task Grouping for Deep Multi-Task Learning in Prediction of Epigenetic Events Mohammad Shiri Jiangwen Sun 70 1 0 24 Sep 2022
Do Current Multi-Task Optimization Methods in Deep Learning Even Help? Derrick Xin Behrooz Ghorbani Ankush Garg Orhan Firat Justin Gilmer MoMe 161 70 0 23 Sep 2022