In Defense of the Unitary Scalarization for Deep Multi-Task Learning

11 January 2022

Papers citing "In Defense of the Unitary Scalarization for Deep Multi-Task Learning"

50 / 55 papers shown

Title
Multi-Task Reinforcement Learning Enables Parameter Scaling Reginald McLean Evangelos Chataroulas Jordan Terry Isaac Woungang Nariman Farsad P. S. Castro LRM 39 0 0 07 Mar 2025
AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers Jake Grigsby Justin Sasek Samyak Parajuli Daniel Adebi Amy Zhang Yuke Zhu OffRL 18 2 0 17 Nov 2024
Vertical Federated Learning with Missing Features During Training and Inference Pedro Valdeira Shiqiang Wang Yuejie Chi FedML 25 1 0 29 Oct 2024
Federated Communication-Efficient Multi-Objective Optimization Baris Askin Pranay Sharma Gauri Joshi Carlee Joe-Wong FedML 44 1 0 21 Oct 2024
Can Optimization Trajectories Explain Multi-Task Transfer? David Mueller Mark Dredze Nicholas Andrews 43 1 0 26 Aug 2024
Analytical Uncertainty-Based Loss Weighting in Multi-Task Learning Lukas Kirchdorfer Cathrin Elich Simon Kutsche Heiner Stuckenschmidt Lukas Schott Jan M. Kohler 23 5 0 15 Aug 2024
DMTG: One-Shot Differentiable Multi-Task Grouping Yuan Gao Shuguo Jiang Moran Li Jin-Gang Yu Gui-Song Xia 42 0 0 06 Jul 2024
Jacobian Descent for Multi-Objective Optimization Pierre Quinton Valérian Rey 23 3 0 23 Jun 2024
Enhancing Domain Adaptation through Prompt Gradient Alignment Hoang Phan Lam C. Tran Quyen Tran Trung Le 45 0 0 13 Jun 2024
Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimization Xi Lin Yilu Liu Xiao-Yan Zhang Fei Liu Zhenkun Wang Qingfu Zhang 24 0 0 30 May 2024
Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learning Shangding Gu Bilgehan Sel Yuhao Ding Lu Wang Qingwei Lin Alois Knoll Ming Jin 21 1 0 26 May 2024
Aux-NAS: Exploiting Auxiliary Labels with Negligibly Extra Inference Cost Yuan Gao Weizhong Zhang Wenhan Luo Lin Ma Jin-Gang Yu Gui-Song Xia Jiayi Ma 21 1 0 09 May 2024
MergeNet: Knowledge Migration across Heterogeneous Models, Tasks, and Modalities Kunxi Li Tianyu Zhan Kairui Fu Shengyu Zhang Kun Kuang Jiwei Li Zhou Zhao Fei Wu MoMe 17 0 0 20 Apr 2024
GO4Align: Group Optimization for Multi-Task Alignment Jiayi Shen Cheems Wang Zehao Xiao N. V. Noord M. Worring 27 1 0 09 Apr 2024
Multitask Learning in Minimally Invasive Surgical Vision: A Review Oluwatosin O. Alabi Tom Kamiel Magda Vercauteren Miaojing Shi 10 1 0 16 Jan 2024
Order Matters in the Presence of Dataset Imbalance for Multilingual Learning Dami Choi Derrick Xin Hamid Dadkhahi Justin Gilmer Ankush Garg Orhan Firat Chih-Kuan Yeh Andrew M. Dai Behrooz Ghorbani 45 3 0 11 Dec 2023
Examining Common Paradigms in Multi-Task Learning Cathrin Elich Lukas Kirchdorfer Jan M. Kohler Lukas Schott 22 0 0 08 Nov 2023
From Molecules to Materials: Pre-training Large Generalizable Models for Atomic Property Prediction Nima Shoghi Adeesh Kolluru John R. Kitchin Zachary W. Ulissi C. L. Zitnick Brandon M. Wood AI4CE 17 30 0 25 Oct 2023
Scalarization for Multi-Task and Multi-Domain Learning at Scale Amelie Royer Tijmen Blankevoort B. Bejnordi 18 16 0 13 Oct 2023
Distill Knowledge in Multi-task Reinforcement Learning with Optimal-Transport Regularization Bang Giang Le Viet-Cuong Ta OT 19 1 0 27 Sep 2023
FonMTL: Towards Multitask Learning for the Fon Language Bonaventure F. P. Dossou Iffanice B. Houndayi Pamely Zantou Gilles Hacheme 23 0 0 28 Aug 2023
Revisiting Scalarization in Multi-Task Learning: A Theoretical Perspective Yuzheng Hu Ruicheng Xian Qilong Wu Qiuling Fan Lang Yin Han Zhao 19 38 0 27 Aug 2023
Dual-Balancing for Multi-Task Learning Baijiong Lin Weisen Jiang Feiyang Ye Yu Zhang Pengguang Chen Yingke Chen Shu Liu James T. Kwok CVBM 14 8 0 23 Aug 2023
Multi-Modal Multi-Task (3MT) Road Segmentation Erkan Milli Özgür Erkent A. Yılmaz 11 8 0 23 Aug 2023
Efficient Controllable Multi-Task Architectures Abhishek Aich S. Schulter A. Roy-Chowdhury Manmohan Chandraker Yumin Suh 15 5 0 22 Aug 2023
Improvable Gap Balancing for Multi-Task Learning Yanqi Dai Nanyi Fei Zhiwu Lu 25 2 0 28 Jul 2023
Multi-task Item-attribute Graph Pre-training for Strict Cold-start Item Recommendation Yuwei Cao Liangwei Yang Chen Wang Zhiwei Liu Hao Peng Chenyu You Philip S. Yu 8 21 0 26 Jun 2023
FAMO: Fast Adaptive Multitask Optimization B. Liu Yihao Feng Peter Stone Qian Liu 22 26 0 06 Jun 2023
Biologically-Motivated Learning Model for Instructed Visual Processing R. Abel S. Ullman 8 0 0 04 Jun 2023
Addressing Negative Transfer in Diffusion Models Hyojun Go Jinyoung Kim Yunsung Lee Seunghyun Lee Shinhyeok Oh Hyeongdon Moon Seungtaek Choi DiffM VLM 16 24 0 01 Jun 2023
Three-Way Trade-Off in Multi-Objective Learning: Optimization, Generalization and Conflict-Avoidance Lisha Chen H. Fernando Yiming Ying Tianyi Chen 8 11 0 31 May 2023
Differentiable Random Partition Models Thomas M. Sutter Alain Ryser Joram Liebeskind Julia E. Vogt 28 3 0 26 May 2023
Expressive Losses for Verified Robustness via Convex Combinations Alessandro De Palma Rudy Bunel Krishnamurthy Dvijotham M. P. Kumar Robert Stanforth A. Lomuscio AAML 18 11 0 23 May 2023
XTab: Cross-table Pretraining for Tabular Transformers Bingzhao Zhu Xingjian Shi Nick Erickson Mu Li George Karypis Mahsa Shoaran LMTD 16 65 0 10 May 2023
A Study of Autoregressive Decoders for Multi-Tasking in Computer Vision Lucas Beyer Bo Wan Gagan Madan Filip Pavetić Andreas Steiner ... Emanuele Bugliarello Xiao Wang Qihang Yu Liang-Chieh Chen Xiaohua Zhai 35 8 0 30 Mar 2023
QMP: Q-switch Mixture of Policies for Multi-Task Behavior Sharing Grace Zhang Ayush Jain Injune Hwang Shao-Hua Sun Joseph J. Lim 9 5 0 01 Feb 2023
ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning Junguang Jiang Baixu Chen Junwei Pan Ximei Wang Liu Dapeng Jie Jiang Mingsheng Long MoMe 8 19 0 30 Jan 2023
Causes and Cures for Interference in Multilingual Translation Uri Shaham Maha Elbayad Vedanuj Goswami Omer Levy Shruti Bhosale 23 18 0 14 Dec 2022
Hybrid Multi-agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systems Tobias Enders James Harrison Marco Pavone Maximilian Schiffer 15 21 0 14 Dec 2022
Vertical Layering of Quantized Neural Networks for Heterogeneous Inference Hai Wu Ruifei He Hao Hao Tan Xiaojuan Qi Kaibin Huang MQ 6 2 0 10 Dec 2022
Offline Q-Learning on Diverse Multi-Task Data Both Scales And Generalizes Aviral Kumar Rishabh Agarwal Xinyang Geng George Tucker Sergey Levine OffRL 21 48 0 28 Nov 2022
A System for Morphology-Task Generalization via Unified Representation and Behavior Distillation Hiroki Furuta Yusuke Iwasawa Yutaka Matsuo S. Gu 13 13 0 25 Nov 2022
Pareto Manifold Learning: Tackling multiple tasks via ensembles of single-task models Nikolaos Dimitriadis P. Frossard Franccois Fleuret 9 25 0 18 Oct 2022
Do Current Multi-Task Optimization Methods in Deep Learning Even Help? Derrick Xin Behrooz Ghorbani Ankush Garg Orhan Firat Justin Gilmer MoMe 61 61 0 23 Sep 2022
A Generalist Neural Algorithmic Learner Borja Ibarz Vitaly Kurin George Papamakarios Kyriacos Nikiforou Mehdi Abbana Bennani ... Andreea Deac Beatrice Bevilacqua Yaroslav Ganin Charles Blundell Petar Velivcković OOD 16 53 0 22 Sep 2022
Beyond Transfer Learning: Co-finetuning for Action Localisation Anurag Arnab Xuehan Xiong A. Gritsenko Rob Romijnders Josip Djolonga Mostafa Dehghani Chen Sun Mario Lucic Cordelia Schmid 16 8 0 08 Jul 2022
Improving Policy Optimization with Generalist-Specialist Learning Zhiwei Jia Xuanlin Li Z. Ling Shuang Liu Yiran Wu H. Su OffRL 11 23 0 26 Jun 2022
Challenges and Opportunities in Offline Reinforcement Learning from Visual Observations Cong Lu Philip J. Ball Tim G. J. Rudner Jack Parker-Holder Michael A. Osborne Yee Whye Teh OffRL 11 40 0 09 Jun 2022
On the Effectiveness of Fine-tuning Versus Meta-reinforcement Learning Mandi Zhao Pieter Abbeel Stephen James OffRL 10 32 0 07 Jun 2022
Auto-Lambda: Disentangling Dynamic Task Relationships Shikun Liu Stephen James Andrew J. Davison Edward Johns 17 74 0 07 Feb 2022