Adapting Auxiliary Losses Using Gradient Similarity

5 December 2018

Yunshu Du

Wojciech M. Czarnecki

Siddhant M. Jayakumar

Mehrdad Farajtabar

Razvan Pascanu

Balaji Lakshminarayanan

ArXiv PDF HTML

Papers citing "Adapting Auxiliary Losses Using Gradient Similarity"

35 / 35 papers shown

Title
Generalized Task-Driven Medical Image Quality Enhancement with Gradient Promotion Dong Zhang Kwang-Ting Cheng MedIm 20 0 0 03 Jan 2025
Budgeted Online Continual Learning by Adaptive Layer Freezing and Frequency-based Sampling Minhyuk Seo Hyunseo Koh Jonghyun Choi 31 1 0 19 Oct 2024
Using dynamic loss weighting to boost improvements in forecast stability Daan Caljon Jeff Vercauteren Simon De Vos Wouter Verbeke Jente Van Belle 37 0 0 26 Sep 2024
Can Optimization Trajectories Explain Multi-Task Transfer? David Mueller Mark Dredze Nicholas Andrews 55 1 0 26 Aug 2024
Careful with that Scalpel: Improving Gradient Surgery with an EMA Yu-Guan Hsieh James Thornton Eugène Ndiaye Michal Klein Marco Cuturi Pierre Ablin MedIm 31 0 0 05 Feb 2024
Overcoming Distribution Mismatch in Quantizing Image Super-Resolution Networks Chee Hong Kyoung Mu Lee SupR MQ 19 1 0 25 Jul 2023
Auxiliary-Tasks Learning for Physics-Informed Neural Network-Based Partial Differential Equations Solving Junjun Yan Xinhai Chen Zhichao Wang Enqiang Zhou Jie Liu PINN AI4CE 24 1 0 12 Jul 2023
MultiWave: Multiresolution Deep Architectures through Wavelet Decomposition for Multivariate Time Series Prediction I. Deznabi M. Fiterau AI4TS 30 5 0 16 Jun 2023
Sample-Level Weighting for Multi-Task Learning with Auxiliary Tasks Emilie Grégoire M. H. Chaudhary Sam Verboven 24 1 0 07 Jun 2023
Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers Félix Gaschi Patricio Cerda Parisa Rastin Y. Toussaint 17 9 0 05 Jun 2023
SRIL: Selective Regularization for Class-Incremental Learning Jisu Han Jaemin Na Wonjun Hwang CLL 10 0 0 09 May 2023
GDOD: Effective Gradient Descent using Orthogonal Decomposition for Multi-Task Learning Xin Dong Ruize Wu Chao Xiong Hai Li Lei Cheng Yong He Shiyou Qian Jian Cao Linjian Mo 6 4 0 31 Jan 2023
Gradient Imitation Reinforcement Learning for General Low-Resource Information Extraction Xuming Hu Shiao Meng Chenwei Zhang Xiangli Yang Lijie Wen Irwin King Philip S. Yu 46 0 0 11 Nov 2022
Auxiliary task discovery through generate-and-test Banafsheh Rafiee Sina Ghiassian Jun Jin R. Sutton Jun-Jie Luo Adam White 16 0 0 25 Oct 2022
Switchable Representation Learning Framework with Self-compatibility Shengsen Wu Yan Bai Yihang Lou Xiongkun Linghu Jianzhong He Ling-yu Duan 22 1 0 16 Jun 2022
The CLRS Algorithmic Reasoning Benchmark Petar Velivcković Adria Puigdomenech Badia David Budden Razvan Pascanu Andrea Banino Mikhail Dashevskiy R. Hadsell Charles Blundell 161 87 0 31 May 2022
Deep AutoAugment Yu Zheng Z. Zhang Shen Yan Mi Zhang ViT 15 26 0 11 Mar 2022
Multi-Agent Policy Transfer via Task Relationship Modeling Rongjun Qin F. Chen Tonghan Wang Lei Yuan Xiaoran Wu Zongzhang Zhang Chongjie Zhang Yang Yu 30 19 0 09 Mar 2022
On Steering Multi-Annotations per Sample for Multi-Task Learning Yuan Li Yiwen Guo Qizhang Li Hongzhi Zhang W. Zuo 17 0 0 06 Mar 2022
Auto-Lambda: Disentangling Dynamic Task Relationships Shikun Liu Stephen James Andrew J. Davison Edward Johns 26 75 0 07 Feb 2022
Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments A. Iyer Karan Grewal Akash Velu Lucas O. Souza Jérémy Forest Subutai Ahmad AI4CE 27 41 0 31 Dec 2021
Auxiliary Loss Reweighting for Image Inpainting Siqi Hui Sanping Zhou Ye Deng Wenli Huang Jinjun Wang 32 1 0 14 Nov 2021
Fishr: Invariant Gradient Variances for Out-of-Distribution Generalization Alexandre Ramé Corentin Dancette Matthieu Cord OOD 38 204 0 07 Sep 2021
Adaptive Transfer Learning on Graph Neural Networks Xueting Han Zhenhuan Huang Bang An Jing Bai 22 59 0 19 Jul 2021
Multiple Instance Learning with Auxiliary Task Weighting for Multiple Myeloma Classification Talha Qaiser S. Winzeck Theodore Barfoot T. Barwick S. Doran ... N. Tunariu D. Koh C. Messiou A. Rockall Ben Glocker 16 8 0 16 Jul 2021
Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions with Superior OOD Generalization Damien Teney Ehsan Abbasnejad Simon Lucey A. Hengel 23 86 0 12 May 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 176 686 0 22 Apr 2021
Improving RNN Transducer Based ASR with Auxiliary Tasks Chunxi Liu Frank Zhang Duc Le Suyoun Kim Yatharth Saraf Geoffrey Zweig 20 49 0 05 Nov 2020
Auxiliary Task Reweighting for Minimum-data Learning Baifeng Shi Judy Hoffman Kate Saenko Trevor Darrell Huijuan Xu MoMe 12 32 0 16 Oct 2020
Multi-Task Learning with Deep Neural Networks: A Survey M. Crawshaw CVBM 25 608 0 10 Sep 2020
Learning explanations that are hard to vary Giambattista Parascandolo Alexander Neitz Antonio Orvieto Luigi Gresele Bernhard Schölkopf FAtt 19 178 0 01 Sep 2020
Auxiliary Learning by Implicit Differentiation Aviv Navon Idan Achituve Haggai Maron Gal Chechik Ethan Fetaya 23 59 0 22 Jun 2020
Multi-Task Reinforcement Learning with Soft Modularization Ruihan Yang Huazhe Xu Yi Wu Xiaolong Wang 22 174 0 30 Mar 2020
Ray Interference: a Source of Plateaus in Deep Reinforcement Learning Tom Schaul Diana Borsa Joseph Modayil Razvan Pascanu 11 63 0 25 Apr 2019
A Survey and Critique of Multiagent Deep Reinforcement Learning Pablo Hernandez-Leal Bilal Kartal Matthew E. Taylor OffRL 30 549 0 12 Oct 2018