Identifying beneficial task relations for multi-task learning in deep neural networks

27 February 2017

Papers citing "Identifying beneficial task relations for multi-task learning in deep neural networks"

50 / 87 papers shown

Title
MINT: Multimodal Instruction Tuning with Multimodal Interaction Grouping Xiaojun Shan Qi Cao Xing Han Haofei Yu Paul Liang 34 0 0 02 Jun 2025
Pareto Set Learning for Multi-Objective Reinforcement Learning Erlong Liu Yu-Chang Wu Xiaobin Huang Chengrui Gao Ren-Jian Wang Ke Xue Chao Qian OffRL 235 2 0 12 Jan 2025
Glider: Global and Local Instruction-Driven Expert Router Pingzhi Li Prateek Yadav Jaehong Yoon Jie Peng Yi-Lin Sung Joey Tianyi Zhou Tianlong Chen MoMe MoE 87 2 0 09 Oct 2024
MAGPIE: Multi-Task Media-Bias Analysis Generalization for Pre-Trained Identification of Expressions Tomávs Horych Martin Wessel Jan Philip Wahle Terry Ruas Jerome Wassmuth André Greiner-Petter Akiko Aizawa Bela Gipp Timo Spinde 66 2 0 27 Feb 2024
Towards Robust and Efficient Continual Language Learning Adam Fisch Amal Rannen-Triki Razvan Pascanu J. Bornschein Angeliki Lazaridou E. Gribovskaya MarcÁurelio Ranzato CLL 51 1 0 11 Jul 2023
Toward Building General Foundation Models for Language, Vision, and Vision-Language Understanding Tasks Xinsong Zhang Yan Zeng Jipeng Zhang Hang Li VLM AI4CE LRM 92 17 0 12 Jan 2023
"It's a Match!" -- A Benchmark of Task Affinity Scores for Joint Learning Raphaël Azorin Massimo Gallo A. Finamore Dario Rossi Pietro Michiardi 132 1 0 07 Jan 2023
Efficiently Tuned Parameters are Task Embeddings Wangchunshu Zhou Canwen Xu Julian McAuley 53 8 0 21 Oct 2022
Multi-Task Meta Learning: learn how to adapt to unseen tasks Richa Upadhyay Prakash Chandra Chhipa Ronald Phlypo Rajkumar Saini Marcus Liwicki 62 11 0 13 Oct 2022
Task Compass: Scaling Multi-task Pre-training with Task Prefix Zhuosheng Zhang Shuohang Wang Yichong Xu Yuwei Fang Wenhao Yu Yang Liu Han Zhao Chenguang Zhu Michael Zeng SSL LRM 70 16 0 12 Oct 2022
Multi-Task Learning for Depression Detection in Dialogs Chuyuan Li Chloé Braud M. Amblard 36 10 0 21 Jul 2022
FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue Alon Albalak Yi-Lin Tuan Pegah Jandaghi Connor Pryor Luke Yoffe Deepak Ramachandran Lise Getoor Jay Pujara William Yang Wang 79 14 0 12 May 2022
Explaining the Effectiveness of Multi-Task Learning for Efficient Knowledge Extraction from Spine MRI Reports Arijit Sehanobish M. Sandora Nabila Abraham Jayashri Pawar Danielle Torres Anasuya Das M. Becker Richard Herzog Benjamin Odry Ron Vianu 75 3 0 06 May 2022
Efficient Extraction of Pathologies from C-Spine Radiology Reports using Multi-Task Learning Arijit Sehanobish Nathaniel K. Brown Ishita Daga Jayashri Pawar Danielle Torres Anasuya Das M. Becker Richard Herzog Benjamin Odry Ron Vianu MedIm 57 2 0 09 Apr 2022
On partitioning of an SHM problem and parallels with transfer learning G. Tsialiamanis David J. Wagg P. Gardner N. Dervilis K. Worden 31 7 0 03 Mar 2022
Identifying Suitable Tasks for Inductive Transfer Through the Analysis of Feature Attributions Alexander Pugantsov R. McCreadie 53 0 0 02 Feb 2022
Grad2Task: Improved Few-shot Text Classification Using Gradients for Task Representation Jixuan Wang Kuan-Chieh Wang Frank Rudzicz M. Brudno VLM 52 22 0 27 Jan 2022
Gap Minimization for Knowledge Sharing and Transfer Boyu Wang Jorge Armando Mendez Mendez Changjian Shui Fan Zhou Di Wu Gezheng Xu Christian Gagné Eric Eaton 107 10 0 26 Jan 2022
Learning Multi-Tasks with Inconsistent Labels by using Auxiliary Big Task Quan Feng Songcan Chen 103 5 0 07 Jan 2022
Robust Natural Language Processing: Recent Advances, Challenges, and Future Directions Marwan Omar Soohyeon Choi Daehun Nyang David A. Mohaisen 78 58 0 03 Jan 2022
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning V. Aribandi Yi Tay Tal Schuster J. Rao H. Zheng ... Jianmo Ni Jai Gupta Kai Hui Sebastian Ruder Donald Metzler MoE 123 216 0 22 Nov 2021
Revisit Multimodal Meta-Learning through the Lens of Multi-Task Learning Milad Abdollahzadeh Touba Malekzadeh Ngai-Man Cheung 62 29 0 27 Oct 2021
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer Tu Vu Brian Lester Noah Constant Rami Al-Rfou Daniel Cer VLM LRM 214 290 0 15 Oct 2021
Contextualizing Variation in Text Style Transfer Datasets S. Schoch Wanyu Du Yangfeng Ji 57 5 0 17 Aug 2021
Learning More for Free - A Multi Task Learning Approach for Improved Pathology Classification in Capsule Endoscopy Anuja Vats Marius Pedersen A. Mohammed Ø. Hovde 43 7 0 30 Jun 2021
One Semantic Parser to Parse Them All: Sequence to Sequence Multi-Task Learning on Semantic Parsing Datasets Marco Damonte Emilio Monti AIMat 67 6 0 08 Jun 2021
Latent-Optimized Adversarial Neural Transfer for Sarcasm Detection Xu Guo Boyang Albert Li Han Yu Chunyan Miao AAML 85 18 0 19 Apr 2021
What to Pre-Train on? Efficient Intermediate Task Selection Clifton A. Poth Jonas Pfeiffer Andreas Rucklé Iryna Gurevych 111 100 0 16 Apr 2021
Language Modelling as a Multi-Task Problem Leon Weber Jaap Jumelet Elia Bruni Dieuwke Hupkes 83 13 0 27 Jan 2021
Seeing Both the Forest and the Trees: Multi-head Attention for Joint Classification on Different Compositional Levels Miruna Pislar Marek Rei 24 4 0 01 Nov 2020
Measuring and Harnessing Transference in Multi-Task Learning Christopher Fifty Ehsan Amid Zhe Zhao Tianhe Yu Rohan Anil Chelsea Finn 92 15 0 29 Oct 2020
Hierarchical Multitask Learning Approach for BERT Çagla Aksoy Alper Ahmetoglu Tunga Güngör SSL 49 5 0 17 Oct 2020
Domain Adversarial Fine-Tuning as an Effective Regularizer Giorgos Vernikos Katerina Margatina Alexandra Chronopoulou Ion Androutsopoulos 70 15 0 28 Sep 2020
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data Jonathan Pilault Amine Elhattami C. Pal CLL MoE 82 91 0 19 Sep 2020
Multi-Task Learning with Deep Neural Networks: A Survey M. Crawshaw CVBM 217 626 0 10 Sep 2020
HydaLearn: Highly Dynamic Task Weighting for Multi-task Learning with Auxiliary Tasks Sam Verboven M. H. Chaudhary Jeroen Berrevoets Wouter Verbeke 46 7 0 26 Aug 2020
Automated Search for Resource-Efficient Branched Multi-Task Networks David Brüggemann Menelaos Kanakis Stamatios Georgoulis Luc Van Gool 73 65 0 24 Aug 2020
Multi-task learning for natural language processing in the 2020s: where are we going? Joseph Worsham Jugal Kalita AIMat 64 81 0 22 Jul 2020
Neural MOS Prediction for Synthesized Speech Using Multi-Task Learning With Spoofing Detection and Spoofing Type Classification Yeunju Choi Youngmoon Jung Hoirin Kim 105 27 0 16 Jul 2020
Learning Functions to Study the Benefit of Multitask Learning Gabriele Bettgenhauser Michael A. Hedderich Dietrich Klakow 76 4 0 09 Jun 2020
Subjective Question Answering: Deciphering the inner workings of Transformers in the realm of subjectivity Lukas Muttenthaler 36 3 0 02 Jun 2020
An Empirical Study of Multi-Task Learning on BERT for Biomedical Text Mining Yifan Peng Qingyu Chen Zhiyong Lu 84 116 0 06 May 2020
Understanding and Improving Information Transfer in Multi-Task Learning Sen Wu Hongyang R. Zhang Christopher Ré 63 158 0 02 May 2020
MultiQT: Multimodal Learning for Real-Time Question Tracking in Speech Jakob Drachmann Havtorn Jan Latko Joakim Edin Lasse Borgholt Lars Maaløe Lorenzo Belgrano Nicolai Frost Jakobsen R. Sdun Zeljko Agic 29 3 0 02 May 2020
Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work? Yada Pruksachatkun Jason Phang Haokun Liu Phu Mon Htut Xiaoyi Zhang Richard Yuanzhe Pang Clara Vania Katharina Kann Samuel R. Bowman CLL LRM 76 197 0 01 May 2020
Lexical Semantic Recognition Nelson F. Liu Daniel Hershcovich Michael Kranzlein Nathan Schneider 48 18 0 30 Apr 2020
SubjQA: A Dataset for Subjectivity and Review Comprehension Johannes Bjerva Nikita Bhutani Behzad Golshan W. Tan Isabelle Augenstein 71 43 0 29 Apr 2020
Masking as an Efficient Alternative to Finetuning for Pretrained Language Models Mengjie Zhao Tao R. Lin Fei Mi Martin Jaggi Hinrich Schütze 75 120 0 26 Apr 2020
Improving Neural Story Generation by Targeted Common Sense Grounding H. H. Mao Bodhisattwa Prasad Majumder Julian McAuley G. Cottrell LRM 80 46 0 26 Aug 2019
Multi-Task Self-Supervised Learning for Disfluency Detection Shaolei Wang Wanxiang Che Qi Liu Pengda Qin Ting Liu William Yang Wang SSL 76 56 0 15 Aug 2019