v1v2 (latest)

Knowledge Distillation for Multi-task Learning

14 July 2020

Papers citing "Knowledge Distillation for Multi-task Learning"

45 / 45 papers shown

Title
Neuroplasticity-inspired dynamic ANNs for multi-task demand forecasting Mateusz Żarski Sławomir Nowaczyk 20 0 0 29 Sep 2025
SlowFast-SCI: Slow-Fast Deep Unfolding Learning for Spectral Compressive Imaging Haijin Zeng Xuan Lu Y. Zhang Yongyong Chen Jingyong Su Jie Liu 24 0 0 20 Sep 2025
Active Membership Inference Test (aMINT): Enhancing Model Auditability with Multi-Task Learning Daniel DeAlcala Aythami Morales Julian Fierrez Gonzalo Mancera Ruben Tolosana Javier-Ortega Garcia MLAU 121 1 0 09 Sep 2025
MMTL-UniAD: A Unified Framework for Multimodal and Multi-Task Learning in Assistive Driving PerceptionComputer Vision and Pattern Recognition (CVPR), 2025 Wenzhuo Liu Wenshuo Wang Yicheng Qiao Qiannan Guo Jiayin Zhu ... Huiming Yang Zhiwei Li Lening Wang Tiao Tan Huaping Liu 185 5 0 03 Apr 2025
Scalable Model Merging with Progressive Layer-wise Distillation Jing Xu Jiazheng Li J.N. Zhang MoMe FedML 489 6 0 18 Feb 2025
ILASH: A Predictive Neural Architecture Search Framework for Multi-Task Applications Md Hafizur Rahman Md. Mashfiq Rizvee Sumaiya Shomaji Prabuddha Chakraborty 188 2 0 03 Dec 2024
Box for Mask and Mask for Box: weak losses for multi-task partially supervised learningBritish Machine Vision Conference (BMVC), 2024 Hoàng-Ân Lê P. Berg Minh Pham 199 2 0 26 Nov 2024
SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery Enneng Yang Li Shen Zhenyi Wang G. Guo Xingwei Wang Xiaocun Cao Jie Zhang Dacheng Tao MoMe 155 9 0 18 Oct 2024
Swiss Army Knife: Synergizing Biases in Knowledge from Vision Foundation Models for Multi-Task LearningInternational Conference on Learning Representations (ICLR), 2024 Yuxiang Lu Shengcao Cao Yu-Xiong Wang 326 3 0 18 Oct 2024
Enhancing Romanian Offensive Language Detection through Knowledge Distillation, Multi-Task Learning, and Data AugmentationInternational Conference on Applications of Natural Language to Data Bases (NLDB), 2024 Vlad-Cristian Matei Iulian-Marius Taiatu Razvan-Alexandru Smadu Dumitru-Clementin Cercel 77 1 0 30 Sep 2024
EchoDFKD: Data-Free Knowledge Distillation for Cardiac Ultrasound Segmentation using Synthetic DataIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2024 Grégoire Petit Nathan Palluau Axel Bauer Clemens Dlaska 136 1 0 11 Sep 2024
Leveraging Foundation Models via Knowledge Distillation in Multi-Object Tracking: Distilling DINOv2 Features to FairMOT Niels G. Faber Seyed Sahand Mohamadi Ziabari Fatemeh Karimi Nejadasl 211 4 0 25 Jul 2024
UDON: Universal Dynamic Online distillatioN for generic image representations Nikolaos-Antonios Ypsilantis Kaifeng Chen André Araujo Ondřej Chum 124 7 0 12 Jun 2024
MTKD: Multi-Teacher Knowledge Distillation for Image Super-Resolution Yuxuan Jiang Chen Feng Fan Zhang David Bull SupR 169 22 0 15 Apr 2024
Configurable Holography: Towards Display and Scene Adaptation Yicheng Zhan Liang Shi Wojciech Matusik Qi Sun K. Akşit 217 0 0 24 Mar 2024
Learning to Maximize Mutual Information for Chain-of-Thought Distillation Xin Chen Hanxian Huang Yanjun Gao Yi Wang Jishen Zhao Ke Ding 240 25 0 05 Mar 2024
Representation Surgery for Multi-Task Model Merging Enneng Yang Li Shen Zhenyi Wang Guibing Guo Xiaojun Chen Xingwei Wang Dacheng Tao MoMe 199 70 0 05 Feb 2024
Rethinking of Feature Interaction for Multi-task Learning on Dense Prediction Jingdong Zhang Jiayuan Fan Peng Ye Bo Zhang Hancheng Ye Baopu Li Yancheng Cai Tao Chen 116 7 0 21 Dec 2023
Data exploitation: multi-task learning of object detection and semantic segmentation on partially annotated dataBritish Machine Vision Conference (BMVC), 2023 Hoàng-Ân Lê Minh-Tan Pham 148 2 0 07 Nov 2023
Multi-task Learning with 3D-Aware RegularizationInternational Conference on Learning Representations (ICLR), 2023 Weihong Li Jingyu Sun A. Leonardis Hakan Bilen 135 6 0 02 Oct 2023
Self-Training and Multi-Task Learning for Limited Data: Evaluation Study on Object Detection Hoàng-Ân Lê Minh-Tan Pham 172 2 0 12 Sep 2023
Multi-Objective Optimization for Sparse Deep Multi-Task LearningIEEE International Joint Conference on Neural Network (IJCNN), 2023 S. S. Hotegni M. Berkemeier S. Peitz 109 8 0 23 Aug 2023
Efficient Controllable Multi-Task ArchitecturesIEEE International Conference on Computer Vision (ICCV), 2023 Abhishek Aich S. Schulter Amit K. Roy-Chowdhury Manmohan Chandraker Yumin Suh 131 7 0 22 Aug 2023
Teacher-Student Architecture for Knowledge Distillation: A Survey Chengming Hu Xuan Li Danyang Liu Haolun Wu Xi Chen Ju Wang Xue Liu 172 33 0 08 Aug 2023
When Multi-Task Learning Meets Partial Supervision: A Computer Vision ReviewProceedings of the IEEE (Proc. IEEE), 2023 Maxime Fontana Michael W. Spratling Miaojing Shi 171 8 0 25 Jul 2023
Contrastive Multi-Task Dense PredictionAAAI Conference on Artificial Intelligence (AAAI), 2023 S. Yang Hanrong Ye Dan Xu 167 13 0 16 Jul 2023
Depth and DOF Cues Make A Better Defocus Blur DetectorIEEE International Conference on Multimedia and Expo (ICME), 2023 Yuxin Jin Ming Qian Jincheng Xiong Nan Xue Guisong Xia 97 5 0 20 Jun 2023
MetaMorphosis: Task-oriented Privacy Cognizant Feature Generation for Multi-task LearningInternational Conference on Internet-of-Things Design and Implementation (IoTDI), 2023 Md. Adnan Arefeen Zhouyu Li M. Y. S. Uddin Anupam Das 124 0 0 13 May 2023
ZipIt! Merging Models from Different Tasks without TrainingInternational Conference on Learning Representations (ICLR), 2023 George Stoica Daniel Bolya J. Bjorner Pratik Ramesh Taylor N. Hearn Judy Hoffman VLM MoMe 318 152 0 04 May 2023
Multi-Task Structural Learning using Local Task Similarity induced Neuron Creation and RemovalInternational Conference on Machine Learning (ICML), 2023 Naresh Gurulingan Bahram Zonooz Elahe Arani 123 2 0 30 Apr 2023
Universal Representations: A Unified Look at Multiple Task and Domain LearningInternational Journal of Computer Vision (IJCV), 2022 Wei-Hong Li Xialei Liu Hakan Bilen SSL OOD 209 32 0 06 Apr 2022
GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented FeatureComputer Vision and Pattern Recognition (CVPR), 2022 Biyang Liu Huimin Yu Guodong Qi 268 63 0 01 Apr 2022
X-Learner: Learning Cross Sources and Tasks for Universal Visual RepresentationEuropean Conference on Computer Vision (ECCV), 2022 Yinan He Gengshi Huang Siyu Chen Jianing Teng Wang Kun Zhen-fei Yin Lu Sheng Ziwei Liu Yu Qiao Jing Shao VLM SSL ViT 157 7 0 16 Mar 2022
Knowledge Amalgamation for Object Detection with TransformersIEEE Transactions on Image Processing (IEEE TIP), 2022 Haofei Zhang Feng Mao Mengqi Xue Gongfan Fang Zunlei Feng Mingli Song Weilong Dai ViT 241 15 0 07 Mar 2022
Global-Reasoned Multi-Task Learning Model for Surgical Scene UnderstandingIEEE Robotics and Automation Letters (RA-L), 2022 Lalithkumar Seenivasan Sai Mitheran Mobarakol Islam Hongliang Ren 148 40 0 28 Jan 2022
EyePAD++: A Distillation-based approach for joint Eye Authentication and Presentation Attack Detection using Periocular ImagesComputer Vision and Pattern Recognition (CVPR), 2021 Prithviraj Dhar Amit Kumar Kirsten Kaplan Khushi Gupta Rakesh Ranjan Ramalingam Chellappa AAML 139 13 0 22 Dec 2021
Distilled Domain Randomization J. Brosseit Benedikt Hahner Fabio Muratore Michael Gienger Jan Peters 93 4 0 06 Dec 2021
Learning Multiple Dense Prediction Tasks from Partially Annotated Data Weihong Li Xialei Liu Hakan Bilen 236 47 0 29 Nov 2021
Cross-Task Consistency Learning Framework for Multi-Task Learning Akihiro Nakano Shi Chen K. Demachi CVBM 161 3 0 28 Nov 2021
WiFi-based Multi-task SensingInternational Conference on Mobile and Ubiquitous Systems: Networking and Services (MobiQuitous), 2021 Xie Zhang Chengpei Tang Yasong An Kang Yin 74 6 0 26 Nov 2021
AutoMTL: A Programming Framework for Automating Efficient Multi-Task LearningNeural Information Processing Systems (NeurIPS), 2021 Lijun Zhang Xiao Liu Hui Guan 255 26 0 25 Oct 2021
Scaling End-to-End Models for Large-Scale Multilingual ASRAutomatic Speech Recognition & Understanding (ASRU), 2021 Yue Liu Ruoming Pang Tara N. Sainath Anmol Gulati Yu Zhang James Qin Parisa Haghani Wenjie Huang Min Ma Junwen Bai CLL 220 82 0 30 Apr 2021
Universal Representation Learning from Multiple Domains for Few-shot ClassificationIEEE International Conference on Computer Vision (ICCV), 2021 Weihong Li Xialei Liu Hakan Bilen SSL OOD VLM 145 107 0 25 Mar 2021
Federated Mutual Learning Tao Shen Jie Zhang Xinkang Jia Tai-wei Chang Gang Huang Pan Zhou Kun Kuang Leilei Gan Chao-Xiang Wu FedML 189 145 0 27 Jun 2020
Contrastive Representation DistillationInternational Conference on Learning Representations (ICLR), 2019 Yonglong Tian Dilip Krishnan Phillip Isola 851 1,179 0 23 Oct 2019