v1v2 (latest)

M2KD: Multi-model and Multi-level Knowledge Distillation for Incremental Learning

3 April 2019

Zuxuan Wu

Papers citing "M2KD: Multi-model and Multi-level Knowledge Distillation for Incremental Learning"

33 / 33 papers shown

Title
Realistic Continual Learning Approach using Pre-trained Models Nadia Nasri Carlos Gutiérrez-Álvarez Sergio Lafuente-Arroyo Saturnino Maldonado-Bascón Roberto J. López-Sastre CLL 139 0 0 11 Apr 2024
Privacy-Preserving Synthetic Continual Semantic Segmentation for Robotic Surgery Mengya Xu Mobarakol Islam Long Bai Hongliang Ren 126 12 0 08 Feb 2024
Inherit with Distillation and Evolve with Contrast: Exploring Class Incremental Semantic Segmentation Without Exemplar MemoryIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Danpei Zhao Bo Yuan Z. Shi VLM CLL 244 17 0 27 Sep 2023
Teacher-Student Architecture for Knowledge Distillation: A Survey Chengming Hu Xuan Li Danyang Liu Haolun Wu Xi Chen Ju Wang Xue Liu 244 39 0 08 Aug 2023
Neural Collapse Terminus: A Unified Solution for Class Incremental Learning and Its Variants Jianlong Wu Haobo Yuan Hefei Ling Yue Yu Lefei Zhang Zhouchen Lin Juil Sock Dacheng Tao Guohao Li CLL 333 12 0 03 Aug 2023
Online Continual Learning via the Knowledge Invariant and Spread-out PropertiesExpert systems with applications (ESWA), 2022 Ya-nan Han Jian Liu CLL 167 9 0 02 Feb 2023
Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental LearningAAAI Conference on Artificial Intelligence (AAAI), 2022 Bin Huang Zhineng Chen Peng Zhou Jiayin Chen Zuxuan Wu CLL 113 25 0 29 Dec 2022
EPIK: Eliminating multi-model Pipelines with Knowledge-distillation Bhavesh Laddagiri Yash Raj Anshuman Dash 81 0 0 27 Nov 2022
Teacher-Student Architecture for Knowledge Learning: A Survey Chengming Hu Xuan Li Dan Liu Xi Chen Ju Wang Xue Liu 258 41 0 28 Oct 2022
PlaStIL: Plastic and Stable Memory-Free Class-Incremental Learning Grégoire Petit Adrian Daniel Popescu Eden Belouadah David Picard Bertrand Delezoide CLL 204 4 0 14 Sep 2022
Online Continual Learning via the Meta-learning Update with Multi-scale Knowledge Distillation and Data AugmentationEngineering applications of artificial intelligence (EAAI), 2022 Ya-nan Han Jian Liu KELM CLL 200 12 0 12 Sep 2022
Contrastive Deep SupervisionEuropean Conference on Computer Vision (ECCV), 2022 Linfeng Zhang Xin Chen Junbo Zhang Runpei Dong Kaisheng Ma 157 42 0 12 Jul 2022
Generalized Knowledge Distillation via Relationship MatchingIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022 Han-Jia Ye Su Lu De-Chuan Zhan FedML 159 25 0 04 May 2022
Improving Feature Generalizability with Multitask Learning in Class Incremental LearningIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2022 Dongpeng Ma Chi Ian Tang Cecilia Mascolo CLL 113 4 0 26 Apr 2022
Memory Efficient Continual Learning with TransformersNeural Information Processing Systems (NeurIPS), 2022 Beyza Ermis Giovanni Zappella Martin Wistuba Aditya Rawal Cédric Archambeau CLL 255 61 0 09 Mar 2022
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansionComputer Vision and Pattern Recognition (CVPR), 2021 Arthur Douillard Alexandre Ramé Guillaume Couairon Matthieu Cord CLL 342 376 0 22 Nov 2021
Dataset Knowledge Transfer for Class-Incremental Learning without Memory H. Slim Eden Belouadah Adrian Daniel Popescu Darian M. Onchis CLL 91 10 0 16 Oct 2021
DIODE: Dilatable Incremental Object DetectionPattern Recognition (Pattern Recogn.), 2021 Can Peng Kun-li Zhao Sam Maksoud Tianren Wang Brian C. Lovell CLL ObjD 171 12 0 12 Aug 2021
Tackling Catastrophic Forgetting and Background Shift in Continual Semantic Segmentation Arthur Douillard Yifu Chen Arnaud Dapogny Matthieu Cord CLL 117 21 0 29 Jun 2021
Energy Aligning for Biased Models Bowen Zhao Chen Chen Qi Ju Shutao Xia 97 1 0 07 Jun 2021
There is More than Meets the Eye: Self-Supervised Multi-Object Detection and Tracking with Sound by Distilling Multimodal KnowledgeComputer Vision and Pattern Recognition (CVPR), 2021 Francisco Rivera Valverde Juana Valeria Hurtado Abhinav Valada 191 82 0 01 Mar 2021
PLOP: Learning without Forgetting for Continual Semantic SegmentationComputer Vision and Pattern Recognition (CVPR), 2020 Arthur Douillard Yifu Chen Arnaud Dapogny Matthieu Cord CLL 290 284 0 23 Nov 2020
A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks Eden Belouadah Adrian Daniel Popescu Ioannis Kanellos CLL 370 235 0 03 Nov 2020
On the Exploration of Incremental Learning for Fine-grained Image Retrieval Wei Chen Yu Liu Weiping Wang Tinne Tuytelaars E. Bakker M. Lew CLL 103 19 0 15 Oct 2020
Initial Classifier Weights Replay for Memoryless Class Incremental LearningBritish Machine Vision Conference (BMVC), 2020 Eden Belouadah Adrian Daniel Popescu Ioannis Kanellos CLL 179 24 0 31 Aug 2020
Active Class Incremental Learning for Imbalanced Datasets Eden Belouadah Adrian Daniel Popescu Umang Aggarwal Léo Saci CLL 134 14 0 25 Aug 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 1.6K 3,631 0 09 Jun 2020
PODNet: Pooled Outputs Distillation for Small-Tasks Incremental Learning Arthur Douillard Matthieu Cord Charles Ollion Thomas Robert Eduardo Valle CLL 155 6 0 28 Apr 2020
Faster ILOD: Incremental Learning for Object Detectors based on Faster RCNNPattern Recognition Letters (Pattern Recognit. Lett.), 2020 Can Peng Kun-li Zhao Brian C. Lovell ObjD 239 129 0 09 Mar 2020
ScaIL: Classifier Weights Scaling for Class Incremental LearningIEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2020 Eden Belouadah Adrian Daniel Popescu CLL 150 88 0 16 Jan 2020
Maintaining Discrimination and Fairness in Class Incremental LearningComputer Vision and Pattern Recognition (CVPR), 2019 Bowen Zhao Xi Xiao Guojun Gan Bin Zhang Shutao Xia CLL 350 499 0 16 Nov 2019
Knowledge Distillation for Incremental Learning in Semantic SegmentationComputer Vision and Image Understanding (CVIU), 2019 Umberto Michieli Pietro Zanuttigh CLL VLM 275 107 0 08 Nov 2019
Incremental Learning Techniques for Semantic Segmentation Umberto Michieli Pietro Zanuttigh SSeg CLL VLM 316 263 0 31 Jul 2019