Deep Mutual Learning

1 June 2017

Ying Zhang

Tao Xiang

Timothy M. Hospedales

Huchuan Lu

FedML

ArXiv PDF HTML

Papers citing "Deep Mutual Learning"

50 / 222 papers shown

Title
Collaborative Training of Acoustic Encoders for Speech Recognition Varun K. Nagaraja Yangyang Shi Ganesh Venkatesh Ozlem Kalinli M. Seltzer Vikas Chandra 37 11 0 16 Jun 2021
Mutual Contrastive Learning for Visual Representation Learning Chuanguang Yang Zhulin An Linhang Cai Yongjun Xu VLM SSL 97 75 0 26 Apr 2021
Distill on the Go: Online knowledge distillation in self-supervised learning Prashant Bhat Elahe Arani Bahram Zonooz SSL 22 28 0 20 Apr 2021
SIMPLE: SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimation Jiabin Zhang Zheng Zhu Jiwen Lu Junjie Huang Guan Huang Jie Zhou 3DH 21 13 0 06 Apr 2021
Federated Few-Shot Learning with Adversarial Learning Chenyou Fan Jianwei Huang FedML 13 29 0 01 Apr 2021
Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization Xin Jin Tianyu He Kecheng Zheng Zhiheng Yin Xu Shen Zhen Huang Ruoyu Feng Jianqiang Huang Xiansheng Hua Zhibo Chen CVBM 24 124 0 29 Mar 2021
Distilling a Powerful Student Model via Online Knowledge Distillation Shaojie Li Mingbao Lin Yan Wang Yongjian Wu Yonghong Tian Ling Shao Rongrong Ji FedML 25 46 0 26 Mar 2021
Learning Scene Structure Guidance via Cross-Task Knowledge Transfer for Single Depth Super-Resolution Baoli Sun Xinchen Ye Baopu Li Haojie Li Zhihui Wang Rui Xu 11 44 0 24 Mar 2021
Intra-Inter Camera Similarity for Unsupervised Person Re-Identification Shiyu Xuan Shiliang Zhang 25 173 0 22 Mar 2021
Adaptive Multi-Teacher Multi-level Knowledge Distillation Yuang Liu Wei Zhang Jun Wang 16 157 0 06 Mar 2021
Semi-supervised Left Atrium Segmentation with Mutual Consistency Training Yicheng Wu Minfeng Xu Z. Ge Jianfei Cai Lei Zhang 13 205 0 04 Mar 2021
Siamese Labels Auxiliary Learning Wenrui Gan Zhulin Liu C. L. P. Chen Tong Zhang 14 1 0 27 Feb 2021
End-to-End Automatic Speech Recognition with Deep Mutual Learning Ryo Masumura Mana Ihori Akihiko Takashima Tomohiro Tanaka Takanori Ashihara 22 5 0 16 Feb 2021
Locally Adaptive Label Smoothing for Predictive Churn Dara Bahri Heinrich Jiang NoLa 32 8 0 09 Feb 2021
On the Reproducibility of Neural Network Predictions Srinadh Bhojanapalli Kimberly Wilber Andreas Veit A. S. Rawat Seungyeon Kim A. Menon Sanjiv Kumar 21 35 0 05 Feb 2021
DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimation Alexandre Ramé Matthieu Cord FedML 45 51 0 14 Jan 2021
Decentralized Federated Learning via Mutual Knowledge Transfer Chengxi Li Gang Li P. Varshney FedML 13 105 0 24 Dec 2020
Hardware and Software Optimizations for Accelerating Deep Neural Networks: Survey of Current Trends, Challenges, and the Road Ahead Maurizio Capra Beatrice Bussolino Alberto Marchisio Guido Masera Maurizio Martina Muhammad Shafique BDL 56 140 0 21 Dec 2020
Cross-Layer Distillation with Semantic Calibration Defang Chen Jian-Ping Mei Yuan Zhang Can Wang Yan Feng Chun-Yen Chen FedML 39 286 0 06 Dec 2020
Data-Free Model Extraction Jean-Baptiste Truong Pratyush Maini R. Walls Nicolas Papernot MIACV 15 181 0 30 Nov 2020
Improving RNN Transducer Based ASR with Auxiliary Tasks Chunxi Liu Frank Zhang Duc Le Suyoun Kim Yatharth Saraf Geoffrey Zweig 20 49 0 05 Nov 2020
Anti-Distillation: Improving reproducibility of deep networks G. Shamir Lorenzo Coviello 39 20 0 19 Oct 2020
Densely Guided Knowledge Distillation using Multiple Teacher Assistants Wonchul Son Jaemin Na Junyong Choi Wonjun Hwang 20 110 0 18 Sep 2020
Mutual Teaching for Graph Convolutional Networks Kun Zhan Chaoxi Niu SSL 22 31 0 02 Sep 2020
A Single Frame and Multi-Frame Joint Network for 360-degree Panorama Video Super-Resolution Hongying Liu Zhubo Ruan Chaowei Fang Peng Zhao Fanhua Shang Yuanyuan Liu Lijun Wang 24 17 0 24 Aug 2020
Temporal Self-Ensembling Teacher for Semi-Supervised Object Detection Cong Chen Shouyang Dong Ye Tian K. Cao Li Liu Yuanhao Guo 28 28 0 13 Jul 2020
Multiple Expert Brainstorming for Domain Adaptive Person Re-identification Yunpeng Zhai QiXiang Ye Shijian Lu Mengxi Jia Rongrong Ji Yonghong Tian 13 163 0 03 Jul 2020
Federated Mutual Learning T. Shen Jie M. Zhang Xinkang Jia Fengda Zhang Gang Huang Pan Zhou Kun Kuang Fei Wu Chao-Xiang Wu FedML 17 119 0 27 Jun 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 19 2,835 0 09 Jun 2020
ResKD: Residual-Guided Knowledge Distillation Xuewei Li Songyuan Li Bourahla Omar Fei Wu Xi Li 21 47 0 08 Jun 2020
Self-Augmentation: Generalizing Deep Networks to Unseen Classes for Few-Shot Learning Jinhwan Seo Hong G Jung Seong-Whan Lee SSL 12 39 0 01 Apr 2020
Unpacking Information Bottlenecks: Unifying Information-Theoretic Objectives in Deep Learning Andreas Kirsch Clare Lyle Y. Gal 19 16 0 27 Mar 2020
Circumventing Outliers of AutoAugment with Knowledge Distillation Longhui Wei Anxiang Xiao Lingxi Xie Xin Chen Xiaopeng Zhang Qi Tian 18 62 0 25 Mar 2020
Dynamic Hierarchical Mimicking Towards Consistent Optimization Objectives Duo Li Qifeng Chen 140 19 0 24 Mar 2020
Efficient Crowd Counting via Structured Knowledge Transfer Lingbo Liu Jiaqi Chen Hefeng Wu Tianshui Chen Guanbin Li Liang Lin 24 64 0 23 Mar 2020
Closed-loop Matters: Dual Regression Networks for Single Image Super-Resolution Yong Guo Jian Chen Jingdong Wang Qi Chen Jiezhang Cao Zeshuai Deng Yanwu Xu Mingkui Tan SupR 13 281 0 16 Mar 2020
Combating noisy labels by agreement: A joint training method with co-regularization Hongxin Wei Lei Feng Xiangyu Chen Bo An NoLa 313 497 0 05 Mar 2020
MS-Net: Multi-Site Network for Improving Prostate Segmentation with Heterogeneous MRI Data Quande Liu Qi Dou Lequan Yu Pheng Ann Heng OOD 66 274 0 09 Feb 2020
DeepSIC: Deep Soft Interference Cancellation for Multiuser MIMO Detection Nir Shlezinger Rong Fu Yonina C. Eldar 37 102 0 08 Feb 2020
Feature-map-level Online Adversarial Knowledge Distillation Inseop Chung Seonguk Park Jangho Kim Nojun Kwak GAN 20 128 0 05 Feb 2020
Cooperative Learning via Federated Distillation over Fading Channels Jinhyun Ahn Osvaldo Simeone Joonhyuk Kang FedML 14 29 0 03 Feb 2020
Improving Domain-Adapted Sentiment Classification by Deep Adversarial Mutual Learning Qian Xue Wei Zhang H. Zha 14 39 0 01 Feb 2020
Lightweight 3D Human Pose Estimation Network Training Using Teacher-Student Learning D. Hwang Suntae Kim Nicolas Monet Hideki Koike Soonmin Bae 3DH 20 39 0 15 Jan 2020
Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-identification Yixiao Ge Dapeng Chen Hongsheng Li 13 555 0 06 Jan 2020
Unsupervised Scene Adaptation with Memory Regularization in vivo Zhedong Zheng Yi Yang CLL 13 117 0 24 Dec 2019
Towards Oracle Knowledge Distillation with Neural Architecture Search Minsoo Kang Jonghwan Mun Bohyung Han FedML 28 43 0 29 Nov 2019
QKD: Quantization-aware Knowledge Distillation Jangho Kim Yash Bhalgat Jinwon Lee Chirag I. Patel Nojun Kwak MQ 16 63 0 28 Nov 2019
Search to Distill: Pearls are Everywhere but not the Eyes Yu Liu Xuhui Jia Mingxing Tan Raviteja Vemulapalli Yukun Zhu Bradley Green Xiaogang Wang 22 67 0 20 Nov 2019
Label-similarity Curriculum Learning Ürün Dogan A. Deshmukh Marcin Machura Christian Igel 23 21 0 15 Nov 2019
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 42 1,029 0 23 Oct 2019