Distilling the Knowledge in a Neural Network

9 March 2015

Papers citing "Distilling the Knowledge in a Neural Network"

27 / 327 papers shown

Title
DeeperGCN: All You Need to Train Deeper GCNs Guohao Li Chenxin Xiong Ali K. Thabet Guohao Li GNN 107 436 0 13 Jun 2020
Ensemble Distillation for Robust Model Fusion in Federated Learning Tao R. Lin Lingjing Kong Sebastian U. Stich Martin Jaggi FedML 47 1,026 0 12 Jun 2020
SuperMix: Supervising the Mixing Data Augmentation Ali Dabouei Sobhan Soleymani Fariborz Taherkhani Nasser M. Nasrabadi 40 98 0 10 Mar 2020
Faster ILOD: Incremental Learning for Object Detectors based on Faster RCNN Can Peng Kun-li Zhao Brian C. Lovell ObjD 35 110 0 09 Mar 2020
StyleGAN2 Distillation for Feed-forward Image Manipulation Yuri Viazovetskyi V. Ivashkin Evgenii Kashin 174 136 0 07 Mar 2020
ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functions Zechun Liu Zhiqiang Shen Marios Savvides Kwang-Ting Cheng MQ 66 350 0 07 Mar 2020
ClusterFit: Improving Generalization of Visual Representations Xueting Yan Ishan Misra Abhinav Gupta Deepti Ghadiyaram D. Mahajan SSL VLM 47 132 0 06 Dec 2019
Can Monolingual Pretrained Models Help Cross-Lingual Classification? Zewen Chi Li Dong Furu Wei Xian-Ling Mao Heyan Huang LRM VLM 60 13 0 10 Nov 2019
Fast Structured Decoding for Sequence Models Zhiqing Sun Zhuohan Li Haoqing Wang Zi Lin Di He Zhihong Deng 50 122 0 25 Oct 2019
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 83 1,037 0 23 Oct 2019
Deep Learning at the Edge Sahar Voghoei N. Tonekaboni Jason G. Wallace H. Arabnia 68 41 0 22 Oct 2019
Convolutional Prototype Learning for Zero-Shot Recognition Zhizhe Liu Xingxing Zhang Zhenfeng Zhu Shuai Zheng Yao Zhao Jian Cheng VLM 37 19 0 22 Oct 2019
Face Behavior a la carte: Expressions, Affect and Action Units in a Single Network D. Kollias V. Sharmanska Ki-young Shin CVBM 68 214 0 15 Oct 2019
Learning Compact Recurrent Neural Networks with Block-Term Tensor Decomposition Jinmian Ye Linnan Wang Guangxi Li Di Chen Shandian Zhe Xinqi Chu Zenglin Xu 62 132 0 14 Dec 2017
Parallel WaveNet: Fast High-Fidelity Speech Synthesis Aaron van den Oord Yazhe Li Igor Babuschkin Karen Simonyan Oriol Vinyals ... Alex Graves Helen King T. Walters Dan Belov Demis Hassabis 114 857 0 28 Nov 2017
Hardware-Software Codesign of Accurate, Multiplier-free Deep Neural Networks Hokchhay Tann S. Hashemi Iris Bahar Sherief Reda MQ 55 74 0 11 May 2017
Cross-lingual Distillation for Text Classification Ruochen Xu Yiming Yang VLM 38 71 0 05 May 2017
Robustness to Adversarial Examples through an Ensemble of Specialists Mahdieh Abbasi Christian Gagné AAML 38 109 0 22 Feb 2017
Collaborative Deep Reinforcement Learning Kaixiang Lin Shu Wang Jiayu Zhou 38 21 0 19 Feb 2017
Visual Saliency Prediction Using a Mixture of Deep Neural Networks Samuel F. Dodge Lina Karam FAtt 52 48 0 01 Feb 2017
Learning From Noisy Large-Scale Datasets With Minimal Supervision Andreas Veit N. Alldrin Gal Chechik Ivan Krasin Abhinav Gupta Serge J. Belongie 65 476 0 06 Jan 2017
Small-footprint Highway Deep Neural Networks for Speech Recognition Liang Lu Steve Renals 59 16 0 18 Oct 2016
Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data Nicolas Papernot Martín Abadi Ulfar Erlingsson Ian Goodfellow Kunal Talwar 45 1,009 0 18 Oct 2016
Xception: Deep Learning with Depthwise Separable Convolutions François Chollet MDE BDL PINN 745 14,454 0 07 Oct 2016
FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognition Hui Ding S. Kevin Zhou Rama Chellappa CVBM 60 363 0 21 Sep 2016
Practical Black-Box Attacks against Machine Learning Nicolas Papernot Patrick McDaniel Ian Goodfellow S. Jha Z. Berkay Celik A. Swami MLAU AAML 36 3,656 0 08 Feb 2016
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 356 7,650 0 03 Jul 2012