FitNets: Hints for Thin Deep Nets

19 December 2014

Adriana Romero

Nicolas Ballas

Samira Ebrahimi Kahou

Papers citing "FitNets: Hints for Thin Deep Nets"

50 / 667 papers shown

Title
Interleaved Group Convolutions for Deep Neural Networks Ting Zhang Guo-Jun Qi Bin Xiao Jingdong Wang 33 81 0 10 Jul 2017
DarkRank: Accelerating Deep Metric Learning via Cross Sample Similarities Transfer Yuntao Chen Naiyan Wang Zhaoxiang Zhang FedML 51 217 0 05 Jul 2017
Data-Driven Sparse Structure Selection for Deep Neural Networks Zehao Huang Naiyan Wang 53 558 0 05 Jul 2017
DiracNets: Training Very Deep Neural Networks Without Skip-Connections Sergey Zagoruyko N. Komodakis UQCV OOD 11 117 0 01 Jun 2017
Iterative Machine Teaching Weiyang Liu Bo Dai Ahmad Humayun C. Tay Chen Yu Linda B. Smith James M. Rehg Le Song 26 140 0 30 May 2017
Feature Incay for Representation Regularization Yuhui Yuan Kuiyuan Yang Chao Zhang 35 16 0 29 May 2017
Hardware-Software Codesign of Accurate, Multiplier-free Deep Neural Networks Hokchhay Tann S. Hashemi Iris Bahar Sherief Reda MQ 14 74 0 11 May 2017
Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation G. Ning Zhi Zhang Zhiquan He GAN 29 169 0 05 May 2017
Inception Recurrent Convolutional Neural Network for Object Recognition Md. Zahangir Alom Mahmudul Hasan C. Yakopcic T. Taha 39 86 0 25 Apr 2017
Snapshot Ensembles: Train 1, get M for free Gao Huang Yixuan Li Geoff Pleiss Zhuang Liu J. Hopcroft Kilian Q. Weinberger OOD FedML UQCV 45 935 0 01 Apr 2017
More is Less: A More Complicated Network with Less Inference Complexity Xuanyi Dong Junshi Huang Yi Yang Shuicheng Yan 26 288 0 25 Mar 2017
Batch-normalized joint training for DNN-based distant speech recognition Mirco Ravanelli Philemon Brakel M. Omologo Yoshua Bengio 13 35 0 24 Mar 2017
Knowledge distillation using unlabeled mismatched images Mandar M. Kulkarni Kalpesh Patil Shirish S. Karande 28 16 0 21 Mar 2017
Second-order Convolutional Neural Networks Kaicheng Yu Mathieu Salzmann 13 51 0 20 Mar 2017
A Novel Weight-Shared Multi-Stage CNN for Scale Robustness Ryo Takahashi Takashi Matsubara K. Uehara OOD 30 21 0 12 Feb 2017
Fast and Accurate Entity Recognition with Iterated Dilated Convolutions Emma Strubell Pat Verga David Belanger Andrew McCallum 30 391 0 07 Feb 2017
Deep Learning with Low Precision by Half-wave Gaussian Quantization Zhaowei Cai Xiaodong He Jian Sun Nuno Vasconcelos MQ 36 502 0 03 Feb 2017
Universal representations:The missing link between faces, text, planktons, and cat breeds Hakan Bilen Andrea Vedaldi 38 147 0 25 Jan 2017
Stacked Generative Adversarial Networks Xun Huang Yixuan Li Omid Poursaeed J. Hopcroft Serge J. Belongie GAN 22 458 0 13 Dec 2016
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 14 2,550 0 12 Dec 2016
Large-Margin Softmax Loss for Convolutional Neural Networks Weiyang Liu Yandong Wen Zhiding Yu Meng Yang CVBM 19 1,451 0 07 Dec 2016
A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images David Vázquez Jorge Bernal F. Sánchez Gloria Fernández-Esparrach Antonio M. López Adriana Romero M. Drozdzal Aaron Courville 3DV 14 621 0 02 Dec 2016
In Teacher We Trust: Learning Compressed Models for Pedestrian Detection Jonathan Shen Noranart Vesdapunt Vishnu Naresh Boddeti Kris M. Kitani 13 29 0 01 Dec 2016
Training Sparse Neural Networks Suraj Srinivas Akshayvarun Subramanya R. Venkatesh Babu 11 204 0 21 Nov 2016
Learning the Number of Neurons in Deep Networks J. Álvarez Mathieu Salzmann 21 412 0 19 Nov 2016
Factorized Bilinear Models for Image Recognition Yanghao Li Naiyan Wang Jiaying Liu Xiaodi Hou 19 96 0 17 Nov 2016
Fully-adaptive Feature Sharing in Multi-Task Networks with Applications in Person Attribute Classification Y. Lu Abhishek Kumar Shuangfei Zhai Yu Cheng T. Javidi Rogerio Feris 3DH 21 384 0 16 Nov 2016
Deep Model Compression: Distilling Knowledge from Noisy Teachers Bharat Bhusan Sau V. Balasubramanian 18 181 0 30 Oct 2016
Small-footprint Highway Deep Neural Networks for Speech Recognition Liang Lu Steve Renals 30 15 0 18 Oct 2016
Do They All Look the Same? Deciphering Chinese, Japanese and Koreans by Fine-Grained Deep Learning Yu Wang Haofu Liao Yang Feng Xiangyang Xu Jiebo Luo CVBM 17 25 0 06 Oct 2016
Knowledge Guided Disambiguation for Large-Scale Scene Classification with Multi-Resolution CNNs Limin Wang Sheng Guo Weilin Huang Yuanjun Xiong Yu Qiao 24 142 0 04 Oct 2016
X-CNN: Cross-modal Convolutional Neural Networks for Sparse Datasets Petar Velickovic Duo Wang Nicholas D. Lane Pietro Lió 18 31 0 01 Oct 2016
HyperNetworks David R Ha Andrew M. Dai Quoc V. Le 84 1,585 0 27 Sep 2016
Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations Itay Hubara Matthieu Courbariaux Daniel Soudry Ran El-Yaniv Yoshua Bengio MQ 42 1,842 0 22 Sep 2016
FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognition Hui Ding S. Kevin Zhou Rama Chellappa CVBM 39 363 0 21 Sep 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu L. V. D. van der Maaten Kilian Q. Weinberger PINN 3DV 315 36,381 0 25 Aug 2016
Lets keep it simple, Using simple architectures to outperform deeper and more complex architectures S. H. HasanPour Mohammad Rouhani Mohsen Fayyaz Mohammad Sabokrou 18 118 0 22 Aug 2016
The Importance of Skip Connections in Biomedical Image Segmentation M. Drozdzal Eugene Vorontsov Gabriel Chartrand Samuel Kadoury C. Pal MedIm 35 1,035 0 14 Aug 2016
Residual Networks of Residual Networks: Multilevel Residual Networks Ke Zhang Miao Sun T. Han Xingfang Yuan Liru Guo Tao Liu 18 303 0 09 Aug 2016
Knowledge Distillation for Small-footprint Highway Networks Liang Lu Michelle Guo Steve Renals 16 73 0 02 Aug 2016
Training Skinny Deep Neural Networks with Iterative Hard Thresholding Methods Xiaojie Jin Xiao-Tong Yuan Jiashi Feng Shuicheng Yan 16 78 0 19 Jul 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 75 4,310 0 29 Jun 2016
Sequence-Level Knowledge Distillation Yoon Kim Alexander M. Rush 27 1,098 0 25 Jun 2016
FractalNet: Ultra-Deep Neural Networks without Residuals Gustav Larsson Michael Maire Gregory Shakhnarovich 45 933 0 24 May 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 68 7,907 0 23 May 2016
Swapout: Learning an ensemble of deep architectures Saurabh Singh Derek Hoiem David A. Forsyth BDL 3DPC OOD UQCV 21 150 0 20 May 2016
Training Constrained Deconvolutional Networks for Road Scene Semantic Segmentation G. Ros Simon Stent P. Alcantarilla Tomoki Watanabe 13 55 0 06 Apr 2016
Do Deep Convolutional Nets Really Need to be Deep and Convolutional? G. Urban Krzysztof J. Geras Samira Ebrahimi Kahou Ozlem Aslan Shengjie Wang R. Caruana Abdel-rahman Mohamed Matthai Philipose Matthew Richardson 20 47 0 17 Mar 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 14 10,125 0 16 Mar 2016
Network Morphism Tao Wei Changhu Wang Y. Rui Chia-Ju Chen 21 176 0 05 Mar 2016