FitNets: Hints for Thin Deep Nets

19 December 2014

Adriana Romero

Nicolas Ballas

Samira Ebrahimi Kahou

Papers citing "FitNets: Hints for Thin Deep Nets"

50 / 667 papers shown

Title
Self-Referenced Deep Learning Xu Lan Xiatian Zhu S. Gong 27 23 0 19 Nov 2018
RePr: Improved Training of Convolutional Filters Aaditya (Adi) Prakash J. Storer D. Florêncio Cha Zhang VLM CVBM 35 57 0 18 Nov 2018
Towards Training Recurrent Neural Networks for Lifelong Learning Shagun Sodhani A. Chandar Yoshua Bengio CLL 11 19 0 16 Nov 2018
Amalgamating Knowledge towards Comprehensive Classification Chengchao Shen L. Câlmâc Mingli Song Li Sun Xiuming Zhang MoMe 22 89 0 07 Nov 2018
Sequenced-Replacement Sampling for Deep Learning C. Ho Dae Hoon Park Wei Yang Yi Chang 24 0 0 19 Oct 2018
Rethinking the Value of Network Pruning Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang Trevor Darrell 10 1,449 0 11 Oct 2018
Virtual Battery Parameter Identification using Transfer Learning based Stacked Autoencoder Indrasis Chakraborty S. Nandanoori Soumya Kundu 18 13 0 10 Oct 2018
Light-Weight RefineNet for Real-Time Semantic Segmentation Vladimir Nekrasov Chunhua Shen Ian Reid SSeg VLM 24 147 0 08 Oct 2018
Ranking Distillation: Learning Compact Ranking Models With High Performance for Recommender System Jiaxi Tang Ke Wang 27 182 0 19 Sep 2018
Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotations Vladimir Nekrasov Thanuja Dharmasiri Andrew Spek Tom Drummond Chunhua Shen Ian Reid 29 148 0 13 Sep 2018
SECS: Efficient Deep Stream Processing via Class Skew Dichotomy Boyuan Feng Kun Wan Shu Yang Yufei Ding 33 4 0 07 Sep 2018
An Adaptive Locally Connected Neuron Model: Focusing Neuron F. Boray Tek 11 5 0 31 Aug 2018
Attention-Guided Answer Distillation for Machine Reading Comprehension Minghao Hu Yuxing Peng Furu Wei Zhen Huang Dongsheng Li Nan Yang M. Zhou FaML 23 75 0 23 Aug 2018
Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Tasks Nikola B. Kovachki Andrew M. Stuart BDL 42 136 0 10 Aug 2018
Training Compact Neural Networks with Binary Weights and Low Precision Activations Bohan Zhuang Chunhua Shen Ian Reid MQ 13 14 0 08 Aug 2018
Teacher Guided Architecture Search P. Bashivan Mark Tensen J. DiCarlo 3DV 27 27 0 04 Aug 2018
SlimNets: An Exploration of Deep Model Compression and Acceleration Ini Oguntola Subby Olubeko Chris Sweeney 21 11 0 01 Aug 2018
Bi-Real Net: Enhancing the Performance of 1-bit CNNs With Improved Representational Capability and Advanced Training Algorithm Zechun Liu Baoyuan Wu Wenhan Luo Xin Yang Wei Liu K. Cheng MQ 35 550 0 01 Aug 2018
Filter Distillation for Network Compression Xavier Suau Luca Zappella N. Apostoloff 24 38 0 20 Jul 2018
Object Detection with Deep Learning: A Review Zhong-Qiu Zhao Peng Zheng Shou-tao Xu Xindong Wu ObjD 42 3,954 0 15 Jul 2018
SCSP: Spectral Clustering Filter Pruning with Soft Self-adaption Manners Huiyuan Zhuo Xuelin Qian Yanwei Fu Heng Yang Xiangyang Xue 24 37 0 14 Jun 2018
EIGEN: Ecologically-Inspired GENetic Approach for Neural Network Structure Searching from Scratch Jian Ren Zhe Li Jianchao Yang N. Xu Tianbao Yang D. Foran 35 17 0 05 Jun 2018
Defending Against Machine Learning Model Stealing Attacks Using Deceptive Perturbations Taesung Lee Ben Edwards Ian Molloy D. Su AAML 15 40 0 31 May 2018
Collaborative Learning for Deep Neural Networks Guocong Song Wei Chai FedML 21 192 0 30 May 2018
Tensorial Neural Networks: Generalization of Neural Networks and Application to Model Compression Jiahao Su Jingling Li Bobby Bhattacharjee Furong Huang 16 20 0 25 May 2018
Object detection at 200 Frames Per Second Rakesh Mehta Cemalettin Öztürk ObjD 30 61 0 16 May 2018
Knowledge Distillation in Generations: More Tolerant Teachers Educate Better Students Chenglin Yang Lingxi Xie Siyuan Qiao Alan Yuille 29 135 0 15 May 2018
Knowledge Distillation with Adversarial Samples Supporting Decision Boundary Byeongho Heo Minsik Lee Sangdoo Yun J. Choi AAML 26 146 0 15 May 2018
Born Again Neural Networks Tommaso Furlanello Zachary Chase Lipton Michael Tschannen Laurent Itti Anima Anandkumar 36 1,020 0 12 May 2018
I Have Seen Enough: A Teacher Student Network for Video Classification Using Fewer Frames S. Bhardwaj Mitesh M. Khapra 23 3 0 12 May 2018
Quantization Mimic: Towards Very Tiny CNN for Object Detection Yi Wei Xinyu Pan Hongwei Qin Wanli Ouyang Junjie Yan ObjD 22 88 0 06 May 2018
Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling Liyuan Liu Xiang Ren Jingbo Shang Jian-wei Peng Jiawei Han 25 44 0 20 Apr 2018
Pelee: A Real-Time Object Detection System on Mobile Devices R. Wang Xiang Li Charles X. Ling ObjD 14 454 0 18 Apr 2018
IGCV $2$ : Interleaved Structured Sparse Convolutional Neural Networks Guotian Xie Jingdong Wang Ting Zhang Jianhuang Lai Richang Hong Guo-Jun Qi 16 105 0 17 Apr 2018
Learning Deep Representations with Probabilistic Knowledge Transfer Nikolaos Passalis Anastasios Tefas 31 406 0 28 Mar 2018
The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches Md. Zahangir Alom T. Taha C. Yakopcic Stefan Westberg P. Sidike Mst Shamima Nasrin B. Van Essen A. Awwal V. Asari VLM 29 873 0 03 Mar 2018
The Description Length of Deep Learning Models Léonard Blier Yann Ollivier 32 95 0 20 Feb 2018
Towards Principled Design of Deep Convolutional Networks: Introducing SimpNet S. H. HasanPour Mohammad Rouhani Mohsen Fayyaz Mohammad Sabokrou Ehsan Adeli 50 45 0 17 Feb 2018
Few-shot learning of neural networks from scratch by pseudo example optimization Akisato Kimura Zoubin Ghahramani Koh Takeuchi Tomoharu Iwata N. Ueda 35 52 0 08 Feb 2018
Focus: Querying Large Video Datasets with Low Latency and Low Cost Kevin Hsieh Ganesh Ananthanarayanan P. Bodík P. Bahl Matthai Philipose Phillip B. Gibbons O. Mutlu 16 275 0 10 Jan 2018
Improved Inception-Residual Convolutional Neural Network for Object Recognition Md. Zahangir Alom Mahmudul Hasan C. Yakopcic T. Taha V. Asari 46 116 0 28 Dec 2017
DeepChess: End-to-End Deep Neural Network for Automatic Learning in Chess Omid David N. Netanyahu Lior Wolf SSL 29 81 0 27 Nov 2017
Knowledge Concentration: Learning 100K Object Classifiers in a Single CNN J. Gao Zijian Guo Zerui Li Ram Nevatia VLM 20 20 0 21 Nov 2017
Moonshine: Distilling with Cheap Convolutions Elliot J. Crowley Gavia Gray Amos Storkey 27 120 0 07 Nov 2017
Towards Effective Low-bitwidth Convolutional Neural Networks Bohan Zhuang Chunhua Shen Mingkui Tan Lingqiao Liu Ian Reid MQ 31 231 0 01 Nov 2017
Knowledge Projection for Deep Neural Networks Zhi Zhang G. Ning Zhihai He 38 15 0 26 Oct 2017
Data-Free Knowledge Distillation for Deep Neural Networks Raphael Gontijo-Lopes Stefano Fenu Thad Starner 22 270 0 19 Oct 2017
Age Group and Gender Estimation in the Wild with Deep RoR Architecture Ke Zhang Ce Gao Liru Guo Miao Sun Xingfang Yuan T. Han Zhenbing Zhao Baogang Li CVBM 14 113 0 09 Oct 2017
Domain-adaptive deep network compression Marc Masana Joost van de Weijer Luis Herranz Andrew D. Bagdanov J. Álvarez 36 62 0 04 Sep 2017
Orthogonal and Idempotent Transformations for Learning Deep Neural Networks Jingdong Wang Yajie Xing Kexin Zhang Cha Zhang 132 2 0 19 Jul 2017