meProp: Sparsified Back Propagation for Accelerated Deep Learning with Reduced Overfitting

19 June 2017

Xu Sun

Xuancheng Ren

Shuming Ma

Houfeng Wang

ArXiv PDF HTML

Papers citing "meProp: Sparsified Back Propagation for Accelerated Deep Learning with Reduced Overfitting"

21 / 71 papers shown

Title
The Convergence of Sparsified Gradient Methods Dan Alistarh Torsten Hoefler M. Johansson Sarit Khirirat Nikola Konstantinov Cédric Renggli 11 489 0 27 Sep 2018
Sparsified SGD with Memory Sebastian U. Stich Jean-Baptiste Cordonnier Martin Jaggi 41 740 0 20 Sep 2018
Sparsity in Deep Neural Networks - An Empirical Investigation with TensorQuant D. Loroch Franz-Josef Pfreundt Norbert Wehn J. Keuper 19 5 0 27 Aug 2018
EasyConvPooling: Random Pooling with Easy Convolution for Accelerating Training and Testing Jianzhong Sheng Chuanbo Chen Chenchen Fu Chun Jason Xue 6 4 0 05 Jun 2018
Analysis of DAWNBench, a Time-to-Accuracy Machine Learning Performance Benchmark Cody Coleman Daniel Kang Deepak Narayanan Luigi Nardi Tian Zhao Jian Zhang Peter Bailis K. Olukotun Christopher Ré Matei A. Zaharia 13 117 0 04 Jun 2018
Structurally Sparsified Backward Propagation for Faster Long Short-Term Memory Training Maohua Zhu Jason Clemons Jeff Pool Minsoo Rhu S. Keckler Yuan Xie 11 13 0 01 Jun 2018
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 79 1,047 0 24 May 2018
Approximate Random Dropout Zhuoran Song Ru Wang Dongyu Ru Hongru Huang Zhenghao Peng Hai Zhao Xiaoyao Liang Li Jiang BDL 28 9 0 23 May 2018
Faster Neural Network Training with Approximate Tensor Operations Menachem Adelman Kfir Y. Levy Ido Hakimi M. Silberstein 29 26 0 21 May 2018
Bag-of-Words as Target for Neural Machine Translation Shuming Ma Xu Sun Yizhong Wang Junyang Lin 3DV 16 76 0 13 May 2018
Autoencoder as Assistant Supervisor: Improving Text Representation for Chinese Social Media Text Summarization Shuming Ma Xu Sun Junyang Lin Houfeng Wang 30 46 0 13 May 2018
A Hierarchical End-to-End Model for Jointly Improving Text Summarization and Sentiment Classification Shuming Ma Xu Sun Junyang Lin Xuancheng Ren 8 59 0 03 May 2018
Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation Shuming Ma Xu Sun Wei Li Sujian Li Wenjie Li Xuancheng Ren 31 62 0 05 Mar 2018
SparCML: High-Performance Sparse Communication for Machine Learning Cédric Renggli Saleh Ashkboos Mehdi Aghagolzadeh Dan Alistarh Torsten Hoefler 29 126 0 22 Feb 2018
Decoding-History-Based Adaptive Control of Attention for Neural Machine Translation Junyang Lin Shuming Ma Qi Su Xu Sun 28 16 0 06 Feb 2018
Building an Ellipsis-aware Chinese Dependency Treebank for Web Text Xuancheng Ren Xu Sun Ji Wen Bingzhen Wei Weidong Zhan Zhiyuan Zhang 28 2 0 20 Jan 2018
Hybrid Oracle: Making Use of Ambiguity in Transition-based Chinese Dependency Parsing Xuancheng Ren Xu Sun 42 1 0 28 Nov 2017
Training Simplification and Model Simplification for Deep Learning: A Minimal Effort Back Propagation Method Xu Sun Xuancheng Ren Shuming Ma Bingzhen Wei Wei Li Jingjing Xu Houfeng Wang Yi Zhang 23 25 0 17 Nov 2017
Shallow Discourse Parsing with Maximum Entropy Model Jingjing Xu 16 0 0 31 Oct 2017
Label Embedding Network: Learning Label Representation for Soft Training of Deep Networks Xu Sun Bingzhen Wei Xuancheng Ren Shuming Ma 24 40 0 28 Oct 2017
Minimal Effort Back Propagation for Convolutional Neural Networks Bingzhen Wei Xu Sun Xuancheng Ren Jingjing Xu 19 28 0 18 Sep 2017