An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

16 / 1,016 papers shown

Title
High-dimension Tensor Completion via Gradient-based Optimization Under Tensor-train Format Longhao Yuan Qibin Zhao Lihua Gui Jianting Cao ViT 18 55 0 05 Apr 2018
Deep Reinforcement Learning for Traffic Light Control in Vehicular Networks Xiaoyuan Liang Xunsheng Du Guiling Wang Zhu Han 35 410 0 29 Mar 2018
Lower error bounds for the stochastic gradient descent optimization algorithm: Sharp convergence rates for slowly and fast decaying learning rates Arnulf Jentzen Philippe von Wurstemberger 75 31 0 22 Mar 2018
Efficient Hardware Realization of Convolutional Neural Networks using Intra-Kernel Regular Pruning Maurice Yang Mahmoud Faraj Assem Hussein V. Gaudet CVBM 22 12 0 15 Mar 2018
Deep Learning in Mobile and Wireless Networking: A Survey Chaoyun Zhang P. Patras Hamed Haddadi 50 1,306 0 12 Mar 2018
The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches Md. Zahangir Alom T. Taha C. Yakopcic Stefan Westberg P. Sidike Mst Shamima Nasrin B. Van Essen A. Awwal V. Asari VLM 29 875 0 03 Mar 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 31 194 0 03 Mar 2018
$$\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space$ $\mathcal{G}$ -SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space Qi Meng Shuxin Zheng Huishuai Zhang Wei Chen Zhi-Ming Ma Tie-Yan Liu 35 38 0 11 Feb 2018
Recent Advances in Recurrent Neural Networks Hojjat Salehinejad Sharan Sankar Joseph Barfett E. Colak S. Valaee AI4TS 37 574 0 29 Dec 2017
Estimating Historical Hourly Traffic Volumes via Machine Learning and Vehicle Probe Data: A Maryland Case Study Przemysław Sekuła Nikola Marković Zachary Vander Laan K. Sadabadi 38 62 0 02 Nov 2017
Clickbait Detection in Tweets Using Self-attentive Network Yiwei Zhou 22 53 0 15 Oct 2017
Train longer, generalize better: closing the generalization gap in large batch training of neural networks Elad Hoffer Itay Hubara Daniel Soudry ODL 44 795 0 24 May 2017
Efficient Parallel Translating Embedding For Knowledge Graphs Denghui Zhang Manling Li Yantao Jia Yuanzhuo Wang Xueqi Cheng 32 18 0 30 Mar 2017
Deep Robust Kalman Filter Shirli Di-Castro Shashua Shie Mannor BDL 30 28 0 07 Mar 2017
Neural Machine Translation and Sequence-to-sequence Models: A Tutorial Graham Neubig AIMat 37 171 0 05 Mar 2017
A State Space Approach for Piecewise-Linear Recurrent Neural Networks for Reconstructing Nonlinear Dynamics from Neural Measurements Daniel Durstewitz 6 54 0 23 Dec 2016