An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 1,016 papers shown

Title
Influence Functions in Deep Learning Are Fragile S. Basu Phillip E. Pope S. Feizi TDI 37 220 0 25 Jun 2020
Explainable CNN-attention Networks (C-Attention Network) for Automated Detection of Alzheimer's Disease Ning Wang Mingxuan Chen K. P. Subbalakshmi 25 22 0 25 Jun 2020
A Constructive, Type-Theoretic Approach to Regression via Global Optimisation D. Ghica Todd Waugh Ambridge 10 0 0 23 Jun 2020
Deep Learning with Functional Inputs Barinder Thind Kevin Multani Jiguo Cao 24 21 0 17 Jun 2020
Interaction Networks: Using a Reinforcement Learner to train other Machine Learning algorithms Florian Dietz 20 1 0 15 Jun 2020
Almost sure convergence rates for Stochastic Gradient Descent and Stochastic Heavy Ball Othmane Sebbouh Robert Mansel Gower Aaron Defazio 22 22 0 14 Jun 2020
A comparative study of 2D image segmentation algorithms for traumatic brain lesions using CT data from the ProTECTIII multicenter clinical trial Shruti Jadon Owen P. Leary I. Pan Tyler Harder D. Wright Lisa H. Merck D. Merck 38 27 0 01 Jun 2020
A Comprehensive Study of Data Augmentation Strategies for Prostate Cancer Detection in Diffusion-weighted MRI using Convolutional Neural Networks Ruqian Hao Khashayar Namdar Lin Liu M. Haider Farzad Khalvati MedIm 26 57 0 01 Jun 2020
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning Z. Yao A. Gholami Sheng Shen Mustafa Mustafa Kurt Keutzer Michael W. Mahoney ODL 39 275 0 01 Jun 2020
Synthetic Learning: Learn From Distributed Asynchronized Discriminator GAN Without Sharing Medical Image Data Qi Chang Hui Qu Yikai Zhang M. Sabuncu Chao Chen Tong Zhang Dimitris N. Metaxas MedIm 34 78 0 29 May 2020
Mass Estimation of Galaxy Clusters with Deep Learning II: CMB Cluster Lensing N. Gupta C. Reichardt 24 13 0 28 May 2020
Generative Adversarial Networks for Bitcoin Data Augmentation Francesco Zola Jan L. Bruse Xabier Etxeberria Barrio M. Galar Raul Orduna Urrutia GAN 22 8 0 27 May 2020
An Introduction to Neural Architecture Search for Convolutional Networks George Kyriakides K. Margaritis AI4CE 33 27 0 22 May 2020
Hidden Markov Chains, Entropic Forward-Backward, and Part-Of-Speech Tagging E. Azeraf E. Monfrini Emmanuel Vignon W. Pieczynski BDL 32 9 0 21 May 2020
Automated Copper Alloy Grain Size Evaluation Using a Deep-learning CNN George S. Baggs P. Guerrier A. Loeb Jason C. Jones 28 9 0 20 May 2020
A Combined Data-driven and Physics-driven Method for Steady Heat Conduction Prediction using Deep Convolutional Neural Networks Hao Ma Xiangyu Y. Hu Yuxuan Zhang Nils Thuerey O. Haidn AI4CE 26 12 0 16 May 2020
MixML: A Unified Analysis of Weakly Consistent Parallel Learning Yucheng Lu J. Nash Christopher De Sa FedML 32 12 0 14 May 2020
A Review of Privacy-preserving Federated Learning for the Internet-of-Things Christopher Briggs Zhong Fan Péter András 31 15 0 24 Apr 2020
Automated diagnosis of COVID-19 with limited posteroanterior chest X-ray images using fine-tuned deep neural networks Narinder Singh Punn Sonali Agarwal 15 191 0 23 Apr 2020
Structure-preserving neural networks Quercus Hernandez Alberto Badías D. González Francisco Chinesta Elías Cueto PINN 22 70 0 09 Apr 2020
Weighted Aggregating Stochastic Gradient Descent for Parallel Deep Learning Pengzhan Guo Zeyang Ye Keli Xiao Wei Zhu 24 14 0 07 Apr 2020
Adaptive Partial Scanning Transmission Electron Microscopy with Reinforcement Learning Jeffrey M. Ede 29 12 0 06 Apr 2020
On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs Yeonjong Shin Jérome Darbon George Karniadakis PINN 14 79 0 03 Apr 2020
OptTyper: Probabilistic Type Inference by Optimising Logical and Natural Constraints Irene Vlassi Pandi Earl T. Barr Andrew D. Gordon Charles Sutton 22 29 0 01 Apr 2020
Improving the Backpropagation Algorithm with Consequentialism Weight Updates over Mini-Batches Naeem Paeedeh Kamaledin Ghiasi-Shirazi ODL 14 8 0 11 Mar 2020
Explore and Exploit with Heterotic Line Bundle Models Magdalena Larfors Robin Schneider 41 38 0 10 Mar 2020
Joint Parameter-and-Bandwidth Allocation for Improving the Efficiency of Partitioned Edge Learning Dingzhu Wen M. Bennis Kaibin Huang 31 48 0 10 Mar 2020
Warwick Electron Microscopy Datasets Jeffrey M. Ede 30 14 0 02 Mar 2020
CSM-NN: Current Source Model Based Logic Circuit Simulation -- A Neural Network Approach M. Abrishami Massoud Pedram Shahin Nazarian 17 7 0 13 Feb 2020
LaProp: Separating Momentum and Adaptivity in Adam Liu Ziyin Zhikang T.Wang Masahito Ueda ODL 13 18 0 12 Feb 2020
On Layer Normalization in the Transformer Architecture Ruibin Xiong Yunchang Yang Di He Kai Zheng Shuxin Zheng Chen Xing Huishuai Zhang Yanyan Lan Liwei Wang Tie-Yan Liu AI4CE 59 953 0 12 Feb 2020
A Comprehensive Survey of Multilingual Neural Machine Translation Raj Dabre Chenhui Chu Anoop Kunchukuttan LRM 36 33 0 04 Jan 2020
Deep Learning-Based Intrusion Detection System for Advanced Metering Infrastructure Zakaria El Mrabet Mehdi Ezzari Hassan El Ghazi B. A. E. Majd 16 14 0 31 Dec 2019
Pipelined Training with Stale Weights of Deep Convolutional Neural Networks Lifu Zhang T. Abdelrahman 24 0 0 29 Dec 2019
SoftAdapt: Techniques for Adaptive Loss Weighting of Neural Networks with Multi-Part Loss Functions A. Heydari Craig Thompson A. Mehmood 32 59 0 27 Dec 2019
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 30 168 0 19 Dec 2019
Adaptive dynamic programming for nonaffine nonlinear optimal control problem with state constraints Jingliang Duan Zhengyu Liu Shengbo Eben Li Qi Sun Zhenzhong Jia B. Cheng 23 64 0 26 Nov 2019
Smart Predict-and-Optimize for Hard Combinatorial Optimization Problems Jaynta Mandi Emir Demirović Peter J. Stuckey Tias Guns 23 143 0 22 Nov 2019
Variable Star Classification Using Multi-View Metric Learning K. Johnston S. Caballero-Nieves V. Petit A. Peter Rana Haber 17 3 0 13 Nov 2019
An Efficient and Effective Second-Order Training Algorithm for LSTM-based Adaptive Learning Nuri Mert Vural Salih Ergüt Suleyman Serdar Kozat 21 12 0 22 Oct 2019
Characterizing Deep Learning Training Workloads on Alibaba-PAI Mengdi Wang Chen Meng Guoping Long Chuan Wu Jun Yang Wei Lin Yangqing Jia 25 54 0 14 Oct 2019
Generative Neural Network based Spectrum Sharing using Linear Sum Assignment Problems A. B. Zaki J. Huang Kaishun Wu B. Elhalawany 22 15 0 12 Oct 2019
Demon: Improved Neural Network Training with Momentum Decay John Chen Cameron R. Wolfe Zhaoqi Li Anastasios Kyrillidis ODL 24 15 0 11 Oct 2019
Distributed Learning of Deep Neural Networks using Independent Subnet Training John Shelton Hyatt Cameron R. Wolfe Michael Lee Yuxin Tang Anastasios Kyrillidis Christopher M. Jermaine OOD 29 35 0 04 Oct 2019
Stochastic gradient descent for hybrid quantum-classical optimization R. Sweke Frederik Wilde Johannes Jakob Meyer Maria Schuld Paul K. Fährmann Barthélémy Meynard-Piganeau Jens Eisert 17 236 0 02 Oct 2019
Locally adaptive activation functions with slope recovery term for deep and physics-informed neural networks Ameya Dilip Jagtap Kenji Kawaguchi George Karniadakis ODL 29 85 0 25 Sep 2019
Deep Convolutions for In-Depth Automated Rock Typing E. E. Baraboshkin L. Ismailova D. Orlov E. Zhukovskaya G. Kalmykov O. V. Khotylev E. Baraboshkin D. Koroteev 36 84 0 23 Sep 2019
A Multi-level procedure for enhancing accuracy of machine learning algorithms K. Lye Siddhartha Mishra Roberto Molinaro 17 32 0 20 Sep 2019
Learn to Compress CSI and Allocate Resources in Vehicular Networks Liang Wang Hao Ye Le Liang Geoffrey Ye Li 20 39 0 12 Aug 2019
The Wang-Landau Algorithm as Stochastic Optimization and Its Acceleration Chenguang Dai Jun S. Liu 27 4 0 27 Jul 2019