An overview of gradient descent optimization algorithms

15 September 2016

Papers citing "An overview of gradient descent optimization algorithms"

50 / 1,016 papers shown

Title
DEAM: Adaptive Momentum with Discriminative Weight for Stochastic Optimization Jiyang Bai Yuxiang Ren Jiawei Zhang ODL 21 1 0 25 Jul 2019
Hyperlink Regression via Bregman Divergence Akifumi Okuno Hidetoshi Shimodaira 36 6 0 22 Jul 2019
A CNN-Based Super-Resolution Technique for Active Fire Detection on Sentinel-2 Data M. Gargiulo Domenico A. G. DellÁglio A. Iodice D. Riccio G. Ruello 24 21 0 25 Jun 2019
Radio Galaxy Zoo: Unsupervised Clustering of Convolutionally Auto-encoded Radio-astronomical Images Nicholas O. Ralph Ray P. Norris Guangchi Fang Laurence A. F. Park T. J. Galvin ... H. Andernach Chris J. Lintott L. Rudnick S. Shabala O. I. Wong 23 34 0 07 Jun 2019
A Novel Deep Neural Network Based Approach for Sparse Code Multiple Access Jinzhi Lin Shengzhong Feng Zhile Yang Yun Zhang Yong Zhang 42 32 0 04 Jun 2019
A multi-path 2.5 dimensional convolutional neural network system for segmenting stroke lesions in brain MRI images Yunzhe Xue F. Farhat Olga Boukrina A. Barrett J. Binder Usman Roshan William W. Graves MedIm 13 64 0 26 May 2019
LGM-Net: Learning to Generate Matching Networks for Few-Shot Learning Huaiyu Li Weiming Dong Xing Mei Chongyang Ma Feiyue Huang Bao-Gang Hu OffRL 32 98 0 15 May 2019
Deep Neural Networks for Marine Debris Detection in Sonar Images Matias Valdenegro-Toro 27 25 0 13 May 2019
1D Convolutional Neural Networks and Applications: A Survey S. Kiranyaz Onur Avcı Osama Abdeljaber T. Ince Moncef Gabbouj D. Inman 3DV 30 1,880 0 09 May 2019
Sketch2code: Generating a website from a paper mockup Alex Robinson 3DV 30 37 0 09 May 2019
Combining Planning and Deep Reinforcement Learning in Tactical Decision Making for Autonomous Driving C. Hoel Katherine Driggs-Campbell Krister Wolff L. Laine Mykel J. Kochenderfer 19 232 0 06 May 2019
Inverse Halftoning Through Structure-Aware Deep Convolutional Neural Networks Chang-Hwan Son 24 14 0 02 May 2019
Declarative Recursive Computation on an RDBMS, or, Why You Should Use a Database For Distributed Machine Learning Dimitrije Jankov Shangyu Luo Binhang Yuan Zhuhua Cai Jia Zou C. Jermaine Zekai J. Gao 26 60 0 25 Apr 2019
Unsupervised Adversarial Domain Adaptation Based On The Wasserstein Distance For Acoustic Scene Classification Konstantinos Drossos P. Magron Tuomas Virtanen 27 37 0 24 Apr 2019
Convergence rates for the stochastic gradient descent method for non-convex objective functions Benjamin J. Fehrman Benjamin Gess Arnulf Jentzen 21 101 0 02 Apr 2019
Machine Vision for Natural Gas Methane Emissions Detection Using an Infrared Camera Jingfan Wang Lyne P. Tchapmi A. Ravikumar M. McGuire Clay S. Bell D. Zimmerle Silvio Savarese A. Brandt 15 100 0 01 Apr 2019
Block stochastic gradient descent for large-scale tomographic reconstruction in a parallel network Yushan Gao A. Biguri T. Blumensath 34 3 0 28 Mar 2019
Deep learning observables in computational fluid dynamics K. Lye Siddhartha Mishra Deep Ray OOD AI4CE 21 158 0 07 Mar 2019
Robust and Subject-Independent Driving Manoeuvre Anticipation through Domain-Adversarial Recurrent Neural Networks Michele Tonutti E. Ruffaldi A. Cattaneo C. Avizzano TTA OOD 16 29 0 26 Feb 2019
LOSSGRAD: automatic learning rate in gradient descent B. Wójcik Lukasz Maziarka Jacek Tabor ODL 42 4 0 20 Feb 2019
Supervised Deep Neural Networks (DNNs) for Pricing/Calibration of Vanilla/Exotic Options Under Various Different Processes Ali Hirsa T. Karatas Amir Oskoui 30 26 0 15 Feb 2019
Bifidelity data-assisted neural networks in nonintrusive reduced-order modeling Chuan Lu Xueyu Zhu 21 11 0 01 Feb 2019
Federated Collaborative Filtering for Privacy-Preserving Personalized Recommendation System Muhammad Ammad-ud-din E. Ivannikova Suleiman A. Khan Were Oyomno Qiang Fu K. E. Tan Adrian Flanagan FedML 37 270 0 29 Jan 2019
Escaping Saddle Points with Adaptive Gradient Methods Matthew Staib Sashank J. Reddi Satyen Kale Sanjiv Kumar S. Sra ODL 14 73 0 26 Jan 2019
Flexible Operator Embeddings via Deep Learning Ryan Marcus Olga Papaemmanouil 11 4 0 25 Jan 2019
Pricing options and computing implied volatilities using neural networks Shuaiqiang Liu C. Oosterlee S. Bohté 19 119 0 25 Jan 2019
Application of Decision Rules for Handling Class Imbalance in Semantic Segmentation Robin Shing Moon Chan Matthias Rottmann Fabian Hüger Peter Schlicht Hanno Gottschalk SSeg 13 40 0 24 Jan 2019
Trust Region Value Optimization using Kalman Filtering Shirli Di-Castro Shashua Shie Mannor 19 7 0 23 Jan 2019
Salient Object Detection with Lossless Feature Reflection and Weighted Structural Loss Pingping Zhang Wen Liu Huchuan Lu Chunhua Shen 23 52 0 21 Jan 2019
Optimizing Deep Neural Networks with Multiple Search Neuroevolution Ahmed Aly David Weikersdorfer C. Delaunay 24 7 0 17 Jan 2019
Location-Centered House Price Prediction: A Multi-Task Learning Approach Guangliang Gao Z. Bao Jie Cao •. A. K. Qin Timos Sellis Zhiang Wu 25 40 0 07 Jan 2019
Deep Energies for Estimating Three-Dimensional Facial Pose and Expression Michael Bao Jane Wu Xinwei Yao Ronald Fedkiw 3DH 23 4 0 07 Dec 2018
Investigating performance of neural networks and gradient boosting models approximating microscopic traffic simulations in traffic optimization tasks P. Góra M. Brzeski Marcin Mo.zejko Arkadiusz Klemenko A. Kochanski 19 6 0 02 Dec 2018
HSD-CNN: Hierarchically self decomposing CNN architecture using class specific filter sensitivity analysis Kasanagottu Sairam J. Mukherjee A. Patra P. Das 27 5 0 11 Nov 2018
A Local Block Coordinate Descent Algorithm for the Convolutional Sparse Coding Model E. Zisselman Jeremias Sulam Michael Elad 19 10 0 01 Nov 2018
A Hitchhiker's Guide On Distributed Training of Deep Neural Networks K. Chahal Manraj Singh Grover Kuntal Dey 3DH OOD 6 53 0 28 Oct 2018
Quasi-hyperbolic momentum and Adam for deep learning Jerry Ma Denis Yarats ODL 84 129 0 16 Oct 2018
$Learning to fail: Predicting fracture evolution in brittle material models using recurrent graph convolutional neural networks$ Learning to fail: Predicting fracture evolution in brittle material models using recurrent graph convolutional neural networks Max Schwarzer Bryce Rogan Yadong Ruan Zhengming Song Diana Lee ... V. Chau B. Moore E. Rougier Hari S. Viswanathan G. Srinivasan AI4CE 24 70 0 14 Oct 2018
CHOPT : Automated Hyperparameter Optimization Framework for Cloud-Based Machine Learning Platforms Jingwoong Kim Minkyu Kim Heungseok Park Ernar Kusdavletov Dongjun Lee A. Kim Ji-Hoon Kim Jung-Woo Ha Nako Sung 34 14 0 08 Oct 2018
NSGA-Net: Neural Architecture Search using Multi-Objective Genetic Algorithm Zhichao Lu Ian Whalen Vishnu Boddeti Yashesh D. Dhebar Kalyanmoy Deb E. Goodman W. Banzhaf 34 81 0 08 Oct 2018
Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues Yaohua Sun M. Peng Yangcheng Zhou Yuzhe Huang S. Mao 19 432 0 24 Sep 2018
Machine Learning for semi linear PDEs Quentin Chan-Wai-Nam Joseph Mikael X. Warin ODL 24 111 0 20 Sep 2018
Capacity Control of ReLU Neural Networks by Basis-path Norm Shuxin Zheng Qi Meng Huishuai Zhang Wei-neng Chen Nenghai Yu Tie-Yan Liu 24 23 0 19 Sep 2018
UAV Pose Estimation using Cross-view Geolocalization with Satellite Imagery Akshay Shetty Grace Gao 22 40 0 16 Sep 2018
RedSync : Reducing Synchronization Traffic for Distributed Deep Learning Jiarui Fang Haohuan Fu Guangwen Yang Cho-Jui Hsieh GNN 22 25 0 13 Aug 2018
Fast and Robust Symmetric Image Registration Based on Distances Combining Intensity and Spatial Information Johan Öfverstedt Joakim Lindblad Natasa Sladoje 17 42 0 30 Jul 2018
Convolutional Recurrent Neural Networks for Glucose Prediction Kezhi Li J. Daniels Chengyuan Liu P. Herrero Pantelis Georgiou BDL 21 215 0 09 Jul 2018
A Machine Learning Framework for Stock Selection XingYu Fu JinHong Du Yifeng Guo MingWen Liu Tao Dong XiuWen Duan AIFin 25 31 0 05 Jun 2018
Solving the Kolmogorov PDE by means of deep learning C. Beck S. Becker Philipp Grohs Nor Jaafari Arnulf Jentzen 24 91 0 01 Jun 2018
An improvement of the convergence proof of the ADAM-Optimizer Sebastian Bock Josef Goppold M. Weiß 23 139 0 27 Apr 2018