Convergence Analysis of Two-layer Neural Networks with ReLU Activation

28 May 2017

Papers citing "Convergence Analysis of Two-layer Neural Networks with ReLU Activation"

33 / 33 papers shown

Title
Quantum Cognition-Inspired EEG-based Recommendation via Graph Neural Networks Jinkun Han Wei Li Yongqian Li Zhipeng Cai 81 2 0 05 Jan 2025
Revisiting Graph Neural Networks on Graph-level Tasks: Comprehensive Experiments, Analysis, and Improvements Haoyang Li Yongjun Xu C. Zhang Alexander Zhou Lei Chen Qing Li AI4CE 276 0 0 03 Jan 2025
Integrating Dual Prototypes for Task-Wise Adaption in Pre-Trained Model-Based Class-Incremental Learning Zhiming Xu Steve Yang Baile Xu Jian Zhao Furao Shen CLL 133 0 0 26 Nov 2024
Towards Understanding Why FixMatch Generalizes Better Than Supervised Learning Jingyang Li Jiachun Pan Vincent Y. F. Tan Kim-Chuan Toh Pan Zhou AAML MLT 104 0 0 15 Oct 2024
Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modeling Wanghan Xu Fenghua Ling Wenlong Zhang Tao Han Hao Chen Wanli Ouyang Lei Bai AI4CE 98 5 0 22 May 2024
Federated Minimax Optimization: Improved Convergence Analyses and Algorithms Pranay Sharma Rohan Panda Gauri Joshi P. Varshney FedML 64 49 0 09 Mar 2022
Nonparametric Learning of Two-Layer ReLU Residual Units Zhunxuan Wang Linyun He Chunchuan Lyu Shay B. Cohen MLT OffRL 99 1 0 17 Aug 2020
Learning Neural Networks with Two Nonlinear Layers in Polynomial Time Surbhi Goel Adam R. Klivans 39 52 0 18 Sep 2017
Eigenvalue Decay Implies Polynomial-Time Learnability for Neural Networks Surbhi Goel Adam R. Klivans 36 27 0 11 Aug 2017
Recovery Guarantees for One-hidden-layer Neural Networks Kai Zhong Zhao Song Prateek Jain Peter L. Bartlett Inderjit S. Dhillon MLT 103 336 0 10 Jun 2017
Learning ReLUs via Gradient Descent Mahdi Soltanolkotabi MLT 61 181 0 10 May 2017
Exponentially vanishing sub-optimal local minima in multilayer neural networks Daniel Soudry Elad Hoffer 108 97 0 19 Feb 2017
Reliably Learning the ReLU in Polynomial Time Surbhi Goel Varun Kanade Adam R. Klivans J. Thaler 60 126 0 30 Nov 2016
Identity Matters in Deep Learning Moritz Hardt Tengyu Ma OOD 53 399 0 14 Nov 2016
Distribution-Specific Hardness of Learning Neural Networks Ohad Shamir 58 116 0 05 Sep 2016
Risk Bounds for High-dimensional Ridge Function Combinations Including Neural Networks Jason M. Klusowski Andrew R. Barron 49 69 0 05 Jul 2016
Deep Learning without Poor Local Minima Kenji Kawaguchi ODL 149 922 0 23 May 2016
Toward Deeper Understanding of Neural Networks: The Power of Initialization and a Dual View on Expressivity Amit Daniely Roy Frostig Y. Singer 90 343 0 18 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.4K 192,638 0 10 Dec 2015
Learning Halfspaces and Neural Networks with Random Initialization Yuchen Zhang Jason D. Lee Martin J. Wainwright Michael I. Jordan 36 35 0 25 Nov 2015
Expressiveness of Rectifier Networks Xingyuan Pan Vivek Srikumar OffRL 39 46 0 18 Nov 2015
On the Quality of the Initial Basin in Overspecified Neural Networks Itay Safran Ohad Shamir 51 127 0 13 Nov 2015
Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition Rong Ge Furong Huang Chi Jin Yang Yuan 114 1,056 0 06 Mar 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 168 18,534 0 06 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 806 149,474 0 22 Dec 2014
Qualitatively characterizing neural network optimization problems Ian Goodfellow Oriol Vinyals Andrew M. Saxe ODL 79 519 0 19 Dec 2014
Provable Methods for Training Neural Networks with Sparse Connectivity Hanie Sedghi Anima Anandkumar 49 64 0 08 Dec 2014
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 225 1,191 0 30 Nov 2014
On the Computational Efficiency of Training Neural Networks Roi Livni Shai Shalev-Shwartz Ohad Shamir 68 479 0 05 Oct 2014
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization Yann N. Dauphin Razvan Pascanu Çağlar Gülçehre Kyunghyun Cho Surya Ganguli Yoshua Bengio ODL 101 1,380 0 10 Jun 2014
On the Number of Linear Regions of Deep Neural Networks Guido Montúfar Razvan Pascanu Kyunghyun Cho Yoshua Bengio 72 1,250 0 08 Feb 2014
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 111 1,830 0 20 Dec 2013
Provable Bounds for Learning Some Deep Representations Sanjeev Arora Aditya Bhaskara Rong Ge Tengyu Ma BDL 60 335 0 23 Oct 2013