Variance Reduction for Faster Non-Convex Optimization

17 March 2016

Papers citing "Variance Reduction for Faster Non-Convex Optimization"

36 / 86 papers shown

Title
SpiderBoost and Momentum: Faster Stochastic Variance Reduction Algorithms Zhe Wang Kaiyi Ji Yi Zhou Yingbin Liang Vahid Tarokh ODL 35 81 0 25 Oct 2018
Continuous-time Models for Stochastic Optimization Algorithms Antonio Orvieto Aurelien Lucchi 19 31 0 05 Oct 2018
Weakly-Convex Concave Min-Max Optimization: Provable Algorithms and Applications in Machine Learning Hassan Rafique Mingrui Liu Qihang Lin Tianbao Yang 15 107 0 04 Oct 2018
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator Cong Fang C. J. Li Zhouchen Lin Tong Zhang 50 571 0 04 Jul 2018
A Simple Stochastic Variance Reduced Algorithm with Fast Convergence Rates Kaiwen Zhou Fanhua Shang James Cheng 22 74 0 28 Jun 2018
Stochastic Nested Variance Reduction for Nonconvex Optimization Dongruo Zhou Pan Xu Quanquan Gu 25 146 0 20 Jun 2018
Stochastic Variance-Reduced Policy Gradient Matteo Papini Damiano Binaghi Giuseppe Canonaco Matteo Pirotta Marcello Restelli 19 174 0 14 Jun 2018
Analysis of nonsmooth stochastic approximation: the differential inclusion approach Szymon Majewski B. Miasojedow Eric Moulines 19 49 0 04 May 2018
Stochastic Variance-Reduced Hamilton Monte Carlo Methods Difan Zou Pan Xu Quanquan Gu BDL 37 31 0 13 Feb 2018
A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization Zhize Li Jian Li 39 116 0 13 Feb 2018
Katyusha X: Practical Momentum Method for Stochastic Sum-of-Nonconvex Optimization Zeyuan Allen-Zhu ODL 46 52 0 12 Feb 2018
Neon2: Finding Local Minima via First-Order Oracles Zeyuan Allen-Zhu Yuanzhi Li 21 130 0 17 Nov 2017
Continuous DR-submodular Maximization: Structure and Algorithms Yatao Bian Kfir Y. Levy Andreas Krause J. M. Buhmann 35 65 0 04 Nov 2017
Natasha 2: Faster Non-Convex Optimization Than SGD Zeyuan Allen-Zhu ODL 28 245 0 29 Aug 2017
Efficient Regret Minimization in Non-Convex Games Elad Hazan Karan Singh Cyril Zhang 25 96 0 31 Jul 2017
Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization Pan Xu Jinghui Chen Difan Zou Quanquan Gu 36 200 0 20 Jul 2017
A Unified Analysis of Stochastic Optimization Methods Using Jump System Theory and Quadratic Constraints Bin Hu Peter M. Seiler Anders Rantzer 30 35 0 25 Jun 2017
Stochastic Recursive Gradient Algorithm for Nonconvex Optimization Lam M. Nguyen Jie Liu K. Scheinberg Martin Takáč 13 94 0 20 May 2017
Linear Convergence of Accelerated Stochastic Gradient Descent for Nonconvex Nonsmooth Optimization Feihu Huang Songcan Chen 6 2 0 26 Apr 2017
Data-Dependent Stability of Stochastic Gradient Descent Ilja Kuzborskij Christoph H. Lampert MLT 14 165 0 05 Mar 2017
Natasha: Faster Non-Convex Stochastic Optimization Via Strongly Non-Convex Parameter Zeyuan Allen-Zhu 23 80 0 02 Feb 2017
The Power of Normalization: Faster Evasion of Saddle Points Kfir Y. Levy 28 108 0 15 Nov 2016
Finding Approximate Local Minima Faster than Gradient Descent Naman Agarwal Zeyuan Allen-Zhu Brian Bullins Elad Hazan Tengyu Ma 43 83 0 03 Nov 2016
Stochastic Alternating Direction Method of Multipliers with Variance Reduction for Nonconvex Optimization Feihu Huang Songcan Chen Zhaosong Lu 30 14 0 10 Oct 2016
Stochastic Quasi-Newton Methods for Nonconvex Stochastic Optimization Tianlin Li Shiqian Ma D. Goldfarb Wen Liu 26 177 0 05 Jul 2016
Guaranteed Non-convex Optimization: Submodular Maximization over Continuous Domains Yatao Bian Baharan Mirzasoleiman J. M. Buhmann Andreas Krause 28 146 0 17 Jun 2016
Variance-Reduced Proximal Stochastic Gradient Descent for Non-convex Composite optimization Xiyu Yu Dacheng Tao 32 5 0 02 Jun 2016
Riemannian SVRG: Fast Stochastic Optimization on Riemannian Manifolds Hongyi Zhang Sashank J. Reddi S. Sra 41 240 0 23 May 2016
Fast Stochastic Methods for Nonsmooth Nonconvex Optimization Sashank J. Reddi S. Sra Barnabás Póczós Alex Smola 28 54 0 23 May 2016
Barzilai-Borwein Step Size for Stochastic Gradient Descent Conghui Tan Shiqian Ma Yuhong Dai Yuqiu Qian 42 182 0 13 May 2016
Unified Convergence Analysis of Stochastic Momentum Methods for Convex and Non-convex Optimization Tianbao Yang Qihang Lin Zhe Li 14 122 0 12 Apr 2016
Katyusha: The First Direct Acceleration of Stochastic Gradient Methods Zeyuan Allen-Zhu ODL 35 577 0 18 Mar 2016
On the Online Frank-Wolfe Algorithms for Convex and Non-convex Optimizations Jean Lafond Hoi-To Wai Eric Moulines 50 32 0 05 Oct 2015
Improved SVRG for Non-Strongly-Convex or Sum-of-Non-Convex Objectives Zeyuan Allen-Zhu Yang Yuan 34 195 0 05 Jun 2015
A Proximal Stochastic Gradient Method with Progressive Variance Reduction Lin Xiao Tong Zhang ODL 93 737 0 19 Mar 2014
Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning Julien Mairal 79 317 0 18 Feb 2014