A Unified Approach to Adaptive Regularization in Online and Stochastic Optimization

20 June 2017

Papers citing "A Unified Approach to Adaptive Regularization in Online and Stochastic Optimization"

17 / 17 papers shown

Title
The Sample Complexity of Parameter-Free Stochastic Convex Optimization Jared Lawrence Ari Kalinsky Hannah Bradfield Y. Carmon Oliver Hinder 53 0 0 12 Jun 2025
ASGO: Adaptive Structured Gradient Optimization Kang An Yuxing Liu Boyao Wang Shiqian Ma Shiqian Ma Tong Zhang Tong Zhang ODL 209 14 0 26 Mar 2025
Structured Preconditioners in Adaptive Optimization: A Unified Analysis Shuo Xie Tianhao Wang Sashank J. Reddi Sanjiv Kumar Zhiyuan Li 138 8 0 13 Mar 2025
Old Optimizer, New Norm: An Anthology Jeremy Bernstein Laker Newhouse ODL 162 37 0 30 Sep 2024
The Price of Adaptivity in Stochastic Convex Optimization Y. Carmon Oliver Hinder 137 8 0 16 Feb 2024
DoWG Unleashed: An Efficient Universal Parameter-Free Gradient Descent Method Ahmed Khaled Konstantin Mishchenko Chi Jin ODL 178 34 0 25 May 2023
DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule Maor Ivgi Oliver Hinder Y. Carmon ODL 233 75 0 08 Feb 2023
Meta-Regularization: An Approach to Adaptive Choice of the Learning Rate in Gradient Descent Guangzeng Xie Hao Jin Dachao Lin Zhihua Zhang 59 0 0 12 Apr 2021
Structured Dropout Variational Inference for Bayesian Neural Networks S. Nguyen Duong Nguyen Khai Nguyen Khoat Than Hung Bui Nhat Ho BDL DRL 137 9 0 16 Feb 2021
Convergence Analysis of a Momentum Algorithm with Adaptive Step Size for Non Convex Optimization Anas Barakat Pascal Bianchi 118 12 0 18 Nov 2019
Learning Neural Networks with Adaptive Regularization Han Zhao Yao-Hung Hubert Tsai Ruslan Salakhutdinov Geoffrey J. Gordon 68 15 0 14 Jul 2019
Universal Online Convex Optimization with Minimax Optimal Second-Order Dynamic Regret Hakan Gokcesu Suleyman S. Kozat 92 1 0 30 Jun 2019
A Latent Variational Framework for Stochastic Optimization P. Casgrain DRL 98 4 0 05 May 2019
Extreme Tensoring for Low-Memory Preconditioning Xinyi Chen Naman Agarwal Elad Hazan Cyril Zhang Yi Zhang 100 11 0 12 Feb 2019
Predictor-Corrector Policy Optimization Ching-An Cheng Xinyan Yan Nathan D. Ratliff Byron Boots OnRL 120 23 0 15 Oct 2018
Shampoo: Preconditioned Stochastic Tensor Optimization Vineet Gupta Tomer Koren Y. Singer ODL 207 260 0 26 Feb 2018
Variants of RMSProp and Adagrad with Logarithmic Regret Bounds Mahesh Chandra Mukkamala Matthias Hein ODL 142 260 0 17 Jun 2017