Random Reshuffling: Simple Analysis with Vast Improvements

10 June 2020

Papers citing "Random Reshuffling: Simple Analysis with Vast Improvements"

19 / 19 papers shown

Title
Random Reshuffling for Stochastic Gradient Langevin Dynamics Luke Shaw Peter A. Whalley 75 3 0 28 Jan 2025
How Neural Networks Learn the Support is an Implicit Regularization Effect of SGD Pierfrancesco Beneventano Andrea Pinto Tomaso A. Poggio MLT 27 1 0 17 Jun 2024
Demystifying SGD with Doubly Stochastic Gradients Kyurae Kim Joohwan Ko Yian Ma Jacob R. Gardner 48 0 0 03 Jun 2024
High Probability Guarantees for Random Reshuffling Hengxu Yu Xiao Li 19 2 0 20 Nov 2023
Demystifying the Myths and Legends of Nonconvex Convergence of SGD Aritra Dutta El Houcine Bergou Soumia Boucherouite Nicklas Werge M. Kandemir Xin Li 18 0 0 19 Oct 2023
On The Impact of Machine Learning Randomness on Group Fairness Prakhar Ganesh Hong Chang Martin Strobel Reza Shokri FaML 8 30 0 09 Jul 2023
Distributed Random Reshuffling Methods with Improved Convergence Kun-Yen Huang Linli Zhou Shi Pu 15 4 0 21 Jun 2023
First Order Methods with Markovian Noise: from Acceleration to Variational Inequalities Aleksandr Beznosikov S. Samsonov Marina Sheshukova Alexander Gasnikov A. Naumov Eric Moulines 32 14 0 25 May 2023
Distributed Stochastic Optimization under a General Variance Condition Kun-Yen Huang Xiao Li Shin-Yi Pu FedML 14 5 0 30 Jan 2023
Convergence of First-Order Algorithms for Meta-Learning with Moreau Envelopes Konstantin Mishchenko Slavomír Hanzely Peter Richtárik FedML 14 5 0 17 Jan 2023
On the Convergence to a Global Solution of Shuffling-Type Gradient Algorithms Lam M. Nguyen Trang H. Tran 19 2 0 13 Jun 2022
GraB: Finding Provably Better Data Permutations than Random Reshuffling Yucheng Lu Wentao Guo Christopher De Sa FedML 9 16 0 22 May 2022
Federated Random Reshuffling with Compression and Variance Reduction Grigory Malinovsky Peter Richtárik FedML 13 10 0 08 May 2022
Nesterov Accelerated Shuffling Gradient Method for Convex Optimization Trang H. Tran K. Scheinberg Lam M. Nguyen 10 10 0 07 Feb 2022
Distributed Random Reshuffling over Networks Kun-Yen Huang Xiao Li Andre Milzarek Shi Pu Junwen Qiu 23 11 0 31 Dec 2021
Random Shuffling Beats SGD Only After Many Epochs on Ill-Conditioned Problems Itay Safran Ohad Shamir 9 19 0 12 Jun 2021
Distributed Second Order Methods with Fast Rates and Compressed Communication Rustem Islamov Xun Qian Peter Richtárik 16 51 0 14 Feb 2021
Incremental Without Replacement Sampling in Nonconvex Optimization Edouard Pauwels 14 5 0 15 Jul 2020
A Unified Convergence Analysis for Shuffling-Type Gradient Methods Lam M. Nguyen Quoc Tran-Dinh Dzung Phan Phuong Ha Nguyen Marten van Dijk 10 77 0 19 Feb 2020