On the One-sided Convergence of Adam-type Algorithms in Non-convex
Non-concave Min-max Optimization

On the One-sided Convergence of Adam-type Algorithms in Non-convex Non-concave Min-max Optimization

29 September 2021

Zehao Dou

Papers citing "On the One-sided Convergence of Adam-type Algorithms in Non-convex Non-concave Min-max Optimization"

5 / 5 papers shown

Title
Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum H. Cai Sulaiman A. Alghunaim Ali H.Sayed 33 1 0 18 Jun 2024
Regularized Gradient Clipping Provably Trains Wide and Deep Neural Networks Matteo Tucat Anirbit Mukherjee Procheta Sen Mingfei Sun Omar Rivasplata MLT 23 1 0 12 Apr 2024
Similarity, Compression and Local Steps: Three Pillars of Efficient Communications for Distributed Variational Inequalities Aleksandr Beznosikov Martin Takáč Alexander Gasnikov 21 10 0 15 Feb 2023
Smooth Monotone Stochastic Variational Inequalities and Saddle Point Problems: A Survey Aleksandr Beznosikov Boris Polyak Eduard A. Gorbunov D. Kovalev Alexander Gasnikov 32 31 0 29 Aug 2022
Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization Junchi Yang Xiang Li Niao He ODL 17 22 0 01 Jun 2022