Negative Momentum for Improved Game Dynamics

12 July 2018

Gauthier Gidel

Reyhane Askari Hemmat

Papers citing "Negative Momentum for Improved Game Dynamics"

26 / 26 papers shown

Title
Negative Stepsizes Make Gradient-Descent-Ascent Converge Henry Shugart Jason M. Altschuler 25 0 0 02 May 2025
Pseudo-Asynchronous Local SGD: Robust and Efficient Data-Parallel Training Hiroki Naganuma Xinzhi Zhang Man-Chung Yue Ioannis Mitliagkas Philipp A. Witte Russell J. Hewett Yin Tat Lee 63 0 0 25 Apr 2025
MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts R. Teo Tan M. Nguyen MoE 33 3 0 18 Oct 2024
One-Shot Safety Alignment for Large Language Models via Optimal Dualization Xinmeng Huang Shuo Li Edgar Dobriban Osbert Bastani Hamed Hassani Dongsheng Ding 47 3 0 29 May 2024
Optimal Guarantees for Algorithmic Reproducibility and Gradient Complexity in Convex Optimization Liang Zhang Junchi Yang Amin Karbasi Niao He 26 2 0 26 Oct 2023
Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates Siqi Zhang S. Choudhury Sebastian U. Stich Nicolas Loizou FedML 19 3 0 08 Jun 2023
Smooth Monotone Stochastic Variational Inequalities and Saddle Point Problems: A Survey Aleksandr Beznosikov Boris Polyak Eduard A. Gorbunov D. Kovalev Alexander Gasnikov 37 31 0 29 Aug 2022
On Scaled Methods for Saddle Point Problems Aleksandr Beznosikov Aibek Alanov D. Kovalev Martin Takáč Alexander Gasnikov 22 4 0 16 Jun 2022
Evolutionary Game Theory Squared: Evolving Agents in Endogenously Evolving Zero-Sum Games Stratis Skoulakis Tanner Fiez Ryan Sim Georgios Piliouras Lillian J. Ratliff 14 13 0 15 Dec 2020
Adaptive extra-gradient methods for min-max optimization and games Kimon Antonakopoulos E. V. Belmega P. Mertikopoulos 54 46 0 22 Oct 2020
Adversarial score matching and improved sampling for image generation Alexia Jolicoeur-Martineau Remi Piche-Taillefer Rémi Tachet des Combes Ioannis Mitliagkas DiffM 24 125 0 11 Sep 2020
Stochastic Hamiltonian Gradient Methods for Smooth Games Nicolas Loizou Hugo Berard Alexia Jolicoeur-Martineau Pascal Vincent Simon Lacoste-Julien Ioannis Mitliagkas 31 50 0 08 Jul 2020
A Convergent and Dimension-Independent Min-Max Optimization Algorithm Vijay Keswani Oren Mangoubi Sushant Sachdeva Nisheeth K. Vishnoi 13 1 0 22 Jun 2020
The limits of min-max optimization algorithms: convergence to spurious non-critical sets Ya-Ping Hsieh P. Mertikopoulos V. Cevher 27 81 0 16 Jun 2020
Global Convergence and Variance-Reduced Optimization for a Class of Nonconvex-Nonconcave Minimax Problems Junchi Yang Negar Kiyavash Niao He 23 83 0 22 Feb 2020
Distributed No-Regret Learning in Multi-Agent Systems Xiao Xu Qing Zhao 12 12 0 20 Feb 2020
Accelerating Smooth Games by Manipulating Spectral Shapes Waïss Azizian Damien Scieur Ioannis Mitliagkas Simon Lacoste-Julien Gauthier Gidel 33 48 0 02 Jan 2020
Towards Better Understanding of Adaptive Gradient Algorithms in Generative Adversarial Nets Mingrui Liu Youssef Mroueh Jerret Ross Wei Zhang Xiaodong Cui Payel Das Tianbao Yang ODL 30 63 0 26 Dec 2019
Poincaré Recurrence, Cycles and Spurious Equilibria in Gradient-Descent-Ascent for Non-Convex Non-Concave Zero-Sum Games Lampros Flokas Emmanouil-Vasileios Vlatakis-Gkaragkounis Georgios Piliouras MLT 14 41 0 28 Oct 2019
Demon: Improved Neural Network Training with Momentum Decay John Chen Cameron R. Wolfe Zhaoqi Li Anastasios Kyrillidis ODL 16 15 0 11 Oct 2019
Fast and Provable ADMM for Learning with Generative Priors Fabian Latorre Gómez Armin Eftekhari V. Cevher GAN 25 43 0 07 Jul 2019
Linear Lower Bounds and Conditioning of Differentiable Games Adam Ibrahim Waïss Azizian Gauthier Gidel Ioannis Mitliagkas 23 10 0 17 Jun 2019
ODE Analysis of Stochastic Gradient Methods with Optimism and Anchoring for Minimax Problems Ernest K. Ryu Kun Yuan W. Yin 17 36 0 26 May 2019
Differentiable Game Mechanics Alistair Letcher David Balduzzi S. Racanière James Martens Jakob N. Foerster K. Tuyls T. Graepel 31 79 0 13 May 2019
Reducing Noise in GAN Training with Variance Reduced Extragradient Tatjana Chavdarova Gauthier Gidel F. Fleuret Simon Lacoste-Julien 22 134 0 18 Apr 2019
Nonparametric Density Estimation & Convergence Rates for GANs under Besov IPM Losses Ananya Uppal Shashank Singh Barnabás Póczós 27 52 0 09 Feb 2019