Local Saddle Point Optimization: A Curvature Exploitation Approach

15 May 2018

Papers citing "Local Saddle Point Optimization: A Curvature Exploitation Approach"

50 / 58 papers shown

Title
A Framework for Finding Local Saddle Points in Two-Player Zero-Sum Black-Box Games Shubhankar Agarwal Hamzah I. Khan Sandeep P. Chinchali David Fridovich-Keil 36 0 0 23 Mar 2025
More Information is Not Always Better: Connections between Zero-Sum Local Nash Equilibria in Feedback and Open-Loop Information Patterns Kushagra Gupta Ross Allen David Fridovich-Keil Ufuk Topcu 50 0 0 19 Mar 2025
A stochastic smoothing framework for nonconvex-nonconcave min-sum-max problems with applications to Wasserstein distributionally robust optimization Wei Liu Muhammad Khan Gabriel Mancino-Ball Yangyang Xu 42 0 0 24 Feb 2025
Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization Tianyi Lin Chi Jin Michael I. Jordan 52 6 0 28 Jan 2025
Second-Order Algorithms for Finding Local Nash Equilibria in Zero-Sum Games Kushagra Gupta Xinjie Liu Ufuk Topcu David Fridovich-Keil 29 3 0 05 Jun 2024
Connected Superlevel Set in (Deep) Reinforcement Learning and its Application to Minimax Theorems Sihan Zeng Thinh T. Doan J. Romberg OffRL 27 3 0 23 Mar 2023
PAPAL: A Provable PArticle-based Primal-Dual ALgorithm for Mixed Nash Equilibrium Shihong Ding Hanze Dong Cong Fang Zhouchen Lin Tong Zhang 33 1 0 02 Mar 2023
Universal Gradient Descent Ascent Method for Nonconvex-Nonconcave Minimax Optimization Taoli Zheng Lingling Zhu Anthony Man-Cho So Jose H. Blanchet Jiajin Li 40 13 0 26 Dec 2022
STay-ON-the-Ridge: Guaranteed Convergence to Local Minimax Equilibrium in Nonconvex-Nonconcave Games C. Daskalakis Noah Golowich Stratis Skoulakis Manolis Zampetakis 14 6 0 18 Oct 2022
Continuous-time Analysis for Variational Inequalities: An Overview and Desiderata Tatjana Chavdarova Ya-Ping Hsieh Michael I. Jordan 21 2 0 14 Jul 2022
A note on large deviations for interacting particle dynamics for finding mixed equilibria in zero-sum games Viktor Nilsson Pierre Nyquist 10 1 0 30 Jun 2022
First-Order Algorithms for Min-Max Optimization in Geodesic Metric Spaces Michael I. Jordan Tianyi Lin Emmanouil-Vasileios Vlatakis-Gkaragkounis 27 19 0 04 Jun 2022
Riemannian Hamiltonian methods for min-max optimization on manifolds Andi Han Bamdev Mishra Pratik Jawanpuria Pawan Kumar Junbin Gao 30 16 0 25 Apr 2022
Sion's Minimax Theorem in Geodesic Metric Spaces and a Riemannian Extragradient Algorithm Peiyuan Zhang J. Zhang S. Sra 14 7 0 13 Feb 2022
Last-Iterate Convergence of Saddle-Point Optimizers via High-Resolution Differential Equations Tatjana Chavdarova Michael I. Jordan Manolis Zampetakis 27 15 0 27 Dec 2021
Accelerated Proximal Alternating Gradient-Descent-Ascent for Nonconvex Minimax Machine Learning Ziyi Chen Shaocong Ma Yi Zhou 17 8 0 22 Dec 2021
Faster Single-loop Algorithms for Minimax Optimization without Strong Concavity Junchi Yang Antonio Orvieto Aurélien Lucchi Niao He 22 61 0 10 Dec 2021
A Cubic Regularization Approach for Finding Local Minimax Points in Nonconvex Minimax Optimization Ziyi Chen Zhengyang Hu Qunwei Li Zhe Wang Yi Zhou 34 7 0 14 Oct 2021
GDA-AM: On the effectiveness of solving minimax optimization via Anderson Acceleration Huan He Shifan Zhao Yuanzhe Xi Joyce C. Ho Y. Saad 34 1 0 06 Oct 2021
On the Convergence of Stochastic Extragradient for Bilinear Games using Restarted Iteration Averaging C. J. Li Yaodong Yu Nicolas Loizou Gauthier Gidel Yi-An Ma Nicolas Le Roux Michael I. Jordan 23 22 0 30 Jun 2021
Minimax Optimization with Smooth Algorithmic Adversaries Tanner Fiez Chi Jin Praneeth Netrapalli Lillian J. Ratliff AAML 16 11 0 02 Jun 2021
Saddle Point Optimization with Approximate Minimization Oracle and its Application to Robust Berthing Control Youhei Akimoto Yoshiki Miyauchi A. Maki 11 16 0 25 May 2021
On Characterizing GAN Convergence Through Proximal Duality Gap Sahil Sidheekh Aroof Aimen N. C. Krishnan 17 3 0 11 May 2021
Understanding Overparameterization in Generative Adversarial Networks Yogesh Balaji M. Sajedi N. Kalibhat Mucong Ding Dominik Stöger Mahdi Soltanolkotabi S. Feizi AI4CE 20 21 0 12 Apr 2021
Saddle Point Optimization with Approximate Minimization Oracle Youhei Akimoto 6 7 0 29 Mar 2021
Learning in Matrix Games can be Arbitrarily Complex Gabriel P. Andrade Rafael M. Frongillo Georgios Piliouras 13 31 0 05 Mar 2021
Direct-Search for a Class of Stochastic Min-Max Problems Sotiris Anagnostidis Aurélien Lucchi Youssef Diouane 20 11 0 22 Feb 2021
Proximal Gradient Descent-Ascent: Variable Convergence under KŁ Geometry Ziyi Chen Yi Zhou Tengyu Xu Yingbin Liang 12 34 0 09 Feb 2021
Solving Min-Max Optimization with Hidden Structure via Gradient Descent Ascent Lampros Flokas Emmanouil-Vasileios Vlatakis-Gkaragkounis Georgios Piliouras MLT 11 14 0 13 Jan 2021
Combating Mode Collapse in GAN training: An Empirical Analysis using Hessian Eigenvalues Ricard Durall Avraam Chatzimichailidis P. Labus J. Keuper GAN 25 57 0 17 Dec 2020
Efficient Methods for Structured Nonconvex-Nonconcave Min-Max Optimization Jelena Diakonikolas C. Daskalakis Michael I. Jordan 10 142 0 31 Oct 2020
Limiting Behaviors of Nonconvex-Nonconcave Minimax Optimization via Continuous-Time Systems Benjamin Grimmer Haihao Lu Pratik Worah Vahab Mirrokni 26 7 0 20 Oct 2020
Gradient Descent-Ascent Provably Converges to Strict Local Minmax Equilibria with a Finite Timescale Separation Tanner Fiez Lillian J. Ratliff 14 16 0 30 Sep 2020
A Unified Analysis of First-Order Methods for Smooth Games via Integral Quadratic Constraints Guodong Zhang Xuchao Bao Laurent Lessard Roger C. Grosse 15 24 0 23 Sep 2020
The Complexity of Constrained Min-Max Optimization C. Daskalakis Stratis Skoulakis Manolis Zampetakis 14 136 0 21 Sep 2020
Higher-order methods for convex-concave min-max optimization and monotone variational inequalities Brian Bullins Kevin A. Lai 25 36 0 09 Jul 2020
Greedy Adversarial Equilibrium: An Efficient Alternative to Nonconvex-Nonconcave Min-Max Optimization Oren Mangoubi Nisheeth K. Vishnoi 11 7 0 22 Jun 2020
The limits of min-max optimization algorithms: convergence to spurious non-critical sets Ya-Ping Hsieh P. Mertikopoulos V. Cevher 27 81 0 16 Jun 2020
Non-convex Min-Max Optimization: Applications, Challenges, and Recent Theoretical Advances Meisam Razaviyayn Tianjian Huang Songtao Lu Maher Nouiehed Maziar Sanjabi Mingyi Hong 19 108 0 15 Jun 2020
A Unified Single-loop Alternating Gradient Projection Algorithm for Nonconvex-Concave and Convex-Nonconcave Minimax Problems Zi Xu Hui-Li Zhang Yang Xu Guanghui Lan 20 99 0 03 Jun 2020
A Dual-Dimer Method for Training Physics-Constrained Neural Networks with Minimax Architecture Dehao Liu Yan Wang 14 72 0 01 May 2020
A mean-field analysis of two-player zero-sum games Carles Domingo-Enrich Samy Jelassi A. Mensch Grant M. Rotskoff Joan Bruna MLT 29 40 0 14 Feb 2020
Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms K. Zhang Zhuoran Yang Tamer Basar 36 1,180 0 24 Nov 2019
A Decentralized Proximal Point-type Method for Saddle Point Problems Weijie Liu Aryan Mokhtari Asuman Ozdaglar S. Pattathil Zebang Shen Nenggan Zheng 59 30 0 31 Oct 2019
Poincaré Recurrence, Cycles and Spurious Equilibria in Gradient-Descent-Ascent for Non-Convex Non-Concave Zero-Sum Games Lampros Flokas Emmanouil-Vasileios Vlatakis-Gkaragkounis Georgios Piliouras MLT 19 41 0 28 Oct 2019
A Stochastic Proximal Point Algorithm for Saddle-Point Problems Luo Luo Cheng Chen Yujun Li Guangzeng Xie Zhihua Zhang 16 16 0 13 Sep 2019
On the convergence of single-call stochastic extra-gradient methods Yu-Guan Hsieh F. Iutzeler J. Malick P. Mertikopoulos 19 167 0 22 Aug 2019
A Tight and Unified Analysis of Gradient-Based Methods for a Whole Spectrum of Games Waïss Azizian Ioannis Mitliagkas Simon Lacoste-Julien Gauthier Gidel 15 24 0 13 Jun 2019
A Closer Look at the Optimization Landscapes of Generative Adversarial Networks Hugo Berard Gauthier Gidel Amjad Almahairi Pascal Vincent Simon Lacoste-Julien GAN 20 64 0 11 Jun 2019
Last-iterate convergence rates for min-max optimization Jacob D. Abernethy Kevin A. Lai Andre Wibisono 11 73 0 05 Jun 2019