ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2002.00057
  4. Cited By
Last Iterate is Slower than Averaged Iterate in Smooth Convex-Concave
  Saddle Point Problems
v1v2 (latest)

Last Iterate is Slower than Averaged Iterate in Smooth Convex-Concave Saddle Point Problems

Annual Conference Computational Learning Theory (COLT), 2020
31 January 2020
Noah Golowich
S. Pattathil
C. Daskalakis
Asuman Ozdaglar
ArXiv (abs)PDFHTML

Papers citing "Last Iterate is Slower than Averaged Iterate in Smooth Convex-Concave Saddle Point Problems"

50 / 57 papers shown
Tight Regret Upper and Lower Bounds for Optimistic Hedge in Two-Player Zero-Sum Games
Tight Regret Upper and Lower Bounds for Optimistic Hedge in Two-Player Zero-Sum Games
Taira Tsuchiya
115
1
0
13 Oct 2025
Negative Stepsizes Make Gradient-Descent-Ascent Converge
Negative Stepsizes Make Gradient-Descent-Ascent Converge
Henry Shugart
Jason M. Altschuler
357
4
0
02 May 2025
Learning Variational Inequalities from Data: Fast Generalization Rates under Strong Monotonicity
Learning Variational Inequalities from Data: Fast Generalization Rates under Strong Monotonicity
Eric Zhao
Tatjana Chavdarova
Michael I. Jordan
358
1
0
20 Feb 2025
Constrained Sampling with Primal-Dual Langevin Monte Carlo
Constrained Sampling with Primal-Dual Langevin Monte CarloNeural Information Processing Systems (NeurIPS), 2024
Luiz F. O. Chamon
Mohammad Reza Karimi
Anna Korba
385
7
0
08 Jan 2025
COMAL: A Convergent Meta-Algorithm for Aligning LLMs with General Preferences
COMAL: A Convergent Meta-Algorithm for Aligning LLMs with General Preferences
Yongxu Liu
Argyris Oikonomou
Weiqiang Zheng
Yang Cai
Arman Cohan
359
4
0
30 Oct 2024
Fast Last-Iterate Convergence of Learning in Games Requires Forgetful Algorithms
Fast Last-Iterate Convergence of Learning in Games Requires Forgetful AlgorithmsNeural Information Processing Systems (NeurIPS), 2024
Yang Cai
Gabriele Farina
Julien Grand-Clément
Christian Kroer
Chung-Wei Lee
Haipeng Luo
Weiqiang Zheng
365
17
0
15 Jun 2024
Primal Methods for Variational Inequality Problems with Functional Constraints
Primal Methods for Variational Inequality Problems with Functional ConstraintsMathematical programming (MP), 2024
Liang Zhang
Niao He
Michael Muehlebach
293
5
0
19 Mar 2024
Diffusion Stochastic Optimization for Min-Max Problems
Diffusion Stochastic Optimization for Min-Max ProblemsIEEE Transactions on Signal Processing (IEEE TSP), 2024
H. Cai
Sulaiman A. Alghunaim
Ali H. Sayed
350
5
0
26 Jan 2024
Optimistic Policy Gradient in Multi-Player Markov Games with a Single
  Controller: Convergence Beyond the Minty Property
Optimistic Policy Gradient in Multi-Player Markov Games with a Single Controller: Convergence Beyond the Minty Property
Ioannis Anagnostides
Ioannis Panageas
Gabriele Farina
Tuomas Sandholm
390
3
0
19 Dec 2023
Last-Iterate Convergence Properties of Regret-Matching Algorithms in Games
Last-Iterate Convergence Properties of Regret-Matching Algorithms in GamesInternational Conference on Learning Representations (ICLR), 2023
Yang Cai
Gabriele Farina
Julien Grand-Clément
Christian Kroer
Chung-Wei Lee
Haipeng Luo
Weiqiang Zheng
416
7
0
01 Nov 2023
A Specialized Semismooth Newton Method for Kernel-Based Optimal
  Transport
A Specialized Semismooth Newton Method for Kernel-Based Optimal TransportInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Tianyi Lin
Marco Cuturi
Michael I. Jordan
OT
376
2
0
21 Oct 2023
Stable Nonconvex-Nonconcave Training via Linear Interpolation
Stable Nonconvex-Nonconcave Training via Linear Interpolation
Thomas Pethick
Wanyun Xie
Volkan Cevher
624
7
0
20 Oct 2023
Variance Reduced Halpern Iteration for Finite-Sum Monotone Inclusions
Variance Reduced Halpern Iteration for Finite-Sum Monotone InclusionsInternational Conference on Learning Representations (ICLR), 2023
Xu Cai
Ahmet Alacaoglu
Jelena Diakonikolas
431
13
0
04 Oct 2023
Extragradient Type Methods for Riemannian Variational Inequality
  Problems
Extragradient Type Methods for Riemannian Variational Inequality ProblemsInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Zihao Hu
Guanghui Wang
Xi Wang
Andre Wibisono
Jacob D. Abernethy
Molei Tao
423
6
0
25 Sep 2023
Last-Iterate Convergence of Adaptive Riemannian Gradient Descent for Equilibrium Computation
Last-Iterate Convergence of Adaptive Riemannian Gradient Descent for Equilibrium Computation
Yong Cai
Michael I. Jordan
Tianyi Lin
Argyris Oikonomou
Emmanouil-Vasileios Vlatakis-Gkaragkounis
359
5
0
29 Jun 2023
A Central Limit Theorem for Algorithmic Estimator of Saddle Point
A Central Limit Theorem for Algorithmic Estimator of Saddle Point
Abhishek Roy
Yian Ma
409
1
0
09 Jun 2023
Adaptively Perturbed Mirror Descent for Learning in Games
Adaptively Perturbed Mirror Descent for Learning in GamesInternational Conference on Machine Learning (ICML), 2023
Kenshi Abe
Kaito Ariu
Mitsuki Sakamoto
Atsushi Iwasaki
646
9
0
26 May 2023
Accelerating Value Iteration with Anchoring
Accelerating Value Iteration with AnchoringNeural Information Processing Systems (NeurIPS), 2023
Jongmin Lee
Ernest K. Ryu
401
14
0
26 May 2023
Towards Characterizing the First-order Query Complexity of Learning
  (Approximate) Nash Equilibria in Zero-sum Matrix Games
Towards Characterizing the First-order Query Complexity of Learning (Approximate) Nash Equilibria in Zero-sum Matrix GamesNeural Information Processing Systems (NeurIPS), 2023
Hédi Hadiji
Sarah Sachs
T. Erven
Wouter M. Koolen
490
6
0
25 Apr 2023
Sublinear Convergence Rates of Extragradient-Type Methods: A Survey on
  Classical and Recent Developments
Sublinear Convergence Rates of Extragradient-Type Methods: A Survey on Classical and Recent Developments
Quoc Tran-Dinh
228
12
0
30 Mar 2023
Doubly Optimal No-Regret Learning in Monotone Games
Doubly Optimal No-Regret Learning in Monotone GamesInternational Conference on Machine Learning (ICML), 2023
Yang Cai
Weiqiang Zheng
307
22
0
30 Jan 2023
ApproxED: Approximate exploitability descent via learned best responses
ApproxED: Approximate exploitability descent via learned best responsesAdaptive Agents and Multi-Agent Systems (AAMAS), 2023
Carlos Martin
Tuomas Sandholm
484
2
0
20 Jan 2023
Min-Max Optimization Made Simple: Approximating the Proximal Point
  Method via Contraction Maps
Min-Max Optimization Made Simple: Approximating the Proximal Point Method via Contraction MapsSIAM Symposium on Simplicity in Algorithms (SOSA), 2023
Volkan Cevher
Georgios Piliouras
Ryann Sim
Stratis Skoulakis
334
7
0
10 Jan 2023
Symmetric (Optimistic) Natural Policy Gradient for Multi-agent Learning
  with Parameter Convergence
Symmetric (Optimistic) Natural Policy Gradient for Multi-agent Learning with Parameter ConvergenceInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022
S. Pattathil
Jianchao Tan
Asuman Ozdaglar
368
15
0
23 Oct 2022
STay-ON-the-Ridge: Guaranteed Convergence to Local Minimax Equilibrium
  in Nonconvex-Nonconcave Games
STay-ON-the-Ridge: Guaranteed Convergence to Local Minimax Equilibrium in Nonconvex-Nonconcave GamesAnnual Conference Computational Learning Theory (COLT), 2022
C. Daskalakis
Noah Golowich
Stratis Skoulakis
Manolis Zampetakis
354
8
0
18 Oct 2022
Last-Iterate Convergence with Full and Noisy Feedback in Two-Player
  Zero-Sum Games
Last-Iterate Convergence with Full and Noisy Feedback in Two-Player Zero-Sum GamesInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Kenshi Abe
Kaito Ariu
Mitsuki Sakamoto
Kenta Toyoshima
Atsushi Iwasaki
338
15
0
21 Aug 2022
A Survey of Decision Making in Adversarial Games
A Survey of Decision Making in Adversarial GamesScience China Information Sciences (Sci. China Inf. Sci.), 2022
Xiuxian Li
Min Meng
Yiguang Hong
Jie-bin Chen
AAML
348
26
0
16 Jul 2022
Continuous-time Analysis for Variational Inequalities: An Overview and
  Desiderata
Continuous-time Analysis for Variational Inequalities: An Overview and Desiderata
Tatjana Chavdarova
Ya-Ping Hsieh
Michael I. Jordan
204
2
0
14 Jul 2022
Solving Constrained Variational Inequalities via a First-order Interior
  Point-based Method
Solving Constrained Variational Inequalities via a First-order Interior Point-based MethodInternational Conference on Learning Representations (ICLR), 2022
Tong Yang
Michael I. Jordan
Tatjana Chavdarova
290
12
0
21 Jun 2022
Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max
  Optimization and Comonotone Inclusion
Accelerated Algorithms for Constrained Nonconvex-Nonconcave Min-Max Optimization and Comonotone InclusionInternational Conference on Machine Learning (ICML), 2022
Yang Cai
Argyris Oikonomou
Weiqiang Zheng
455
25
0
10 Jun 2022
What is a Good Metric to Study Generalization of Minimax Learners?
What is a Good Metric to Study Generalization of Minimax Learners?Neural Information Processing Systems (NeurIPS), 2022
Asuman Ozdaglar
S. Pattathil
Jiawei Zhang
Jianchao Tan
265
17
0
09 Jun 2022
Policy Optimization for Markov Games: Unified Framework and Faster
  Convergence
Policy Optimization for Markov Games: Unified Framework and Faster ConvergenceNeural Information Processing Systems (NeurIPS), 2022
Runyu Zhang
Qinghua Liu
Haiquan Wang
Caiming Xiong
Na Li
Yu Bai
458
31
0
06 Jun 2022
First-Order Algorithms for Min-Max Optimization in Geodesic Metric
  Spaces
First-Order Algorithms for Min-Max Optimization in Geodesic Metric SpacesNeural Information Processing Systems (NeurIPS), 2022
Sai Li
Tianyi Lin
Emmanouil-Vasileios Vlatakis-Gkaragkounis
309
22
0
04 Jun 2022
Tight Last-Iterate Convergence of the Extragradient and the Optimistic
  Gradient Descent-Ascent Algorithm for Constrained Monotone Variational
  Inequalities
Tight Last-Iterate Convergence of the Extragradient and the Optimistic Gradient Descent-Ascent Algorithm for Constrained Monotone Variational Inequalities
Yang Cai
Argyris Oikonomou
Weiqiang Zheng
306
20
0
20 Apr 2022
Stochastic Halpern Iteration with Variance Reduction for Stochastic
  Monotone Inclusions
Stochastic Halpern Iteration with Variance Reduction for Stochastic Monotone InclusionsNeural Information Processing Systems (NeurIPS), 2022
Xu Cai
Chaobing Song
Cristóbal Guzmán
Jelena Diakonikolas
377
15
0
17 Mar 2022
Last-Iterate Convergence of Saddle-Point Optimizers via High-Resolution
  Differential Equations
Last-Iterate Convergence of Saddle-Point Optimizers via High-Resolution Differential Equations
Tatjana Chavdarova
Sai Li
Manolis Zampetakis
438
19
0
27 Dec 2021
Convergence Rates of Two-Time-Scale Gradient Descent-Ascent Dynamics for
  Solving Nonconvex Min-Max Problems
Convergence Rates of Two-Time-Scale Gradient Descent-Ascent Dynamics for Solving Nonconvex Min-Max ProblemsConference on Learning for Dynamics & Control (L4DC), 2021
Thinh T. Doan
334
19
0
17 Dec 2021
Doubly Optimal No-Regret Online Learning in Strongly Monotone Games with
  Bandit Feedback
Doubly Optimal No-Regret Online Learning in Strongly Monotone Games with Bandit FeedbackOperational Research (OR), 2021
Wenjia Ba
Tianyi Lin
Jiawei Zhang
Zhengyuan Zhou
374
23
0
06 Dec 2021
Stochastic Extragradient: General Analysis and Improved Rates
Stochastic Extragradient: General Analysis and Improved Rates
Eduard A. Gorbunov
Hugo Berard
Gauthier Gidel
Nicolas Loizou
401
52
0
16 Nov 2021
Extragradient Method: $O(1/K)$ Last-Iterate Convergence for Monotone
  Variational Inequalities and Connections With Cocoercivity
Extragradient Method: O(1/K)O(1/K)O(1/K) Last-Iterate Convergence for Monotone Variational Inequalities and Connections With CocoercivityInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2021
Eduard A. Gorbunov
Nicolas Loizou
Gauthier Gidel
341
80
0
08 Oct 2021
Nonconvex-Nonconcave Min-Max Optimization with a Small Maximization
  Domain
Nonconvex-Nonconcave Min-Max Optimization with a Small Maximization Domain
Dmitrii Ostrovskii
Babak Barazandeh
Meisam Razaviyayn
318
13
0
08 Oct 2021
$O\left(1/T\right)$ Time-Average Convergence in a Generalization of
  Multiagent Zero-Sum Games
O(1/T)O\left(1/T\right)O(1/T) Time-Average Convergence in a Generalization of Multiagent Zero-Sum Games
James P. Bailey
224
0
0
06 Oct 2021
Fair Representation: Guaranteeing Approximate Multiple Group Fairness
  for Unknown Tasks
Fair Representation: Guaranteeing Approximate Multiple Group Fairness for Unknown TasksIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
Xudong Shen
Yongkang Wong
Mohan S. Kankanhalli
FaML
298
28
0
01 Sep 2021
The Last-Iterate Convergence Rate of Optimistic Mirror Descent in
  Stochastic Variational Inequalities
The Last-Iterate Convergence Rate of Optimistic Mirror Descent in Stochastic Variational Inequalities
Waïss Azizian
F. Iutzeler
J. Malick
P. Mertikopoulos
284
33
0
05 Jul 2021
Stochastic Gradient Descent-Ascent and Consensus Optimization for Smooth
  Games: Convergence Analysis under Expected Co-coercivity
Stochastic Gradient Descent-Ascent and Consensus Optimization for Smooth Games: Convergence Analysis under Expected Co-coercivityNeural Information Processing Systems (NeurIPS), 2021
Nicolas Loizou
Hugo Berard
Gauthier Gidel
Alexia Jolicoeur-Martineau
Damien Scieur
473
62
0
30 Jun 2021
On the Convergence of Stochastic Extragradient for Bilinear Games using
  Restarted Iteration Averaging
On the Convergence of Stochastic Extragradient for Bilinear Games using Restarted Iteration AveragingInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2021
C. J. Li
Yaodong Yu
Nicolas Loizou
Gauthier Gidel
Yi-An Ma
Nicolas Le Roux
Sai Li
499
29
0
30 Jun 2021
Complexity Lower Bounds for Nonconvex-Strongly-Concave Min-Max
  Optimization
Complexity Lower Bounds for Nonconvex-Strongly-Concave Min-Max OptimizationNeural Information Processing Systems (NeurIPS), 2021
Haochuan Li
Yi Tian
Jingzhao Zhang
Ali Jadbabaie
307
49
0
18 Apr 2021
On the Initialization for Convex-Concave Min-max Problems
On the Initialization for Convex-Concave Min-max ProblemsInternational Conference on Algorithmic Learning Theory (ALT), 2021
Mingrui Liu
Francesco Orabona
ODL
325
4
0
27 Feb 2021
Stochastic Variance Reduction for Variational Inequality Methods
Stochastic Variance Reduction for Variational Inequality MethodsAnnual Conference Computational Learning Theory (COLT), 2021
Ahmet Alacaoglu
Yura Malitsky
243
85
0
16 Feb 2021
Potential Function-based Framework for Making the Gradients Small in
  Convex and Min-Max Optimization
Potential Function-based Framework for Making the Gradients Small in Convex and Min-Max Optimization
Jelena Diakonikolas
Puqian Wang
295
14
0
28 Jan 2021
12
Next
Page 1 of 2