On the Convergence of Model Free Learning in Mean Field Games

4 July 2019

Romuald Elie

Julien Pérolat

Mathieu Laurière

M. Geist

Olivier Pietquin

ArXiv PDF HTML

Papers citing "On the Convergence of Model Free Learning in Mean Field Games"

49 / 49 papers shown

Title
Stochastic Semi-Gradient Descent for Learning Mean Field Games with Population-Aware Function Approximation Chenyu Zhang Xu Chen Xuan Di 87 4 0 17 Feb 2025
Last Iterate Convergence in Monotone Mean Field Games Noboru Isobe Kenshi Abe Kaito Ariu 41 0 0 07 Oct 2024
Reinforcement Learning for Finite Space Mean-Field Type Games Kai Shao Jiacheng Shen Chijie An Mathieu Laurière AI4CE 31 1 0 25 Sep 2024
Robust Cooperative Multi-Agent Reinforcement Learning:A Mean-Field Type Game Perspective Muhammad Aneeq uz Zaman Mathieu Laurière Alec Koppel Tamer Basar 42 3 0 20 Jun 2024
Analysis of Multiscale Reinforcement Q-Learning Algorithms for Mean Field Control Games Andrea Angiuli J. Fouque Mathieu Laurière Mengrui Zhang 39 1 0 27 May 2024
Graphon Mean Field Games with a Representative Player: Analysis and Learning Algorithm Fuzhong Zhou Chenyu Zhang Xu Chen Xuan Di 33 2 0 08 May 2024
A Single Online Agent Can Efficiently Learn Mean Field Games Chenyu Zhang Xu Chen Xuan Di OffRL 39 2 0 05 May 2024
MF-OML: Online Mean-Field Reinforcement Learning with Occupation Measures for Large Population Games Anran Hu Junzi Zhang 28 5 0 01 May 2024
Convergence analysis of controlled particle systems arising in deep learning: from finite to infinite sample size Huafu Liao Alpár R. Mészáros Chenchen Mou Chao Zhou 26 2 0 08 Apr 2024
Independent RL for Cooperative-Competitive Agents: A Mean-Field Perspective Muhammad Aneeq uz Zaman Alec Koppel Mathieu Laurière Tamer Basar 39 3 0 17 Mar 2024
Model-Based RL for Mean-Field Games is not Statistically Harder than Single-Agent RL Jiawei Huang Niao He Andreas Krause 32 6 0 08 Feb 2024
Learning Mean Field Games on Sparse Graphs: A Hybrid Graphex Approach Christian Fabian Kai Cui Heinz Koeppl 17 0 0 23 Jan 2024
Networked Communication for Decentralised Agents in Mean-Field Games Patrick Benjamin Alessandro Abate FedML 40 2 0 05 Jun 2023
On the Statistical Efficiency of Mean Field Reinforcement Learning with General Function Approximation Jiawei Huang Batuhan Yardim Niao He 42 10 0 18 May 2023
Actor-Critic learning for mean-field control in continuous time N. Frikha Maximilien Germain Mathieu Laurière H. Pham Xuan Song 30 16 0 13 Mar 2023
Mean-Field Control based Approximation of Multi-Agent Reinforcement Learning in Presence of a Non-decomposable Shared Global State Washim Uddin Mondal Vaneet Aggarwal S. Ukkusuri 33 8 0 13 Jan 2023
Scalable and Sample Efficient Distributed Policy Gradient Algorithms in Multi-Agent Networked Systems Xin Liu Honghao Wei Lei Ying 40 6 0 13 Dec 2022
Developing, Evaluating and Scaling Learning Agents in Multi-Agent Environments I. Gemp Thomas W. Anthony Yoram Bachrach Avishkar Bhoopchand Kalesha Bullard ... Florian Strub Andrea Tacchetti Eugene Tarassov Zhe Wang K. Tuyls LLMAG AI4CE 41 3 0 22 Sep 2022
Graphon Mean-Field Control for Cooperative Multi-Agent Reinforcement Learning Yuanquan Hu Xiaoli Wei Jun Yan Heng-Wei Zhang 32 8 0 11 Sep 2022
Mean Field Games on Weighted and Directed Graphs via Colored Digraphons Christian Fabian Kai Cui Heinz Koeppl AI4CE 57 3 0 08 Sep 2022
Optimal Offloading Strategies for Edge-Computing via Mean-Field Games and Control Kai Cui M. Yilmaz Anam Tahir A. Klein Heinz Koeppl 11 1 0 08 Sep 2022
MF-OMO: An Optimization Formulation of Mean-Field Games Xin Guo Anran Hu Junzi Zhang 37 14 0 20 Jun 2022
Hypergraphon Mean Field Games Kai Cui Wasiur R. KhudaBukhsh Heinz Koeppl AI4CE 25 7 0 30 Mar 2022
Scalable Deep Reinforcement Learning Algorithms for Mean Field Games Mathieu Laurière Sarah Perrin Sertan Girgin Paul Muller Ayush Jain ... Georgios Piliouras Julien Pérolat Romuald Élie Olivier Pietquin M. Geist 24 42 0 22 Mar 2022
Individual-Level Inverse Reinforcement Learning for Mean Field Games Yang Chen Libo Zhang Jiamou Liu Shuyue Hu AI4CE 28 9 0 13 Feb 2022
Decentralized Mean Field Games Sriram Ganapathi Subramanian Matthew E. Taylor Mark Crowley Pascal Poupart OOD OffRL 40 14 0 16 Dec 2021
Empirical Game-Theoretic Analysis for Mean Field Games Yongzhao Wang Michael P. Wellman 19 4 0 02 Dec 2021
Learning Graphon Mean Field Games and Approximate Nash Equilibria Kai Cui Heinz Koeppl AI4CE 34 34 0 29 Nov 2021
Learning Equilibria in Mean-Field Games: Introducing Mean-Field PSRO Paul Muller Mark Rowland Romuald Elie Georgios Piliouras Julien Perolat Mathieu Lauriere Raphaël Marinier Olivier Pietquin K. Tuyls 6 24 0 16 Nov 2021
Generalization in Mean Field Games by Learning Master Policies Sarah Perrin Mathieu Laurière Julien Pérolat Romuald Élie M. Geist Olivier Pietquin AI4CE 89 35 0 20 Sep 2021
On the Approximation of Cooperative Heterogeneous Multi-Agent Reinforcement Learning (MARL) using Mean Field Control (MFC) Washim Uddin Mondal Mridul Agarwal Vaneet Aggarwal S. Ukkusuri 33 43 0 09 Sep 2021
Efficient Model-Based Multi-Agent Mean-Field Reinforcement Learning Barna Pásztor Ilija Bogunovic Andreas Krause 28 41 0 08 Jul 2021
Exploration noise for learning linear-quadratic mean field games François Delarue A. Vasileiadis MLT 28 11 0 02 Jul 2021
Reinforcement Learning for Mean Field Games, with Applications to Economics Andrea Angiuli J. Fouque Mathieu Lauriere 27 26 0 25 Jun 2021
Concave Utility Reinforcement Learning: the Mean-Field Game Viewpoint M. Geist Julien Pérolat Mathieu Laurière Romuald Elie Sarah Perrin Olivier Bachem Rémi Munos Olivier Pietquin 37 62 0 07 Jun 2021
Signatured Deep Fictitious Play for Mean Field Games with Common Noise Ming Min Ruimeng Hu 27 27 0 06 Jun 2021
Mean Field Games Flock! The Reinforcement Learning Way Sarah Perrin Mathieu Laurière Julien Pérolat M. Geist Romuald Élie Olivier Pietquin AI4CE 11 44 0 17 May 2021
Adversarial Inverse Reinforcement Learning for Mean Field Games Yang Chen Libo Zhang Jiamou Liu Michael Witbrock AI4CE 55 6 0 29 Apr 2021
Scaling up Mean Field Games with Online Mirror Descent Julien Perolat Sarah Perrin Romuald Elie Mathieu Laurière Georgios Piliouras M. Geist K. Tuyls Olivier Pietquin LRM AI4CE 61 45 0 28 Feb 2021
Partially Observable Mean Field Reinforcement Learning Sriram Ganapathi Subramanian Matthew E. Taylor Mark Crowley Pascal Poupart OOD 16 26 0 31 Dec 2020
Provable Fictitious Play for General Mean-Field Games Qiaomin Xie Zhuoran Yang Zhaoran Wang Andreea Minca 11 18 0 08 Oct 2020
Linear-Quadratic Zero-Sum Mean-Field Type Games: Optimality Conditions and Policy Optimization René Carmona Kenza Hamidouche Mathieu Laurière Zongjun Tan 21 9 0 01 Sep 2020
Global Convergence of Policy Gradient for Linear-Quadratic Mean-Field Control/Game in Continuous Time Weichen Wang Jiequn Han Zhuoran Yang Zhaoran Wang 27 26 0 16 Aug 2020
Convergence of Deep Fictitious Play for Stochastic Differential Games Jiequn Han Ruimeng Hu Jihao Long 13 19 0 12 Aug 2020
Fictitious Play for Mean Field Games: Continuous Time Analysis and Applications Sarah Perrin Julien Perolat Mathieu Laurière M. Geist Romuald Elie Olivier Pietquin 17 119 0 05 Jul 2020
Unified Reinforcement Q-Learning for Mean Field Game and Control Problems Andrea Angiuli J. Fouque Mathieu Laurière 35 70 0 24 Jun 2020
Reinforcement Learning in Economics and Finance Arthur Charpentier Romuald Elie Carl Remlinger OffRL 21 150 0 22 Mar 2020
A General Framework for Learning Mean-Field Games Xin Guo Anran Hu Renyuan Xu Junzi Zhang OffRL AI4CE 29 49 0 13 Mar 2020
Model-Free Mean-Field Reinforcement Learning: Mean-Field MDP and Mean-Field Q-Learning René Carmona Mathieu Laurière Zongjun Tan OffRL 24 97 0 28 Oct 2019