Model-Free Mean-Field Reinforcement Learning: Mean-Field MDP and Mean-Field Q-Learning

28 October 2019

Mathieu Laurière

Papers citing "Model-Free Mean-Field Reinforcement Learning: Mean-Field MDP and Mean-Field Q-Learning"

48 / 48 papers shown

Title
Evolutionary Multi-agent Reinforcement Learning in Group Social Dilemmas Brian Mintz Feng Fu 26 1 0 01 Nov 2024
Scalable Offline Reinforcement Learning for Mean Field Games Axel Brunnbauer Julian Lemmel Z. Babaiee Sophie A. Neubauer Radu Grosu OffRL 30 0 0 23 Oct 2024
Deep Learning Algorithms for Mean Field Optimal Stopping in Finite Space and Discrete Time Lorenzo Magnino Yuchen Zhu Mathieu Laurière AI4CE 21 1 0 11 Oct 2024
Reinforcement Learning for Finite Space Mean-Field Type Games Kai Shao Jiacheng Shen Chijie An Mathieu Laurière AI4CE 26 1 0 25 Sep 2024
Robust Cooperative Multi-Agent Reinforcement Learning:A Mean-Field Type Game Perspective Muhammad Aneeq uz Zaman Mathieu Laurière Alec Koppel Tamer Basar 34 3 0 20 Jun 2024
Locally Interdependent Multi-Agent MDP: Theoretical Framework for Decentralized Agents with Dynamic Dependencies Alex DeWeese Guannan Qu 29 2 0 10 Jun 2024
Analysis of Multiscale Reinforcement Q-Learning Algorithms for Mean Field Control Games Andrea Angiuli J. Fouque Mathieu Laurière Mengrui Zhang 33 1 0 27 May 2024
A Single Online Agent Can Efficiently Learn Mean Field Games Chenyu Zhang Xu Chen Xuan Di OffRL 23 2 0 05 May 2024
Independent RL for Cooperative-Competitive Agents: A Mean-Field Perspective Muhammad Aneeq uz Zaman Alec Koppel Mathieu Laurière Tamer Basar 37 3 0 17 Mar 2024
Efficient Reinforcement Learning for Global Decision Making in the Presence of Local Agents at Scale Emile Anand Guannan Qu 36 5 0 01 Mar 2024
Collaborative Optimization of the Age of Information under Partial Observability Anam Tahir Kai Cui Bastian Alt Amr Rizk Heinz Koeppl 21 1 0 20 Dec 2023
Deep Reinforcement Learning for Infinite Horizon Mean Field Problems in Continuous Spaces Andrea Angiuli J. Fouque Ruimeng Hu Alan Raydan 25 5 0 19 Sep 2023
Actor critic learning algorithms for mean-field control with moment neural networks Huyen Pham X. Warin 18 5 0 08 Sep 2023
Learning Decentralized Partially Observable Mean Field Control for Artificial Collective Behavior Kai Cui Sascha H. Hauck Christian Fabian Heinz Koeppl 26 6 0 12 Jul 2023
Safe Model-Based Multi-Agent Mean-Field Reinforcement Learning Matej Jusup Barna Pásztor Tadeusz Janik Kecheng Zhang F. Corman Andreas Krause Ilija Bogunovic 27 3 0 29 Jun 2023
Continuous-time q-learning for mean-field control problems Xiaoli Wei Xian Yu 23 8 0 28 Jun 2023
On Imitation in Mean-field Games Giorgia Ramponi Pavel Kolev Olivier Pietquin Niao He Mathieu Laurière M. Geist AI4CE 22 0 0 26 Jun 2023
Networked Communication for Decentralised Agents in Mean-Field Games Patrick Benjamin Alessandro Abate FedML 30 2 0 05 Jun 2023
On the Statistical Efficiency of Mean Field Reinforcement Learning with General Function Approximation Jiawei Huang Batuhan Yardim Niao He 18 10 0 18 May 2023
Model-Free Learning and Optimal Policy Design in Multi-Agent MDPs Under Probabilistic Agent Dropout Carmel Fiscko S. Kar Bruno Sinopoli 6 1 0 24 Apr 2023
Major-Minor Mean Field Multi-Agent Reinforcement Learning Kai Cui Christian Fabian Anam Tahir Heinz Koeppl 19 2 0 19 Mar 2023
Actor-Critic learning for mean-field control in continuous time N. Frikha Maximilien Germain Mathieu Laurière H. Pham Xuan Song 24 16 0 13 Mar 2023
Mean-Field Control based Approximation of Multi-Agent Reinforcement Learning in Presence of a Non-decomposable Shared Global State Washim Uddin Mondal Vaneet Aggarwal S. Ukkusuri 22 8 0 13 Jan 2023
Policy Mirror Ascent for Efficient and Independent Learning in Mean Field Games Batuhan Yardim Semih Cayci M. Geist Niao He 48 28 0 29 Dec 2022
Multi-Agent Reinforcement Learning with Shared Resources for Inventory Management Yuandong Ding Ming Feng Guozi Liu Wei Jiang Chuheng Zhang Li Zhao Lei Song Houqiang Li Yan Jin Jiang Bian 11 16 0 15 Dec 2022
Scalable Task-Driven Robotic Swarm Control via Collision Avoidance and Learning Mean-Field Control Kai Cui Mengguang Li Christian Fabian Heinz Koeppl AI4CE 35 5 0 15 Sep 2022
Graphon Mean-Field Control for Cooperative Multi-Agent Reinforcement Learning Yuanquan Hu Xiaoli Wei Jun Yan Heng-Wei Zhang 26 8 0 11 Sep 2022
A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learning Kai Cui Anam Tahir Gizem Ekinci Ahmed Elshamanhory Yannick Eich Mengguang Li Heinz Koeppl AI4CE 78 15 0 08 Sep 2022
Learning Mean-Field Control for Delayed Information Load Balancing in Large Queuing Systems Anam Tahir Kai Cui Heinz Koeppl 11 2 0 09 Aug 2022
Hypergraphon Mean Field Games Kai Cui Wasiur R. KhudaBukhsh Heinz Koeppl AI4CE 20 7 0 30 Mar 2022
Individual-Level Inverse Reinforcement Learning for Mean Field Games Yang Chen Libo Zhang Jiamou Liu Shuyue Hu AI4CE 17 9 0 13 Feb 2022
Decentralized Mean Field Games Sriram Ganapathi Subramanian Matthew E. Taylor Mark Crowley Pascal Poupart OOD OffRL 24 14 0 16 Dec 2021
Learning Graphon Mean Field Games and Approximate Nash Equilibria Kai Cui Heinz Koeppl AI4CE 22 34 0 29 Nov 2021
Generalization in Mean Field Games by Learning Master Policies Sarah Perrin Mathieu Laurière Julien Pérolat Romuald Élie M. Geist Olivier Pietquin AI4CE 81 34 0 20 Sep 2021
On the Approximation of Cooperative Heterogeneous Multi-Agent Reinforcement Learning (MARL) using Mean Field Control (MFC) Washim Uddin Mondal Mridul Agarwal Vaneet Aggarwal S. Ukkusuri 27 43 0 09 Sep 2021
Mean-Field Multi-Agent Reinforcement Learning: A Decentralized Network Approach Haotian Gu Xin Guo Xiaoli Wei Renyuan Xu OOD 18 36 0 05 Aug 2021
Efficient Model-Based Multi-Agent Mean-Field Reinforcement Learning Barna Pásztor Ilija Bogunovic Andreas Krause 18 41 0 08 Jul 2021
Exploration noise for learning linear-quadratic mean field games François Delarue A. Vasileiadis MLT 19 11 0 02 Jul 2021
Reinforcement Learning for Mean Field Games, with Applications to Economics Andrea Angiuli J. Fouque Mathieu Lauriere 17 26 0 25 Jun 2021
Permutation Invariant Policy Optimization for Mean-Field Multi-Agent Reinforcement Learning: A Principled Approach Yan Li Lingxiao Wang Jiachen Yang Ethan Wang Zhaoran Wang T. Zhao H. Zha 11 22 0 18 May 2021
Mean Field Behaviour of Collaborative Multi-Agent Foragers Daniel Jarne Ornia P. Zufiria M. Mazo 11 4 0 13 Mar 2021
Exploratory LQG Mean Field Games with Entropy Regularization Dena Firoozi S. Jaimungal 20 30 0 25 Nov 2020
Linear-Quadratic Zero-Sum Mean-Field Type Games: Optimality Conditions and Policy Optimization René Carmona Kenza Hamidouche Mathieu Laurière Zongjun Tan 19 9 0 01 Sep 2020
Unified Reinforcement Q-Learning for Mean Field Game and Control Problems Andrea Angiuli J. Fouque Mathieu Laurière 32 70 0 24 Jun 2020
A General Framework for Learning Mean-Field Games Xin Guo Anran Hu Renyuan Xu Junzi Zhang OffRL AI4CE 21 49 0 13 Mar 2020
Adaptive Online Distributed Optimal Control of Very-Large-Scale Robotic Systems Pingping Zhu Chang-rui Liu Silvia Ferrari 15 12 0 04 Mar 2020
Mean-Field Controls with Q-learning for Cooperative MARL: Convergence and Complexity Analysis Haotian Gu Xin Guo Xiaoli Wei Renyuan Xu 32 65 0 10 Feb 2020
Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms K. Zhang Zhuoran Yang Tamer Basar 19 1,173 0 24 Nov 2019