4.5 Article

Mean Field Markov Decision Processes

Related references

Note: Only part of the references are listed.
Article Statistics & Probability

MEAN-FIELD MARKOV DECISION PROCESSES WITH COMMON NOISE AND OPEN-LOOP CONTROLS

Mederic Motte et al.

Summary: In this paper, we conducted a comprehensive study on Markov decision process (MDP) under mean field interaction both on states and actions in the presence of common noise. By introducing the CMKV-MDP model, which is the asymptotic problem of N-cooperative agents controlled by a social planner/influencer, we established the correspondence between CMKV-MDP and a general lifted MDP on the space of probability measures. Furthermore, we proved the dynamic programming Bellman fixed point equation satisfied by the value function and the existence of e-optimal randomized feedback controls.

ANNALS OF APPLIED PROBABILITY (2022)

Article Operations Research & Management Science

Stationary Discounted and Ergodic Mean Field Games with Singular Controls

Haoyang Cao et al.

Summary: This paper studies stationary mean field games with singular controls and proves the existence and uniqueness of mean field equilibria. It also shows how the mean field equilibria for discounted and ergodic games can be related through an Abelian limit, enabling the approximation of Nash equilibria in unexplored N-player ergodic singular control games through the mean field equilibrium of the discounted game.

MATHEMATICS OF OPERATIONS RESEARCH (2022)

Article Mathematics, Interdisciplinary Applications

Discrete-Time Ergodic Mean-Field Games with Average Reward on Compact Spaces

Piotr Wiecek

DYNAMIC GAMES AND APPLICATIONS (2020)

Article Statistics & Probability

Perturbation theory for Markov chains via Wasserstein distance

Daniel Rudolf et al.

BERNOULLI (2018)

Article Automation & Control Systems

OPTIMAL CONTROL OF PARTIALLY OBSERVABLE PIECEWISE DETERMINISTIC MARKOV PROCESSES

Nicole Bauerle et al.

SIAM JOURNAL ON CONTROL AND OPTIMIZATION (2018)

Article Automation & Control Systems

MARKOV-NASH EQUILIBRIA IN MEAN-FIELD GAMES WITH DISCOUNTED COST

Naci Saldi et al.

SIAM JOURNAL ON CONTROL AND OPTIMIZATION (2018)

Article Mathematics, Interdisciplinary Applications

CONTROL SYSTEMS OF INTERACTING OBJECTS MODELED AS A GAME AGAINST NATURE UNDER A MEAN FIELD APPROACH

Carmen G. Higuera-Chan et al.

JOURNAL OF DYNAMICS AND GAMES (2017)

Article Mathematics, Applied

Discrete-Time Control for Systems of Interacting Objects with Unknown Random Disturbance Distributions: A Mean Field Approach

Carmen G. Higuera-Chan et al.

APPLIED MATHEMATICS AND OPTIMIZATION (2016)

Article Mathematics, Applied

Discrete Time McKean-Vlasov Control Problem: A Dynamic Programming Approach

Huyn Pham et al.

APPLIED MATHEMATICS AND OPTIMIZATION (2016)

Article Automation & Control Systems

Discrete time mean-field stochastic linear-quadratic optimal control problems

Robert Elliott et al.

AUTOMATICA (2013)

Article Automation & Control Systems

Mean Field for Markov Decision Processes: From Discrete to Continuous Optimization

Nicolas Gast et al.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2012)

Article Automation & Control Systems

A mean field approach for optimization in discrete time

Nicolas Gast et al.

DISCRETE EVENT DYNAMIC SYSTEMS-THEORY AND APPLICATIONS (2011)

Article Mathematics, Applied

Discrete time, finite state space mean field games

Diogo A. Gomes et al.

JOURNAL DE MATHEMATIQUES PURES ET APPLIQUEES (2010)

Article Mathematics

Mean field games. I - The stationary case.

Jean-Michel Lasry et al.

COMPTES RENDUS MATHEMATIQUE (2006)

Article Operations Research & Management Science

The unbalance and bounds on the average waiting time for periodic routing to one queue

A Hordijk et al.

MATHEMATICAL METHODS OF OPERATIONS RESEARCH (2004)

Article Mathematics, Applied

Convex stochastic fluid programs with average cost

N Bäuerle

JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS (2001)