Analysis of the Finite-State Ergodic Master Equation
Tóm tắt
Mean field games model equilibria in games with a continuum of players as limiting systems of symmetric n-player games with weak interaction between the players. We consider a finite-state, infinite-horizon problem with two cost criteria: discounted and ergodic. Under the Lasry–Lions monotonicity condition we characterize the stationary ergodic mean field game equilibrium by a mean field game system of two coupled equations: one for the value and the other for the stationary measure. This system is linked with the ergodic master equation. Several discounted mean field game systems are utilized in order to set up the relevant discounted master equations. We show that the discounted master equations are smooth, uniformly in the discount factor. Taking the discount factor to zero, we achieve the smoothness of the ergodic master equation.
Tài liệu tham khảo
Achdou, Y., Cardaliaguet, P., Delarue, F., Porretta, A., Santambrogio, F.: Mean Field Games. Springer, New York (2019)
Arapostathis, A., Biswas, A., Carroll, J.: On solutions of mean field games with ergodic cost. J. Math. Pures Appl. (9) 107(2), 205–251 (2017)
Bayraktar, E., Cecchin, A., Cohen, A., Delarue, F.: Finite state mean field games with Wright Fisher common noise as limits of N-player weighted games. Math. Oper. Res. (2021). https://doi.org/10.1287/moor.2021.1230
Bayraktar, E., Cecchin, A., Cohen, A., Delarue, F.: Finite state MFGs with Wright-Fisher common noise. J. de Math Pures et App 147, 98–162 (2021)
Bayraktar, E., Cohen, A.: Analysis of a finite state many player game using its master equation. SIAM J. Control Optim. 56(5), 3538–3568 (2018)
Bensoussan, A., Frehse, J., Yam, P.: Mean Field Games and Mean Field Type Control Theory. SpringerBriefs in Mathematics. Springer, New York (2013)
Bensoussan, A., Jameson Graber, P., Yam, S.C.P.: Stochastic control on space of random variables. http://arxiv.org/abs/1903.12602 (2019)
Bertucci, C.: Monotone solutions for mean field games master equations: finite state space and optimal stopping. J. de l’École polytechnique — Mathématiques 8, 1099–1132 (2021)
Buckdahn, R., Li, J., Peng, S., Rainer, C.: Mean-field stochastic differential equations and associated PDEs. Ann. Probab. 45(2), 824–878 (2017)
Burzoni, M., Ignazio, V., Reppen, A.M., Soner, H.M.: Viscosity solutions for controlled McKean-Vlasov jump-diffusions. SIAM J. Control Optim. 58(3), 1676–1699 (2020)
Cardaliaguet, P., Delarue, F., Lasry, J.-M., Lions, P.-L.: The Master Equation and the Convergence Problem in Mean Field Games. Annals of Mathematics Studies, vol. 201. Princeton University Press, Princeton (2019)
Cardaliaguet, P., Lasry, J.-M., Lions, P.-L., Porretta, A.: Long time average of mean field games with a nonlocal coupling. SIAM J. Control Optim. 51(5), 3558–3591 (2013)
Cardaliaguet, P., Porretta, A.: Long time behavior of the master equation in mean-field game theory. Anal. PDE 12, 1397 (2017)
Carmona, R., Delarue, F.: Probabilistic Theory of mean field games with applications I. Probability Theory and Stochastic Modelling, vol. 83. Springer, Cham (2018)
Carmona, R., Delarue, F.: Probabilistic Theory of Mean Field Games with Applications. Probability Theory and Stochastic Modelling, vol. 84. Springer, Cham (2018)
Cecchin, A., Pelino, G.: Convergence, fluctuations and large deviations for finite state mean field games via the master equation. Stoch. Process. Appl. 129(11), 4510–4555 (2019)
Chassagneux, J.-F., Crisan, D., Delarue, F.: Numerical method for FBSDEs of McKean-Vlasov type. Ann. Appl. Probab. 29(3), 1640–1684 (2019)
Cohen, A., Zell, E.: Analysis of the finite-state ergodic master equation. http://arxiv.org/abs/2204.05373 (2022)
Delarue, F., Lacker, D., Ramanan, K.: From the master equation to mean field game limit theory: a central limit theorem. Electron. J. Probab. 24, 1–54 (2019)
Delarue, F., Lacker, D., Ramanan, K.: From the master equation to mean field game limit theory: large deviations and concentration of measure. Ann. Probab. 48(1), 211–263 (2020)
Doob, J.L.: Stochastic Processes. Wiley Classics Library. A Wiley Interscience Publication. Reprint of the 1953 original (1990)
Feleqi, E.: The derivation of ergodic mean field game equations for several populations of players. Dyn. Games Appl. 3(4), 523–536 (2013)
Gangbo, W., Mészáros, A.R., Mou, C., Zhang, J.: Mean field games master equations with nonseparable Hamiltonians and displacement monotonicity. Ann. Probab. 50(6), 2178–2217 (2022)
Gangbo, W., Świȩch, A.: Existence of a solution to an equation arising from the theory of mean field games. J. Differ. Equ. 259(11), 6573–6643 (2015)
Gomes, D.A., Mohr, J., Souza, R.R.: Continuous time finite state mean field games. Appl. Math. Optim. 68(1), 99–143 (2013)
Gomes, D.A., Mohr, J., Souza, R.R.A.: Discrete time, finite state space mean field games. In Dynamics, Games and Science. I, volume 1 of Springer Proceedings of Mathematics, pp. 385–389. Springer, Heidelberg (2011)
Guo, X., Hernández-Lerma, O.: Continuous Time Markov Decision Processes. Stochastic Modelling and Applied Probability, vol. 62. Springer-Verlag, Berlin (2009)
Huang, M., Malhamé, R.P., Caines, P.E.: Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle. Commun. Inf. Syst. 6(3), 221–251 (2006)
Lasry, J.-M., Lions, P.-L.: Jeux à champ moyen. I. Le cas stationnaire. C. R. Math. Acad. Sci. Paris 343(9), 619–625 (2006)
Lasry, J.-M., Lions, P.-L.: Jeux à champ moyen. II. Horizon fini et contrôle optimal. C. R. Math. Acad. Sci. Paris 343(10), 679–684 (2006)
Lasry, J.-M., Lions, P.-L.: Mean field games. Jpn. J. Math. 2(1), 229–260 (2007)
Mou, C., Zhang, J.: Wellposedness of second order master equations for mean field games with nonsmooth data. http://arxiv.org/abs/1903.09907 (2019)
Mou, C., Zhang, J.: Mean field game master equations with anti-monotonicity conditions. http://arxiv.org/abs/2201.10762 (2022)
Wiȩcek, P.: Discrete-time ergodic mean-field games with average reward on compact spaces. Dyn. Games Appl. 10(1), 222–256 (2020)
Wu, C., Zhang, J.: Viscosity solutions to parabolic master equations and McKean-Vlasov SDEs with closed-loop controls. Ann. Appl. Probab. 30(2), 936–986 (2020)