Markov decision processes approximation with coupled dynamics via Markov deterministic control systems
Abstract: This article presents an approximation of discrete Markov decision processes with small noise on Borel spaces with an infinite horizon and an expected total discounted cost by the corresponding deterministic Markov process. In both cases, the dynamics evolve through a system consisting of two coupled difference equations. It is assumed that the difference equations of the system are perturbed by a small noise. Under our assumptions, a bound for the stability index is given, and the optimal cost convergence rate is estimated using a small perturbation parameter. Moreover, the convergence of the optimal policy on compact subsets is verified. Finally, two examples are presented to illustrate the developed theory.
- Standort
-
Deutsche Nationalbibliothek Frankfurt am Main
- Umfang
-
Online-Ressource
- Sprache
-
Englisch
- Erschienen in
-
Markov decision processes approximation with coupled dynamics via Markov deterministic control systems ; volume:21 ; number:1 ; year:2023 ; extent:18
Open mathematics ; 21, Heft 1 (2023) (gesamt 18)
- Urheber
-
Portillo-Ramírez, Gustavo
Cruz-Suárez, Hugo
López-Ríos, Ruy
Blancas-Rivera, Rubén
- DOI
-
10.1515/math-2023-0129
- URN
-
urn:nbn:de:101:1-2023102514034188633867
- Rechteinformation
-
Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Letzte Aktualisierung
-
14.08.2025, 10:48 MESZ
Datenpartner
Dieses Objekt wird bereitgestellt von:
Deutsche Nationalbibliothek. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Deutsche Nationalbibliothek. Bei Fragen zum Objekt wenden Sie sich bitte an den Datenpartner.
Beteiligte
- Portillo-Ramírez, Gustavo
- Cruz-Suárez, Hugo
- López-Ríos, Ruy
- Blancas-Rivera, Rubén
Ähnliche Objekte (12)
On Risk-Sensitive Piecewise Deterministic Markov Decision Processes
Competitive Markov decision processes
Markov-switching decision trees
Local Approximation of Discounted Markov Decision Problems by Mathematical Programming Methods
Markov processes driven by quasi-periodic deterministic forces
Risk-sensitive Markov decision processes
Mean Field Markov Decision Processes
A Markov decision model for a surveillance application and risk-sensitive Markov decision processes
Markov operators, positive semigroups and approximation processes
Supports of invariant measures for piecewise deterministic Markov processes
Analysis Of Upwind Method For Piecewise Deterministic Markov Processes
Equilibrium in misspecified Markov decision processes
On Risk-Sensitive Piecewise Deterministic Markov Decision Processes
Competitive Markov decision processes
Markov-switching decision trees
Local Approximation of Discounted Markov Decision Problems by Mathematical Programming Methods
Markov processes driven by quasi-periodic deterministic forces
Risk-sensitive Markov decision processes
Mean Field Markov Decision Processes
A Markov decision model for a surveillance application and risk-sensitive Markov decision processes
Markov operators, positive semigroups and approximation processes
Supports of invariant measures for piecewise deterministic Markov processes
Analysis Of Upwind Method For Piecewise Deterministic Markov Processes
Equilibrium in misspecified Markov decision processes
On Risk-Sensitive Piecewise Deterministic Markov Decision Processes
Competitive Markov decision processes
Markov-switching decision trees
Local Approximation of Discounted Markov Decision Problems by Mathematical Programming Methods
Markov processes driven by quasi-periodic deterministic forces
Risk-sensitive Markov decision processes
Mean Field Markov Decision Processes
A Markov decision model for a surveillance application and risk-sensitive Markov decision processes
Markov operators, positive semigroups and approximation processes
Supports of invariant measures for piecewise deterministic Markov processes
Analysis Of Upwind Method For Piecewise Deterministic Markov Processes