Markov decision processes approximation with coupled dynamics via Markov deterministic control systems
Abstract: This article presents an approximation of discrete Markov decision processes with small noise on Borel spaces with an infinite horizon and an expected total discounted cost by the corresponding deterministic Markov process. In both cases, the dynamics evolve through a system consisting of two coupled difference equations. It is assumed that the difference equations of the system are perturbed by a small noise. Under our assumptions, a bound for the stability index is given, and the optimal cost convergence rate is estimated using a small perturbation parameter. Moreover, the convergence of the optimal policy on compact subsets is verified. Finally, two examples are presented to illustrate the developed theory.
- Location
-
Deutsche Nationalbibliothek Frankfurt am Main
- Extent
-
Online-Ressource
- Language
-
Englisch
- Bibliographic citation
-
Markov decision processes approximation with coupled dynamics via Markov deterministic control systems ; volume:21 ; number:1 ; year:2023 ; extent:18
Open mathematics ; 21, Heft 1 (2023) (gesamt 18)
- Creator
-
Portillo-Ramírez, Gustavo
Cruz-Suárez, Hugo
López-Ríos, Ruy
Blancas-Rivera, Rubén
- DOI
-
10.1515/math-2023-0129
- URN
-
urn:nbn:de:101:1-2023102514034188633867
- Rights
-
Open Access; Der Zugriff auf das Objekt ist unbeschränkt möglich.
- Last update
-
14.08.2025, 10:48 AM CEST
Data provider
This object is provided by:
Deutsche Nationalbibliothek. If you have any questions about the object, please contact the data provider.
Deutsche Nationalbibliothek. If you have any questions about the object, please contact the data provider.
Associated
- Portillo-Ramírez, Gustavo
- Cruz-Suárez, Hugo
- López-Ríos, Ruy
- Blancas-Rivera, Rubén
Other Objects (12)
On Risk-Sensitive Piecewise Deterministic Markov Decision Processes
Competitive Markov decision processes
Markov-switching decision trees
Local Approximation of Discounted Markov Decision Problems by Mathematical Programming Methods
Markov processes driven by quasi-periodic deterministic forces
Risk-sensitive Markov decision processes
Mean Field Markov Decision Processes
A Markov decision model for a surveillance application and risk-sensitive Markov decision processes
Markov operators, positive semigroups and approximation processes
Supports of invariant measures for piecewise deterministic Markov processes
Analysis Of Upwind Method For Piecewise Deterministic Markov Processes
Equilibrium in misspecified Markov decision processes
On Risk-Sensitive Piecewise Deterministic Markov Decision Processes
Competitive Markov decision processes
Markov-switching decision trees
Local Approximation of Discounted Markov Decision Problems by Mathematical Programming Methods
Markov processes driven by quasi-periodic deterministic forces
Risk-sensitive Markov decision processes
Mean Field Markov Decision Processes
A Markov decision model for a surveillance application and risk-sensitive Markov decision processes
Markov operators, positive semigroups and approximation processes
Supports of invariant measures for piecewise deterministic Markov processes
Analysis Of Upwind Method For Piecewise Deterministic Markov Processes
Equilibrium in misspecified Markov decision processes
On Risk-Sensitive Piecewise Deterministic Markov Decision Processes
Competitive Markov decision processes
Markov-switching decision trees
Local Approximation of Discounted Markov Decision Problems by Mathematical Programming Methods
Markov processes driven by quasi-periodic deterministic forces
Risk-sensitive Markov decision processes
Mean Field Markov Decision Processes
A Markov decision model for a surveillance application and risk-sensitive Markov decision processes
Markov operators, positive semigroups and approximation processes
Supports of invariant measures for piecewise deterministic Markov processes
Analysis Of Upwind Method For Piecewise Deterministic Markov Processes