Research ArticleOpen AccessGoogle Scholar indexed
Stability Estimation for Markov Control Processes with Discounted Cost
Departamento de Mercadotecnia y Análisis de Datos, Tecnologico de Monterrey, Campus Estado de Mexico (ITESM-CEM), Atizapán de Zaragoza, Estado de México, Mexico
- 1 Departamento de Mercadotecnia y Análisis de Datos, Tecnologico de Monterrey, Campus Estado de Mexico (ITESM-CEM), Atizapán de Zaragoza, Estado de México, Mexico
Copy link · social · email
Abstract
This article explores controllable Borel spaces, stationary, homogeneous Markov processes, discrete time with infinite horizon, with bounded cost functions and using the expected total discounted cost criterion. The problem of the estimation of stability for this type of process is set. The central objective is to obtain a bounded stability index expressed in terms of the Lévy-Prokhorov metric; likewise, sufficient conditions are provided for the existence of such inequalities.
KeywordsDiscrete-Time Markov Control ProcessExpected Total Discounted CostStability IndexProbabilistic MetricLévy-Prokhorov Metric
- Dynkin, E.B. and Yushkevich, A.A. (1979) Controlled Markov Processes. Springer-Verlag, New York. https://doi.org/10.1007/978-1-4615-6746-2
- Hernandez-Lerma, O. (1989) Adaptive Markov Control Process. Springer-Verlang, New York. https://doi.org/10.1007/978-1-4419-8714-3
- Gordienko, E.I. (1988) Stability Estimates for Controlled Markov Chains with a Minorant. Journal of Soviet Mathematics, 40, 481-486. https://doi.org/10.1007/BF01083641
- Gordienko, E.I. (1992) An Estimate of the Stability of Optimal Control of Certain in Stochastic and Deterministic Systems. Journal of Soviet Mathematics, 59, 891-899. https://doi.org/10.1007/BF01099115
- Gordienko, E.I. and Salem, F.S. (1998) Robustness Inequality for Markov Control Processes with Undounded Costs. Systems & Control Letters, 33, 125-130. https://doi.org/10.1016/S0167-6911(97)00077-7
- Gordienko, E.I. and Yushkevich, A. (2003) Stability Estimates in the Problem of Optimal Switching of a Markov Chain. Mathematical Methods of Operations Research, 57, 345-365. https://doi.org/10.1007/s001860200258
- Gordienko, E.I., Lemus-Rodriguez, E. and Montes-de-Oca, R. (2008) Discounted Cost Optimality Problem: Stability with Respect to Weak Metrics. Mathematical Methods of Operations Research, 68, 77-96. https://doi.org/10.1007/s00186-007-0171-z
- Rachev, S.T. and Ruschendorfl, L. (1998) Mass Transportation Problem, Vol. II: Applications. Springer, New York.
- Gordienko, E.I., Lemus-Rodriguez, E. and Montes-de-Oca, R. (2009) Average Cost Markov Control Processes: Stability with Respect to the Kantorovich Metric. Mathematical Methods of Operations Research, 70, 13-33. https://doi.org/10.1007/s00186-008-0229-6
- Montes-de-Oca, R. and Salem-Silva, F. (2005) Estimates for Perturbations of Average Markov Decision Processes with a Minimal State and Upper Bounded by Stochastically Ordered Markov Chains. Kybernetika, 41, 757-772.
- Aziz, M.M. and Merie, D.M. (2020) Stability and Adaptive Control with Sychronition of 3-D Dynamical System. Open Access Library Journal, 7, e6075. https://doi.org/10.4236/oalib.1106075
- Yilmaz, S., Büyükköroglu, T. and Dzhafarov, V. (2015) On Asymptotic Stability of Linear Control Systems. Applied Mathematics, 6, 71-77. https://doi.org/10.4236/am.2015.61008
- Engblom, S. (2014) On the Stability of Stochastic Jump Kinetics. Applied Mathematics, 5, 3217-3239. https://doi.org/10.4236/am.2014.519300