Abstract
The paper deals with a class of semi-Markov control models with Borel state and control spaces, possibly unbounded costs, and unknown holding times distribution H. Assuming that H does not depend on state-action pairs, we combine suitable methods of statistical estimation of H with control procedures to construct an asymptotically discounted optimal policy and an optimal stationary policy { f∞}, where f n converges to f∞ in the sense of Schäl [12].
Similar content being viewed by others
Author information
Authors and Affiliations
Corresponding author
Additional information
Manuscript received: February 2004 / Final version received: September 2004
Work supported by Consejo Nacional de Ciencia y Tecnología (CONACyT) under Grant 37239-E.
Rights and permissions
About this article
Cite this article
Luque-Vásquez, F., Minjárez-Sosa, J.A. Semi-Markov control processes with unknown holding times distribution under a discounted criterion. Math Meth Oper Res 61, 455–468 (2005). https://doi.org/10.1007/s001860400406
Issue Date:
DOI: https://doi.org/10.1007/s001860400406