Skip to main content

1991 | OriginalPaper | Buchkapitel

The Second Moment of the Markovian Reward Process

verfasst von : S. Subba Rao

Erschienen in: Stochastic Processes and their Applications

Verlag: Springer Berlin Heidelberg

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

In this note an m-state aperiodic irreducible Markov Chain is considered with an associated reward matrix. Expressions for the second moment of Sn, the accumulated reward in n transitions, have been obtained using elementary methods. These provide an alternative computational method compared to methods using the eigen value structure. Asmyptotic forms are also considered.

Metadaten
Titel
The Second Moment of the Markovian Reward Process
verfasst von
S. Subba Rao
Copyright-Jahr
1991
Verlag
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-58201-1_23