1993 | OriginalPaper | Chapter
Markov Jump Processes
Author : Marc A. Berger
Published in: An Introduction to Probability and Stochastic Processes
Publisher: Springer New York
Included in: Professional Book Archive
Activate our intelligent search to find suitable subject content or patents.
Select sections of text to find matching patents with Artificial Intelligence. powered by
Select sections of text to find additional relevant content using AI-assisted search. powered by
We want to describe Markov processes that evolve through continuous time t ≥ 0, but in a discrete state space ℒ. The prescription for such a process has two ingredients. There are random jump times 0 < τ1 < τ2 < … < τn < … when the process jumps away from the state it is at, and there are transition probabilities Q xy that govern the transitions at these jump times. The process {X(t): t ≥ 0 } itself has piecewise constant paths, which we can take to be right-continuous $$X(t) = \left\{ \begin{gathered} {x_0}, 0 \leqslant t < {\tau _1}, \hfill \\ {x_1}, {\tau _1} \leqslant t < {\tau _2}, \hfill \\ {x_2}, {\tau _2} \leqslant t < {\tau _3}, \hfill \\ \ldots \ldots \ldots \ldots \ldots \ldots \ldots \hfill \\ \end{gathered} \right.$$