Question

1. Consider the Markov chain whose transition probability matrix is given by (a) Starting in state 2, determine the probability that the process is absorbed into state 0. (b) Starting in state 0, determine the mean time that the process spends in state 0 prior to absorption and the mean time that prior to absorption. P = egin{bmatrix} 0.2 & 0.3 & 0 & 0.5 \ 1 & 0 & 0 & 0 \ 0.2 & 0 & 0.6 & 0.2 \ 0 & 0 & 0 & 1 end{bmatrix}

          1. Consider the Markov chain whose transition probability matrix is given by
(a) Starting in state 2, determine the probability that the process is absorbed into state 0.
(b) Starting in state 0, determine the mean time that the process spends in state 0 prior to absorption and the mean time that prior to absorption.
P = egin{bmatrix} 0.2 & 0.3 & 0 & 0.5 \ 1 & 0 & 0 & 0 \ 0.2 & 0 & 0.6 & 0.2 \ 0 & 0 & 0 & 1 end{bmatrix}

1. Consider the Markov chain whose transition probability matrix is given by
(a) Starting in state 2, determine the probability that the process is absorbed into state 0.
(b) Starting in state 0, determine the mean time that the process spends in state 0 prior to absorption and the mean time that prior to absorption.
P = eginbmatrix 0.2 0.3 0 0.5 1 0 0 0 0.2 0 0.6 0.2 0 0 0 1 endbmatrix

Added by Encarnacion P.

Calculus: Early Transcendentals

James Stewart 8th Edition

Thanks for your feedback!

Consider the Markov chain whose transition probability matrix is given by (a) Starting in state 2, determine the probability that the process is absorbed into state 0. (b) Starting in state 0, determine the mean time that the process spends in state 0 prior to absorption and the mean time that prior to absorption.