Question

4.1.4 A Markov chain X0, X1, X2, ... has the transition probability matrix 0 1 2 0 || 0.3 0.2 0.5 || P = 1 || 0.5 0.1 0.4 || 2 || 0.5 0.2 0.3 || Every period that the process spends in state 0 incurs a cost of $2. Every period that the process spends in state 1 incurs a cost of $5. Every period that the process spends in state 2 incurs a cost of $3. What is the long run cost per period associated with this Markov chain?

          4.1.4 A Markov chain X0, X1, X2, ... has the transition probability matrix
0 1 2
0 || 0.3 0.2 0.5 ||
P = 1 || 0.5 0.1 0.4 ||
2 || 0.5 0.2 0.3 ||
Every period that the process spends in state 0 incurs a cost of $2. Every period that the process spends in state 1 incurs a cost of $5. Every period that the process spends in state 2 incurs a cost of $3. What is the long run cost per period associated with this Markov chain?

4.1.4 A Markov chain X0, X1, X2, ... has the transition probability matrix
0 1 2
0 || 0.3 0.2 0.5 ||
P = 1 || 0.5 0.1 0.4 ||
2 || 0.5 0.2 0.3 ||
Every period that the process spends in state 0 incurs a cost of 2. Every period that the process spends in state 1 incurs a cost of5. Every period that the process spends in state 2 incurs a cost of 3. What is the long run cost per period associated with this Markov chain?

Added by Elizabeth F.

Elementary Statistics a Step by Step Approach

Allan G. Bluman 9th Edition

Instant Answer

Solved by Expert Sri K

08/27/2023

Step 1

To do this, we need to solve the following system of equations: πP = π π1 + π2 + π3 = 1 where π is the stationary distribution vector. We can rewrite the system of equations as: 0.3π1 + 0.5π2 + 0.3π3 = π1 0.2π1 + 0.5π2 + 0.2π3 = π2 0.5π1 + 0.1π2 + 0.5π3 = Show more…

Show all steps

Thanks for your feedback!

A Markov chain X0, X1, X2, ... has the transition probability matrix 0 1 2 0 0.3 0.2 0.5 P = 1 0.5 0.1 0.4 2 0.5 0.2 0.3 Every period that the process spends in state 0 incurs a cost of $2. Every period that the process spends in state 1 incurs a cost of $5. Every period that the process spends in state 2 incurs a cost of $3. What is the long run cost per period associated with this Markov chain?