Problem 4
A continuous-time Markov chain (CTMC) has the state transition diagram given on the right. a) Write the transition rate matrix Q and the transition probability matrix P of this CTMC. b) Is this CTMC irreducible? (Why? / Why not?) c) If possible, calculate the stationary state probability vector π.