Consider a Bernoulli process {Xn, n = 0, 1, 2} with success probability p = 0.75. Define Yn as follows:
Yn = 0 if Xn = 0 and Xn-1 = 0,
Yn = 1 if Xn = 0 and Xn-1 = 1,
Yn = 2 if Xn = 1 and Xn-1 = 0,
Yn = 3 if Xn = 1 and Xn-1 = 1.
a) Prove that {Yn, n = 1, 2} is a Markov chain.
b) Write the one-step transition matrix for it.