You are allowed to use Matlab/Octave. Show all your work and box in all solutions. After the completion of the quiz, please submit the scan in PDF form.
1. For the rock, paper, scissors problem whose transition diagram is given below, find:
199
a) Probability transition matrix P
b) Probability of picking paper in Step 4 of a random walk given that Step 0 is scissors.
c) Stationary probabilities given that Step 0 is scissors.