3. Consider the following Markov Chain: 0.4 1 0.3 0.6 0.3 0.4 0.1 0.3 0.2 2 3 0.4 Find the generating functions $f_{1,3}(z)$, $f_{2,3}(z)$, $f_{3,3}(z)$, where $\infty$ $f_{i,j}(z) = \sum_{n=1} f^n_{i,j} z^n$
Added by Andrew M.
Close
Step 1
Then $$ P = \begin{pmatrix} 0.4 & 0.6 & 0 \\ 0.3 & 0 & 0.7 \\ 0 & 0.4 & 0.6 \end{pmatrix} $$ The generating functions are given by $$ f_{i,j}(z) = \sum_{n=1}^\infty P^n_{i,j} z^n $$ We have $$ f_{i,j}(z) = \sum_{n=1}^\infty (P^n)_{i,j} z^n = (I - zP)^{-1}_{i,j} - Show more…
Show all steps
Your feedback will help us improve your experience
Adi S and 89 other Calculus 3 educators are ready to help you.
Ask a new question
Labs
Want to see this concept in action?
Explore this concept interactively to see how it behaves as you change inputs.
Key Concepts
Recommended Videos
Consider a Markov chain with state space S = {1,2,3}, and transition probabilities p11 = 1/6, p12 = 1/3, p13 = 1/2, p22 = p33 = 1, and pij = 0 otherwise. (a) Draw a diagram of this Markov chain. (b) Compute (with explanation) f12. (c) Prove that p12^(n) ≥ 1/3, for all positive integers n. (d) Compute Σ_{n=1}^{∞} p12^(n). (e) Why do the answers in parts (d) and (b) not contradict the implication (1) ⇒ (5) in the Recurrence Equivalences Theorem?
Adi S.
7. For each of these generating functions, provide a closed formula for the sequence it determines. a) (3x - 4)³ b) (x³ + 1)³ c) 1/(1 - 5x) d) x³/(1 + 3x) e) x² + 3x + 7 + (1/(1 - x²)) f) (x⁴/(1 - x⁴)) - x³ - x² - x - 1 g) x²/(1 - x)² h) 2e²ˣ
5. (26 marks) A Markov chain X0, X1, X2... on states 0, 1, 2 has the transition probability matrix: P = [0.2 0.1 0.7; 0.5 0.2 0.3; 0.6 0.3 0.1] and initial distribution p0 = P(X0=0) = 0.5, p1 = P(X0=1) = 0.4, p2 = P(X0=2) = 0.1. Determine: a) P(X0=1, X1=2, X2=1). b) P(X0=0, X1=1, X2=2). c) P(X2=0, X3=2 | X1=0). d) P(X1=2, X2=1 | X0=1). e) P(X1=1, X2=2, X3=0). f) Calculate the two-step transition matrix P^2. g) What is P(X3=2 | X1=1)?
Recommended Textbooks
Calculus: Early Transcendentals
Thomas Calculus
Transcript
Watch the video solution with this free unlock.
EMAIL
PASSWORD