Question

Q5: (A) A zero memory source has a source alphabet S = {s1, s2, s3, s4}, with P = {3/8, 1/8, 1/4, 3/4 }. Find the entropy of the source H (S). Find the entropy of the second H (S²) extension and verify; Then Find H (S?) and H (S¹¹)? (13 Marks) B) Consider a Binary channel specified by the following noise characteristic (channel matrix); Find correct source probabilities (Input symbol probabilities) using Muroga’s Theorem (12 Marks) P(Y/X) = [0.5 0.5] [0.2 0.8]

          Q5: (A) A zero memory source has a source alphabet S = {s1, s2, s3, s4}, with P = {3/8, 1/8, 1/4, 3/4 }. Find the entropy of the source H (S). Find the entropy of the second H (S²) extension and verify; Then Find H (S?) and H (S¹¹)? (13 Marks)

B) Consider a Binary channel specified by the following noise characteristic (channel matrix); Find correct source probabilities (Input symbol probabilities) using Muroga’s Theorem (12 Marks)

P(Y/X) = [0.5 0.5]
          [0.2 0.8]

Q5: (A) A zero memory source has a source alphabet S = s1, s2, s3, s4, with P = 3/8, 1/8, 1/4, 3/4 . Find the entropy of the source H (S). Find the entropy of the second H (S²) extension and verify; Then Find H (S?) and H (S¹¹)? (13 Marks)

B) Consider a Binary channel specified by the following noise characteristic (channel matrix); Find correct source probabilities (Input symbol probabilities) using Muroga’s Theorem (12 Marks)

P(Y/X) = [0.5 0.5]
[0.2 0.8]

Added by Sandra G.

Calculus: Early Transcendentals

James Stewart 8th Edition

Instant Answer

Solved by Expert Madhur L

02/14/2023

Step 1

However, there's an inconsistency in the number of symbols and the number of probabilities provided. A source alphabet with three symbols should have three probabilities summing up to 1. Assuming a typo and that the correct probabilities are meant for three Show more…

Show all steps

Thanks for your feedback!

(A) A zero memory source has a source alphabet S = {s1, s2, s3, s4}, with P = {3/8, 1/8, 1/4, 3/4 }. Find the entropy of the source H (S). Find the entropy of the second H (S²) extension and verify; Then Find H (S⁶) and H (S¹¹)? (13 Marks) B) Consider a Binary channel specified by the following noise characteristic (channel matrix); Find correct source probabilities (Input symbol probabilities) using Muroga’s Theorem (12 Marks) P(Y/X) = [0.5 0.5; 0.2 0.8]