1. (MO1): A message source generates one of five messages randomly every 0.2 microsecond.
The probabilities of these messages are 0.4, 0.3, 0.2, 0.05, and 0.05. Each emitted message
is independent of the other messages in the sequence.
(a) What is the source entropy?
(b) What is the rate of information generated by this source (in bits per second)?
2. (MO2): A source emits eight messages with probabilities 1/2, 1/4, 1/8, 1/16, 1/32,
1/64, 1/128, and 1/128, respectively. Find the entropy of the source. Obtain the compact
binary code and find the average length of the codeword. Determine the efficiency and
the redundancy of the code