redundancy.
code, the average length of the codeword, the code efficiency, and
We now code the second extension of the source.
14.4-1 A binary channel matrix is given by
Outputs
$\begin{pmatrix} \frac{2}{3} & \frac{1}{3} \\ \frac{1}{10} & \frac{9}{10} \end{pmatrix}$
Inputs
$x_1$
$x_2$
This means $P_{Y|X}(y_1|x_1) = 2/3$, $P_{Y|X}(y_2|x_1) = 1/3$, etc. You are also given that $P_X(x_1) = 1/3$
and $P_X(x_2) = 2/3$. Determine $H(x)$, $H(x|y)$, $H(y)$, $H(y|x)$, and $I(x; y)$.
14.4-2 For the ternary channel in Fi