Chap3_思考题与习题.pdfVIP

Chap3 3.1 01 P(0) 0.4P(1) 0.6 (1) ? (2) H(X2)H(X /X X )H 3 1 2 (3) H(X4)X4 1p(0)=0.4p(1)=0.6 (2) H (X 2 ) 2H (X ) −2 ×(0.4log 0.4 +0.6 log 0.6) 1.942(bit / sym bols) H (X | X X ) H (X ) − p (x ) log p (x ) −(0.4log 0.4 +0.6 log 0.6) 0.971(bit / symbol ) 3 1 2 3 ∑ i i i H ∞ lim H (X | X X X − ) H (X ) 0.971(bit / sy mbol) N 1 2 N 1 N N →∞ (3) H (X 4 ) 4H (X ) −4 ×(0.4