第三章 信道容量习题答案.doc

信道容量习题答案第三章． 信道容量习题答案第三章． xXx????21，信道转移矩3.1 设信源通过一干扰信道，接收符号为Y = { y1, y2 }?????)0.60.4XP(????15???? 66 ，求：阵为??31?? 44??xXx 中事件分别包含的自信息量；(1) 信源和事件 21 (i=1,2)(j=1,2)xy 后，获得的关于(2) 收到消息的信息量；ij YX (3) 信源的信息熵；和信宿H(Y/X)H(X/Y) (4) 和噪声熵；信道疑义度Y (5) 接收到信息后获得的平均互信息量。 解：1) bit0(x)??log.6?0.737 xI()??logp 22110.4?1.??log322 bitlogI(x)??p(x)22222) 51p(y)?p(x)p(y/x)?p(x)p(y/x)?0.6??0.4??0.621111216413p(y)?p(x)p(y/x)?p(x)p(y/x)?0.6??0.4??0.4212221264p(y/x)5/611I(x;y)?log?log?0.474 bit2121p(y)0.6 1)/xp(y61/12bit263 ?1.y)?log?log?I(x;22124.y)0(p2)x(y/p4/121bit .263log??log??1(Ix;y)21226.)0p(y1)xy/p(43/22bit)xI(;y?log907 log?0.?222240.p(y)23) ?p(x)logp(x)??(0.6log0.6?0.4log?H(X)?0.4)log10?0.971 bit/symbol2ii i?symbol/971. bit010lo)yp)y?)(HY?p(log(?(.log.?.log.)?2jjj4) · 17 · ??)/xxx)p(y/)logp(/H(YX)??yp(iiijjji3135511110??log?0.4log)?log? ??(0.6?log0.6?log?0.4 244466664 symbol ?0.715 bit/)H(X)?HYX/Y)?H((Y/X)?H(?)Y)?H(YH(X)?H(/X??H(X/Y) symbol715 bit/.715?0.971?0.0 ?0.971? 5) symbol .715?0.256bit/?X)?H(X)?H(/Y)?0.9710I(X;Y12????33 设二元对称信道的传递矩阵为3.2 ??21??33??I(X;Y)H(X), H(X/Y), H(Y/X)P(0)P(1) (1) 若 = 3/4, 和= 1/4，求； 求该信道的信道容量及其达到信道容量时的输入概率分布；(2) 解：1) 1133?symbol/811 bit)??(?log??log)?0?H(X)?.p(x2i24444i??)y/x(x)p(y/x)logpH(Y/X)??(piiijjji21232231111110?log??lg??lg??lg)? ?(?lg2334334334334symbol/ ?0.918 bit1132 ?x)/)p(y(y??(xy)p(xy)p(x)p(0????.5833/x)?px?(py)p21111112121343421134167()y)?y?y?(py)p(x)p(x)p(xp(/x?px)?.?0?/p(yx)??221212212223443?symbolbit0)4167?.980 /.?.?0?.?)?YH()?(py?(05833log.583304167log02j2j)Y/X())?H(X/Y?H(Y)?HX)(IX;Y?H(symbol/.749 bit????Y)?)H(Y?H(/X)0.8110.9800.9180XH)/(HXY?(symbol .?.?.??YXH)(?YXI(;)HX?(/)081107490062bit/ 2) · 18 · 1122C?maxI(X;Y)?logm?H?log2?(lg?lg)?log10?0.082 bit/symbol 22mi2 33331?x)p( i2。0.25W，其余是是5 KΩ；按瓦分64%是0.125WΩ，3.3 设有一批电阻，按阻值分70%是2K30%，问通过测量阻值可以得到的关于瓦数的平均信息0.125W80%是现已知2 KΩ阻值的电