Information Theory Coding信息论与编码（英文版） 梁建武 第6章 限失真编码新.ppt

Chapter 6 Limited distortion Loss Source Coding Brief introduction: compared with the lossless encoding,（comparison on distortion and entropy rate ）. If the entropy compressed encoding permits distortion, then entropy rate will be compressed to the least after encoded. （without decoder）（explain the necessity of two kinds of encode method） Info. rate distortion function R(D): is the basis of entropy compressed encoding. It combines the two measurements : information and distortion to provide solution to consider two factors at the same time in signal processing. The necessity of introduction of distortion 1）Distortion is inevitable; 2）Whether the receiver (info. host) is human being or machine device, he has certain analyze ability and sensitivity. The transmission process surpass these ability will be no significance. 3）Even the receiver can be distinguished and be differentiated, it has little influence on communication quality. So we also call it permitted distortion； 4）Our goal is to research various objective source and source receiver and to get the biggest (permitted) distortion D and its least corresponding source info. rate R(D) when the Qos is assigned. 5）To limited distortion source, the least info. rate must be transmitted is R(D)，not the source entropy H(U) under the lossless situation. Obviously, H(U)≥R(D). only when D=0，the equality is tenable； 6）We must establish objective distortion measure of the source in order to measure D，should we also establish stint relation with D; 7）Function R(D) is the theory basis of limited distortion source processing； Goals to achieve in this chapter Understand the significance of limited distortion source encoding in communication system Discern the meaning and basic method of distortion measure Understand the concept, physical significance and nature of function R(D) Discern the calculation method of function R(D) in specific situation Discern the usage of function R(D) in channel encoding theorem