Information Theory Coding信息论与编码（英文版） 梁建武 第5章 无失真编码新.ppt

Chapter 5 lossless source coding Source info. Content which the Info. Theory researches on the source: Source modeling: use suitable random process to describe signals concerned：info. which the signals carry Calculation of info. efficiency carried by source output signals Entropy rate, redundancy Valid expression of the source output Source coding source info. Characteristics and classifications of information source Examples of practical info. source Characteristics and classifications of information source Statistical characteristics of information source 1）what is info. source? Info. Source is the origin of information, in practical communication, the common source are: voice, word, picture, data…. In the Info. Theory, info. source is the origin of message（signal）, message（signal）sequence and continuous message. In mathematics, the source is the origin to produce random variable U，random sequence U and random process U(t,ω). 2）Main characteristics of information source The basic characteristic of source is statistical uncertain. It can be described by the probability statistical characteristics. Characteristics and classifications of information source Description and classifications of info. source Single message (signal) source: Discrete source Continuous variable source Steady source Source with/without memory Markov source Random waveform source Practical source Characteristics and classifications of information source Single message（signal）source It is the simplest also is the most basic source, is the composition actual letter source basic unit. It may use the dual foreword [U,P(u)] composed of the scope U of the source random variable and the correspondent probability distribution P (u) to express. Once the source is assigned, its corresponding probability space has been assigned; Otherwise, if the probability space is assigned, which indicates the corresponding source has been assigned. Therefore, the probability space can attribute the discrete source