第4章-信道容量.pptVIP

Chapter 4.Channel and Channel Capacity Review – property of mutual info. function : Property.1 Relationship between average mutual info. and channel input probability distribution Property 1: I (X; Y) is an upper convex function of the channel input probability distribution p (x). Review – property of mutual info. function : Property. 2 Relationship between Info. content and channel transition probability distribution Property 2: I (X; Y) is a concave function of channel transition probability distributes p (y/X). What is channel? The channel is a carrier transmitting messages — a passage through which signal passes. The information is abstract, but the channel is concrete. For instance: If two people converse, the air is the channel; If the two call each other, the telephone line is the channel; If we watch the television, listen to the radio, the space between the receiver and the transmitter is the channel. 4.1. The model and classification of the channel In this part ,we will mainly introduce two parts: Channel models Channel classifications 4.1.1 Channel Models BSC Binary Symmetric Channel (BSC) is the simplest channel model A BSC is shown as below: DMC We assume that the channel and the modulation is memoryless . The inputs and outputs can then be related by a set of conditional probabilities DMC This channel is known as a Discrete Memoryless Channel (DMC) and is depicted as 4.1.2 Channel classifications Channel can be classified into several types. 4.2 Channel doubt degree and average mutual information 4.2.1 Channel doubt degree 4.2.2 Average mutual information 4.2.3 Properties of mutual information function 4.2.4 Relationship between entropy, channel doubt degree and average mutual information 4.2.1 Channel doubt degree Assume r.v. X indicates the input set of channel, and r.v. Y indicates the output set of channel, the channel doubt degree is: This means that if the average uncertainty of source X is H(X) , we’ll get