电子信息工程专业英语翻译清华出版社English_for_IT_and_EE-04技巧.pptVIP

* 9 Quantities of information Information theory is based on probability theory and statistics. The most important quantities of information are entropy, the information in a random variable, and mutual information, the amount of information in common between two random variables. 最重要的信息量是熵即随机变量中的信息，以及互信息即两个随机变量之间的共有信息量。 * 9，10 The former quantity indicates how easily message data can be compressed while the latter can be used to find the communication rate across a channel.6 The choice of logarithmic base determines the unit of information entropy that is used. The most common unit of info