第二章信息度量1(英文).pptVIP

Chapter 2.Basic Concepts of Info. Theory--Information statistical measure Introduction——preparation knowledge1.Information measure The information is measurable – which is the foundation to establish Info. Theory; Methods of information measure :Structure measure , statistical measure , semantic measure , fuzzy measure and so on; Statistical measure: this method counts with logarithm of the probability of the event to describe the uncertain thing and to obtain the info. content of the message, it also establishes a new concept --entropy ; Entropy is the most important concept in Shannon Info