信息论 英文课件1.pdfVIP

Fundamentals of Information Theory Lecture 1 —— Introduction Dr. Wu Shaohua hitwush@ Contents What is “Information”? What is “Information Theory”? What can we learn from this course? Page 2 page 2 1. What is “Information”? Definition of Information • “Information” —— something informed. • “信息” —— 音讯、消息（message） • In daily life, we usually take it that “information = message” . • Message is the carrier of information. 息 信 沉 人 美 断 梦 • Not all messages contain information. (uncertainty) 台 楼 倚 路 长 穿 目 • Definition —— description of the uncertainty of motion state or existence form of things. Page 3 page 3 1. What is “Information”? (cont’d) Measurement of information • Uncertain random; uncertain event random event. So we can use “Probability” to measure the amount of information. Page 4 page 4 2. What is “Information Theory”? Background • The history of human utilizing information. – the 1st milestone —— language speed – the 2nd milestone —— character distance – the 3rd milestone —— printing – the 4th milestone —— telegraph, telephone … – the 5th milestone ——digital communications Cost Evaluation Mathematical theory needed!