Vladimir N弗拉迪米尔. Vapnik’s The Nature of Statistical .pptVIP

Statistical Learning and Inference Lecturer: Liqing Zhang Dept. Computer Science Engineering, Shanghai Jiao Tong University Statistical Learning  Inference * Statistical Learning and Inference * Books and References Trevor Hastie Robert Tibshirani Jerome Friedman , The Elements of statistical Learning: Data Mining, Inference, and Prediction, 2001, Springer-Verlag V. Cherkassky F. Mulier, Learning From Data, Wiley,1998 Vladimir N. Vapnik, The Nature of Statistical Learning Theory, 2nd ed., Springer, 2000 M. Vidyasagar, Learning and generalization: with applications to neural networks, 2nd ed., Springer, 2003 G. Casella R. Berger, Statistical Inference, Thomson, 2002 T. Cover J. Thomas, Elements of Information Theory, Wiley * Statistical Learning and Inference * Overview of the Course Introduction Overview of Supervised Learning Linear Method for Regression and Classification Basis Expansions and Regularization Kernel Methods Model Selections and Inference Support Vector Machine Bayesian Inference Unsupervised Learning * Statistical Learning and Inference * Why Statistical Learning? 我门被信息淹没，但却缺乏知识。---- R. Roger 恬静的统计学家改变了我们的世界；不是通过发现新的事实或者开发新技术，而是通过改变我们的推理、实验和观点的形成方式。---- I. Hacking 问题：为什么现在的计算机处理智能信息效率很低？ 图像、视频、音频 认知、交流 语言、语音、文本 生物、基因、蛋白 * Statistical Learning and Inference * ML: SARS Risk Prediction SARS Risk Age Gender Blood Pressure Chest X-Ray Pre-Hospital Attributes Albumin Blood pO2 White Count RBC Count In-Hospital Attributes * Statistical Learning and Inference * ML: Auto Vehicle Navigation Steering Direction * Statistical Learning and Inference * Protein Folding * Statistical Learning and Inference * The Scale of Biomedical Data * Statistical Learning and Inference * Computer vs. Brain 计算机信息处理 基于逻辑的计算 ＣＰＵ和数据分离 数据处理与存储　简单 智能信息处理　复杂、慢 认知能力　　　弱 信息处理模式： 　逻辑－概念－统计信息 大脑信息处理 基于统计信息的计算 计算和数据集成一体　 数据处理与存储　未知 智能信息处理　简单、快速 认知能力　　　强 信息处理模式： 　统计信息－概念－逻辑 * Statistical Learning and Inference * Function Estimation Model The Function Estimation Model of lear