《数据挖掘机器学习和Weka》.pptVIP

数据挖掘—实用机器学习技术及Java实现 原书 英文版《DataMining—PracticalMachineLearningToolsandTechniqueswithJavaImplementations》，新西兰IanH.Witten、EibeFrank著 Weka AnopensourceframeworkfortextanalysisimplementedinJavathatisbeingdevelopedattheUniversityofWaikatoinNewZealand. http://www.cs.waikato.ac.nz/ml/weka/ /datamining/  概念：KDD、ML、OLAP与DM KDD（Knowledge Discovery in Database） 是一种知识发现的一连串过程。 ML（Machine Learning） ＝KD，不限于Database的数据 过程：挖掘－数据模式－表示－验证－预测 OLAP（Online Analytical Process） 是数据库在线分析过程。 数据挖掘（data Mining） 只是KDD/ML的一个重要组成部分。 DM用在产生假设 ，而OLAP则用于查证假设 概念：DM与DB Data Preparation要占Data mining过程70％工作量 「Data base」＋「 Data mining」＝会说话的数据库 概念：Data Mining 概念：数据挖掘是从大量的数据中，抽取出潜在的、有价值的知识（模型或规则）的过程 Key Characteristics of Data Mining： Large amount of data Discovering previously unknown, hidden information Extracting valuable information Making important business decision using the information DM/ML的一些要点 The data is stored electronically and the search is automated by computer; About solving problems by analyzing data already present in databases; Defined as the process of discovering patterns in data; This book is about——Techniques for finding and describing structural patterns in data. structural patterns表示法：表、树、规则 概念：Machine Learning To learn: to get knowledge of study, experience, or being taught; to become aware by information or from observation; to commit to memory; to be informed of, ascertain(确定); to receive instruction Shortcomings when it comes to talking about computes It’s virtually impossible to test if learning as bean achieved or not. This ties learning to performance rather than knowledge 简单例子：天气问题* 天气数据：weather.nominal.arff 运行Weka，载入数据，选择算法id3 预测（决策树） outlook = rainy | windy = TRUE: no | windy = FALSE: yes 测试方法：采用10 Cross-validation的 测试结果：Confusion Matrix(P.138)和准确率 a b -- classified as 8 1 | a = yes 1 4 | b = no Correctly Classified Instances 12 85.7143 % Incorrectly Classified Instances 2 14.2857 % 其他算法：Neural Network 数据挖掘的过程步