数据挖掘：实用机器学习工具与技术_05挖掘结果的可信度评价.pptx

2 Data Mining: Practical Machine Learning Tools and Techniques (Chapter 5) Credibility: Evaluating what’s been learned Issues: training, testing, tuning Predicting performance: confidence limits Holdout, cross-validation, bootstrap Comparing schemes: the t-test Predicting probabilities: loss functions Cost-sensitive measures Evaluating numeric prediction The Minimum Description Length principle 3 Data Mining: Practical Machine Learning Tools and Techniques (Chapter 5) Evaluation: the key to success How predictive is the model we learned? Error on the training data is not a good indicator of pe