weka开发文档7.pdfVIP

Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter 7 of Data Mining by I. H. Witten, E. Frank and M. A. Hall Data transformations ● Attribute selection ♦ Scheme-independent, scheme-specific ● Attribute discretization ♦ Unsupervised, supervised, error- vs entropy-based, converse of discretization ● Projections ♦ Principal component analysis, random projections, partial least-squares, text, time series ● Sampling ♦ Reservoir sampling ● Dirty data ♦ Data cleansing, robust regression, anomaly detection ● Transforming multiple classes to binary ones ♦ Simple approaches, error-correcting codes, ensembles of nested dichotomies ● Calibrating class probabilities Data Mining: Practical Machine Learning Tools and Techniques (Chapter 7) 2 Just apply a learner? NO! ● Scheme/parameter selection treat selection process as part of the learning process ● Modifying the input: ♦ Data engineering to make learning possible or easier ● Modifying the output ♦ Re-calibrating probability estimates Data Mining: Practical Machine Learning Tools and Techniques (Chapter 7) 3 Attribute selection ● Adding a random (i.e. irrelevant) attribute can significantly degrade C4.5’s performance ♦ Problem: attribute selection based on smaller and smaller amounts of data ● IBL very susceptible to irrelevant attributes ♦ Number of training instances required increases exponentially with number of irrelevant attributes ● Naïve Bayes doesn’t have this problem ● Relevant attributes can also be harmful Data Mining: Practical Machine Learning Tools and Techniques (Chapter 7) 4 Scheme-independent attribute selection ● Filter approach: assess based on g