数据挖掘：实用机器学习工具与技术_07变换技术解读.pptxVIP

2 Data Mining: Practical Machine Learning Tools and Techniques (Chapter 7) Data transformations Attribute selection Scheme-independent, scheme-specific Attribute discretization Unsupervised, supervised, error- vs entropy-based, converse of discretization Projections Principal component analysis, random projections, partial least-squares, text, time series Sampling Reservoir sampling Dirty data Data cleansing, robust regression, anomaly detection Transforming multiple classes to binary ones Simple approaches, error-correcting codes, ensembles of nested dichotomies Calibrating class probabilities 3 Data Mining: Practical Machine Learning Tools and Techniques (Chapter 7) Just apply a learner? NO! Scheme/parameter selection treat selection process as part of the learning process Modifying the input: Data engineering to make learning possible or easier Modifying the output Re-calibrating probability estimates 4 Data Mining: Practical Machine Learning Tools and Techniques (Chapter 7) Attribute selection Adding a random (i.e. irrelevant) attribute can significantly degrade C4.5’s performance Problem: attribute selection based on smaller and smaller amounts of data IBL very susceptible to irrelevant attributes Number of training instances required increases exponentially with number of irrelevant attributes Na?ve Bayes doesn’t have this problem Relevant attributes can also be harmful 5 Data Mining: Practical Machine Learning Tools and Techniques (Chapter 7) Scheme-independent attribute selection Filter approach: assess based on general characteristics of the data One method: find smallest subset of attributes that separates data Another method: use different learning scheme e.g. use attributes selected by C4.5 and 1R, or coefficients of linear model, possibly applied recursively (recursive feature elimination) IBL-based attribute weighting techniques: can’t find redundant attributes (but fix has been suggested) Correlation-based Feature Selection (CFS): correlation between