Machine Learning II (advanced machine learning)(PDF)l11资料.ppt

Dimensionality Reduction with PCA * gaelvaroquaux@ Linear: Principal Components Fit multivariate Gaussian Compute eigenvectors of Covariance Project onto eigenvectors with largest eigenvalues * Other examples of unsupervised learning * Mean face (after alignment) Slide credit: Santiago Serrano Eigenfaces * Slide credit: Santiago Serrano Non-Linear Techniques Isomap Local Linear Embedding * Isomap, Science, M. Balasubmaranian and E. Schwartz Scape (Drago Anguelov et al) * * * I gave each pixel the mean intensity or mean color of its cluster --- this is basically just vector quantizing the image intensities/colors. Notice that there is no requirement that clusters be spatially localized and they’re not. * here c(x) is a vector of filter outputs. A natural thing to do is to square the outputs of a range of different filters at different scales and orientations, smooth the result, and rack these into a vector. * This is figure 14.18 CS 221: Artificial Intelligence Lecture 6: Advanced Machine Learning Sebastian Thrun and Peter Norvig Slide credit: Mark Pollefeys, Dan Klein, Chris Manning * Outline Clustering K-Means EM Spectral Clustering Dimensionality Reduction * The unsupervised learning problem * Many data points, no labels Unsupervised Learning? Google Street View * K-Means * Many data points, no labels K-Means Choose a fixed number of clusters Choose cluster centers and point-cluster allocations to minimize error can’t do this by exhaustive search, because there are too many possible allocations. Algorithm fix cluster centers; allocate points to closest cluster fix allocation; compute best cluster centers x could be any set of features for which we can compute a distance (careful about scaling) * From Marc Pollefeys COMP 256 2003 * K-Means * K-Means * From Marc Pollefeys COMP 256 2003 * K-means clustering using intensity alone and color alone Image Clusters on intensity Clusters on color * From Marc Pollefeys COMP 256 2003 Results of K-Means Clustering: *