CMU高级机器学习非参数学习.pdfVIP

Advanced Machine Learning Advanced Machine Learning Nonparametric methods Nonparametric methods Eric Xing Eric Xing Lecture 2, August 10, 2009 Reading: © Eric Xing @ CMU, 2006-2009 Univariate prediction without using a model: good or bad? Nonparametric Classifier (Instance-based learning) Nonparametric density estimation K-nearest-neighbor classifier Optimality of kNN Spectrum clustering Clustering Graph partition and normalized cut The spectral clustering algorithm Very little “learning” is involved in these methods © Eric Xing @ CMU, 2006-2009 1 Classification Representing data: Hypothesis (classifier) © Eric Xing @ CMU, 2006-2009 Clustering © Eric Xing @ CMU, 2006-2009 2 Decision-making as dividing a high-dimensional space Classification-specific Dist.: P(X|Y) p (X | Y 1) r p (X ;µ ,Σ ) 1 1 1 p (X | Y 2) p X r ( ;µ ,Σ ) 2 2 2 Class prior (i.e., weight): P(Y) © Eric Xing @ CMU, 2006-2009 The Bayes Rule What we have jus