高维特征降维技术.pptVIP

高维降维理论与技术 Reference Turk, Matthew A.; Pentland, Alex P. Face Recognition using Eigenface，Proc IEEE CVPR 1991, p 586-591 M. S. Bartlett, H. M. Lades, and T. J. Sejnowski. Independent Component Representations for Face Recognition,In Proc. SPIE Conf. on Human Vision and Electronic Imaging III, volume 3299, pages 528-539, 1998. JB Tenenbaum etc. A Global Geometric Framework for Nonlinear Dimensionality Reduction, Science 290 (5500): 2319-2323, 22 December 2000 Sam T. Roweis, Lawrence K. Saul ,Nonlinear Dimensionality Reduction by Locally Linear Embedding, Science 290 (5500): 2323-2326, 22 December 2000 特征降维的意义 Complex stimuli can be represented by points in a high-dimensional vector space They typically have a much more compact description Dimensionality reduction: finding meaningful hidden low-dimensional structures 中心极限定律与维数灾难 SVD Decomposition 对得到的Term-Document矩阵进行SVD分解 SVD for Technical Memo Example SVD for Technical Memo Example Computing fundamental comparison quantities from the SVD model Three basically sorts of comparisons of interest: Comparing two terms (How similar are terms i and j ?) Comparing two documents (How similar are documents i and j ?), Comparing a term and a document (How associated are term i and document j ?). In standard information retrieval approaches, these amount respectively, to comparing two rows, comparing two columns, or examining individual cells of the original matrix of term by document data, X Here we make similar comparisons, but use the matrix Xhihat , since it is presumed to represent the important and reliable patterns underlying the data in X SVD for Technical Memo Example Principal Component Analysis A N x N pixel image of a face, represented as a vector occupies a single point in N2-dimensional image space. Images of faces being similar in overall configuration, will not be randomly distributed in this huge image space. Therefore, they can be described by a low dimensiona