final-day1-july2.pptxVIP

Deep Learning for Information Processing Artificial IntelligenceNew-Generation Models Methodology for Advancing AI SIP;- Survey of audience background (500 registrants: too many to accommodate all)- Teaching materialPART I: Basics of Deep LearningPART II: Modern (as of ICASSP, May 2013 ICML, June, 2013) ;Teaching Material;;5;6;;;;Scientists See Promise in Deep-Learning Programs John Markoff November 23, 2012;Useful Sites on Deep Learning;/deep-learning-research-groups-and-labs/;Outline;Outline;Review of Deep Learning Basics;Distributed Representation;Definition 1: A class of machine learning techniques that exploit many layers of non-linear information processing for supervised or unsupervised feature extraction and transformation, and for pattern analysis and classification. Definition 2: “A sub-field within machine learning that is based on algorithms for learning multiple levels of representation in order to model complex relationships among data. Higher-level features and concepts are thus defined in terms of lower-level ones, and such a hierarchy of features is called a deep architecture. Most of these models are based on unsupervised learning of representations.” (Wikipedia on “Deep Learning” around March 2012.) Definition 3: “A sub-field of?machine learning?that is based on learning several levels of representations, corresponding to a hierarchy of features or factors or concepts, where higher-level concepts are defined from lower-level ones, and the same lower-level concepts can help to define many higher-level concepts. Deep learning is part of a broader family of?machine learning?methods based on?learning representations. An observation (e.g., an image) can be represented in many ways (e.g., a vector of pixels), but some representations make it easier to learn tasks of interest (e.g., is this the image of a human face?) from examples, and research in this area attempts to define what makes better representations and how to learn t