视频理解技术前沿与方向.ppt

Introduction –Advanced Topics in Multimedia Analysis and Indexing (MMAI) Institute of Digital Media School of EE CS, Peking University Office: 2641 Science Buildings (北京大学理科二号楼2641室) Definition Multimedia Text (Web, PDF, Blog, etc.) Speech (broadcasting, podcasting, recording) Music (CD, MP3, etc.) Image/Photo: a collection of pixels Video: sequence of images Analysis To gain high-level semantic for further manipulation Indexing/search, clustering, and classification Provide efficient non-linear access to data automatic vs. manual e.g., surveillance. Videos during London Bombing Semantic Gap Multimedia Analysis and Indexing, Spring 2009 Goal Preliminary understanding the design and implementation of search, classification, clustering for multimedia (including images, videos, and music) Understanding basic statistical tools for high-dimensional and large-scale (multimedia) data analysis Evaluating the performance of multimedia systems Identifying current research problems in multimedia analysis and retrieval Application Domains and Research in MMAI, Spring 2009 Course Goals for MMAI, Spring 2009 Extending breadths and depths for essential technical components for multimedia analysis and indexing in feature representations and learning Gain practical experiences through assignments and experiments Practicing paper critiques, summarization, and presentations Expected Audiences Students enthusiastic about the research topics in multimedia analysis and indexing Students preliminarily understanding related disciplines such as MMAI, machine learning, pattern recognition, computer vision, etc. Outlines Current directions Web Image Search and Mining Image and Video Annotation Affective Video Retrieval Information Fusion Integration of Context and Content Top 10 Problems in Multimedia Information Retrieval Related Publications Projects in high impact Current Directions Web Image Search and Mining Image and Video Annotation Affective Video Retrie