基于语义的视频内容提取与分析关键技术分析-semantic - based key technology analysis of video content extraction and analysis.docxVIP

map, we extract the feature point motion vectors as motion feature, and then propose a new fuzzy cluster method which use cluster validation to analysis motion consistency. The spatial saliency map is generated using Gabor filter and center-surround descriptor. At last, we fuse the motion and spatial saliency map in motion priority fashion to produce the overall spatiotemporal attention map.For the object content extraction, we focus on the surveillance video. To enable foreground object extraction in outdoor scene, a robust background subtraction technique named AFSDS is proposed based on the adaptive clustering of temporal color/intensity. An un-supervised clustering method is proposed to model the background with a group of clusters and their weights. The clusters and their weights can be updated with the background change. In addition, the unimodal or multimodal distributions of background are detected adaptively. We also present a novel statistical threshold estimation scheme to determine the thresholds using in our method. To enalble the real-time foreground detection, we also proposed a real-time foreground detection algorithm called FFSBC. The unimodal or multimodal distributions of background are detected adaptively. We use a Gaussians model to simulate each cluster which prevents the estimation the parameter of mix of Gaussians model. These nice features enable the real-time foreground detection in outdoor scene.For the scene content extraction, we investigate several methods to semantic content analysis according to the characters of each type of scene. Person retrieval and indexing in video sequences is a challenging task for many multimedia applications. In order to index the person shown in a video, we propose a novel person indexing method called APIV. Firstly, the persons in a shot are detected and tracked through face detector and continuously adaptive mean shift algorithm. Then mid-level features such as clothes colors and voice are applied to repr