基于概念选择和重要性度量的多模态语义融合-应用科学学报.pdfVIP

28 3 Vol. 28 No. 3 20105 JOURNAL OF APPLIED SCIENCES — Electronics and Information Engineering May 2010 DOI: 10.3969/j.issn.0255-8297.2010.03.007 450002 . . . . TP391 0255-8297(2010)03-0266-05 Multimodal Fusion Based on Concept Selection and Importance Measure GUO Ge, PING Xi-jian, ZHANG Tao Institute of Information Engineering, PLA Information Engineering University, Zhengzhou 450002, China Abstract: According to the characteristics of human cognitive processes, a multimodal fusion method of semantic concept selection and importance measure is proposed. Semantic concepts are first obtained in single mode, and a correlation detection method is used to decide semantic concept of fusion. Correlation detection can reduce the influence of diffusion error due to false detection semantic. Since the method of probability fusion cannot effectively handle the temporal characteristics of the semantic, an importance measure is introduced for high level semantic fusion. Experimental results show that the proposed method using temporal characteristics and relativity between concepts can better extract high-level semantic contents as compared to other fusion methods. Keywords: semantic information, multimodal fusion, importance measure, relativity, concept selection . .