基于多模的新闻人物自动标识.pdf

中国科技论文在线 Cross-modality based Face Naming For News image Collection# * 5 Jinye Peng, Xueping Su, Xiaoyi Feng, Jun Wu, Jianping Fan (School of electronics and information,Northwestern Polytechnical University,Xi'an,71019) Abstract : For automatically mining the underlying relationships between different famous persons in daily news, for example, building a news person based network with the faces as icons to facilitate face-based person finding, we need a tool to automatically label faces in new images as their real 10 names. This paper studies the problem of linking names with faces from large-scale news images with captions. In our previous work, we proposed a method called Person-based Subset Clustering which is mainly based on face clustering for all face images derived from the same name. The location where a name appears in a caption, as well as the visual structural information within a news image provided informative cues such as who are really in the associated image. By combining the domain knowledge 15 from the captions and the corresponding image we propose a novel cross-modality approach to further improve the performance of linking names with faces. The experiments are performed on the data sets including approximately half a million news images from Yahoo! news, and the results show that the proposed method achieves significant improvement over the clustering-only methods. Key words: Image processing ; Cross-modality; Rank aggregation; Face Naming 20 0