一种基于语子空间谱聚类的自动图像标注的方法.docVIP

一种基于语义空间谱聚类的自动图像标注方法 郭玉堂1,2，韩昌刚2 1．合肥师范学院计算机科学与技术系,合肥 230601 2．安徽大学计算机科学与技术学院,合肥 230039 摘 要: 由于“语义鸿沟”的存在，低层特征相同或相似的图像，其语义有可能完全不同。如何挖掘图像的高层语义与低层特征之间的内在联系是当前图像标注领域研究的难点之一。在详细分析现有的图像标注方法优缺点的基础上，提出了一种基于语义一致性的谱聚类图像标注方法。该方法首先在语义空间内，对训练图像先按语义聚类，使得语义相同或相近的图像处于同一类中，再对每个语义类按区域特征聚类，把相似区域聚类到同一个块中，然后运用多伯努利模型求出语义类中每个块与语义间的联合概率分布，利用该联合概率分布模型为未标注图像进行标注。实验结果表明所提出的方法明显提高了标注准确度。能有效地建立图像的低层特征与语义特征间的一致性。 关键词: 图像标注 K-调和均值 图谱聚类 语义鸿沟 Automatic Image Annotation Using Semantic Subspace graph spectral clustering Algorithn Guo Yu-tang1 ， Han Chang-gang2 1．Department of Computer Science and Technology in Hefei Normal College, Hefei 230061,China 2．School of Computer Science and Technology in Anhui University, Hefei 230039,China aieyt@ Abstract: Due to existing the semantic gap, images with the same or similar low level features are possibly totally different on semantic level. How to find the underlying relationship between the high-level semantic and low level features is one of the difficult problems for image annotation. In this paper, a new image annotation method based on graph spectral clustering with the consistency of semantics is proposed with detailed analysis on the advantages and disadvantages of the existed image annotation methods. This method firstly cluster image into several semantic classes by semantic similarity measurement in the semantic subspace. Within each semantic class, images are re-clustered with visual features of.region Then, the joint probability distribution of blobs and words was modeled by using Multiple-Bernoulli Relevance Model. We can annotate a unannotated image by using the joint distribution. Experimental results show the the effectiveness of the proposed approach in terms of quality of the image annotation, the consistency of high-level semantics and low level features is efficiently achieved. Key Words: image annotation, K-Harmonic Means, graph spectral clustering, semantic gap 1 引言 自动图像标注指的是指借助计算机视觉、机器学习与模式识别等多学科技术，从一组已标注好的图像集合中学习图像特征与文本标