汉语词语语义相似度计算研究.pdfVIP

33 6 2007 3 Vol.33 No.6 Computer Engineering March 2007 ·· 2007 A TP391 ( 100872) 15 Study on Chinese Words Semantic Similarity Computation XIA Tian (School of Information Resource Management, Renmin University of China, Beijing 100872) AbstractSimilarity computation of Chinese words is a key problem in Chinese information processing. This paper proposes a new method on similarity computation which is based on Hownet, geared to semantic and could be expanded. The new method defines a similarity computation formula among Hownet’s sememes according to information theory, finds a way out of the difficulty that OOV words cannot participate in semantic computation by implementing concept segmentation and automatic semantic production to OOV words, and realizes the similarity computation on the semantic level among arbitrary words finally. Experimental result of CILIN indicates that the accuracy rate of the new method is nearly 15% higher than present ones. Key wordsWords similarity; Hownet; Concept; Sememe [1,2] D =4 3 [3] D =2 D1 =3 2 [4] [4]