中文字符串的相似度（Similarity of Chinese strings）.doc

中文字符串的相似度（Similarity of Chinese strings） How to determine the similarity of Chinese strings (ZT) (2008-06-14, 09:19:27)? Reprint Tags: Chinese string similarity, component weight, it abstract Research on data mining, we often need to determine whether the article is similar, classify of similar articles or short sentences, which will encounter this problem: how to determine the degree of similarity between two strings. Based on the authors practical work experience and data mining theory, this paper introduces a relatively complete set of methods to solve the above problems in combination with Chinese string characteristics. Analysis The simplest problem solver The string consists of a set of different meanings of the word, it is different from the numerical variables, to determine its size or position with a specific value, so how to describe the distance between two strings, has become a problem worthy of discussion. Typically, the types of data used for analysis are as follows: interval scale traversal, two variables, nominal variables, ordinal variables, scale type variables, mixed type variables, and so on. These types of variables, this paper argues that the string variable is more suitable for classified in two variables, we can use the word string into a number of words, each word as an attribute of two variables. We set all the words as a set of two yuan variables, R, string 1 and string 2 are included in the set R. Q is the total number of 1 and 2 are string string of words, s is 1 in the total number of words in a string string does not exist, R is a string 2, the total number of words in the 1 string does not exist, t is the total number of words and 1 string string 2 does not exist. We call Q, R, s, and t as 4 state components in string comparison. As shown in figure 1: Because of the two strings of words two string does not exist is not any effect, so ignore T, so we use the similarity evaluation of non constant coefficients (Jaccard coefficients) to d