基于大规模语料库的中文同义词抽取方法研究.docVIP

Abstract With the popularity of computer and the rapid development of Internet, the information on the Internet assumes the exponential order to grow. At the same time, the degree shared the information resources is more and more high, bring great convenience in People’s Daily life. At present, people face a lot of information every day, how to extract valuable information from huge amounts of data that has become a hot topic in the research of information technology. Chinese synonym extraction is the foundation of Chinese information processing research, it plays a different role in different application fields. As synonym scattered in sea of information, it is to extract synonym as much as possible, the paper use the large-scale corpus as the research object. The continuous development of Internet technology and the explosive growth of information, Natural Language Processing and information retrival technology play more and more important role in deal with and extract information, synonym has important research significance and application value in all sorts of Natural Language Processing. According to this, the paper proposes two kinds of synonym methods , such as literal similarity and PageRank, Pointwise Mutural Information(PMI) and Latent Semantic Analysis(LSA). Based on Literal similarity and PageRank method, make full use of the literal similar characteristics and PageRank semantic relation. Both consider the matching sequence and compatibility of the two words and relationship. The combination method of PMI and LSA based on the principle of PMI and LSA theory. PMI use two word mutural information to estimate multiple words simply and effectively. LSA combines computer science, mathematics, the ideas of information science and technology and means to dig the potential meaning of vocabulary. According to the retrieval results of two words semantic association to achieve the goal. Synonym extraction method based on LSA starts with the mass matrix that word as