汉语词法分析平台的构建-计算机技术专业论文.docxVIP

汉语词法分析平台的构建The 汉语词法分析平台的构建 The construction of Chinese lexical analysis platform Abstract With the rapid development of modern information technology，the number of computers and the amount of information in the Intemet are both increasing rapidly．Computer technology has been closely related to people’S daily life．NLP(natural language processing)is an important research topic in the field of Computer Science，its research obj ect is people’S natural language．Through the research and processing on natural language，realize the normal communication and mutual understanding between natural language and computers． Lexical analysis is an important problem in the field of Machine Translation．Most of problems about Machine Translation are needed to do lexical analysis．At present，most of the research and implementation of lexical analysis are confined to the experimental level，but the Internet environment of mobile office and resource sharing determines that the usefulness of an online platform has more practical significance．Some practical lexical analysis platform have appeared in the Internet which can achieve the function of segmentation and part of speech tagging．However，due to the source code can not be modified and part of speech tagging set，it is unable to get support about future research work． Based on the research about word segmentation and part of speech tagging in the laboratory，this paper develops a platform on lexical analysis．This platform adds the module on the artificial intervention，the user can modify the segmentation results．The platform will start the thread periodically to scan the results modified and find the results contain the new words to expand the new dictionary．For each user，you can also apply a temporary dictionary and add the new words you need to the temporary dictionary to correct the results temporarily．Users can choose the original method of word segmentation when we submit a task．We can also use the new word dictionary and temporary dicti