基于特征选择和最大熵模型汉语词义消歧.pdfVIP

ISSN 1000-9825, CODEN RUXUEW E-mail: jos@ Journal of Software , Vol.21, No.6, June 2010, pp.1287− 1295 doi: 10.3724/SP.J.1001.2010.03591 Tel/Fax: +86-10 © by Institute of Software , the Chinese Academy of Sciences . All rights reserved. ∗ 1,2 1,2+ , 1( , 100871) 2( , 100871) Chinese Word Sense Disambiguation Based on Maximum Entropy Model with Feature Selection HE Jing-Zhou1,2, WANG Hou-Feng1,2+ 1(Institute of Computational Linguistics, School of Electronic Engineering and Computer Science, Peking University, Beijing 100871, China) 2(Key Laboratory of Computational Linguistics (Ministry of Education), Peking University, Beijing 100871, China) + Corresponding author: E-mail: wanghf@ He JZ, Wang HF. Chinese word sense disambiguation based on maximum entropy model with feature selection. Journal of Software, 2010,21(6):1287−1295. /1000-9825/3591.htm Abstract : Word sense disambiguation (WSD) can be thought as a classification problem. Feature selection is of great importance in such a task. In general, features are selected manually, which requires a deep understanding of the task itself and the employed classification model. In this paper, the effect of feature template on Chinese WSD is studied, and an automatic feature selection algorithm based on maximum entropy model (MEM) is proposed, including uniform feature template selection for all ambiguous words and customized feature template selection for each word. Experimental result shows that automatic feature selection can reduce feature size and improve Chinese WSD performance. Compared with the best evaluation results