汉语语料库词性标注自动校对方法研究-计算机与信息技术学院-山西.pdfVIP

第25卷第1期 计算机应用 Vo1．25 No．1 2005年1月 Computer Applications Jan．2oo5 文章编号：1001—9081(2005)O1—0017一O3 汉语语料库词性标注自动校对方法研究 张 虎，郑家恒，刘 江 (山西大学计算机与信息技术学院，山西太原030006) (four—tiger@sina．corn，cn) 摘 要：从聚类和分类的角度入手，对大规模语料库中的词性标注的自动校对问题作了分析，提 出了语料库词性标注正确性检查和自动校对的新方法。该方法利用聚类和分类的思想，对范例进行 聚类并求出阈值，根据阈值，判定词性标注的正误；对标注错误的词性，按靠近各词性类别重心的原则 归类，给出一个校对词性，进而提高汉语语料库词性标注的准确率。 关键词：聚类；词性标注；自动校对 中图分类号：TP391 文献标识码：A Study on auto-proofreading method for POS tagging of Chinese corpus ZHANG Hu，ZHENG Jia—heng，LIU Jiang rCollege of ComputerInformation Technolog)，Shanxi University,Tai)Tzan Shanxi 030006．China) Abstract：The auto—proofreading problem in the large—scale COrpUS was analyzed ， and a new method inspecting the correctness of POS tagging and an auto—proofreading method based on clustering and classifying were put forward ． Using clustering and classifying，the method firstly classified the sequences of part of speech of the example and got the threshold value．Then according t0 the threshold value，it classified the test sequences to judge its correctness，and gave out a proofreading POS to the wrong POS Tagging．Furthermore，it enhanced the correctness ratio of the part of speech tagging on large—scale corpus． Key words：clustering；POS Tagging；auto—proofreading 确性检查的有效性约为76％，准确率约为83％．自动校对的 0 引言 准确率约为70％，对词性标注的准确率可以提高2～3个百 随着语料库语言学研究的兴起，建设高质量的大规模语 分点。 料库已成为首要任务。语料库作为研究资源其价值是通过对