基于LIBSVM就是句句间关系判别方法.docVIP

基于LIBSVM就是句句间关系判别方法 　　摘要：针对使用规则和机器学习方法判别句间关系时出现因机器学习多次迭代而导致规则权值削弱现象，进而导致判别正确率偏低的问题，提出了在规则和机器学习相结合过程中对导入的明显规则特征进行加强处理的方法。首先，抽取依存词汇、语义、句子结构等具有明显规则的特有特征；然后，基于一些句间关系指示词提取普适的特征；其次，将特征写入待输入的数据向量，并且增加一维向量用来存储出现的明显规则特征；最后，运用LIBSVM模型结合规则和机器学习进行实验。实验结果表明，加强后的实验正确率较之加强前平均提高了两个百分点，各句间关系准确率、召回率、F1值整体上都取得了较好的结果，平均值达到了82.02%、88.95%、84.76%。实验思路和方法对研究句子间联系紧密度具有重要价值。 　　关键词：句间关系；LIBSVM；机器学习；kappa值；依存词汇 　　中图分类号： TP399； TP181 文献标志码：A 　　Abstract： Aiming at the low accuracy caused by the phenomenon of rule weight weakening from iterations of machine learning when judging the sentence relationships by applying rules and machine learning methods， the method of strengthening the imported obvious rule characteristics in the process of combining rules and machine learning was proposed. Firstly， these specific characteristics that having obvious rules such as dependency vocabulary， syntax and semantics information were extracted； secondly， universal characteristics were extracted based on these words that could indicate relationships； then， the characteristics were written into the data vector that to be input， and another dimensional vector was added to store the obvious rule characteristics； Finally， rules and machine learning methods were combined with LIBSVM model to perform the experiment. The experimental results show that the accuracy rate is averagely 2% higher than that before strengthening the characteristics， and all kinds of relationships accurate rate， recall rate and F1 value show good results as a whole， their average values achieved 82.02%， 88.95% and 84.76%. The experimental ideas and methods are important for studying the compactness of adjacent sentences. 　　Key words： relationship between sentences； LIBSVM； machine learning； kappa value； dependency vocabulary 　　0 引言 　　近年来，随着自然语言处理技术迅速发展，篇章分析[1]、信息检索、自动问答等在内的研究都有了较大的提高，但发展的同时也面临着瓶颈，即语言的语义理解，传统语言学中对于句群层面的一些抽象定义无法满足计算机处理的需要。要想在自然语言处理技术上取得进一步的突破，必须要在语义理解、句群层面上提供相关的理论和技术支持。对于信息检索、机器翻译等的研究来说，理想的模型也应该是建立在段落或者句群层面上，因为句子本身所能承载