基于大间隔方法的汉语组块分析-软件学报.pdfVIP

ISSN 1000-9825, CODEN RUXUEW E-mail: jos@ Journal of Software , Vol.20, No.4, April 2009, pp.870−877 doi: 10.3724/SP.J.1001.2009.03233 Tel/Fax: +86-10 © by Institute of Software , the Chinese Academy of Sciences . All rights reserved. ∗ 基于大间隔方法的汉语组块分析 1,2+ 1 1 2 周俊生 , 戴新宇 , 陈家骏 , 曲维光 1(南京大学 计算机软件新技术国家重点实验室,江苏 南京 210093) 2(南京师范大学 计算机科学系,江苏 南京 210097) Chinese Chunking with Large Margin Method 1,2+ 1 1 2 ZHOU Jun-Sheng , DAI Xin-Yu , CHEN Jia-Jun , QU Wei-Guang 1(State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing 210093, China) 2(Department of Computer Science, Nanjing Normal University, Nanjing 210097, China) + Corresponding author: E-mail: zhoujs@, http :// Zhou JS, Dai XY, Chen JJ, Qu WG. Chinese chunking with large margin method. Journal of Software, 2009, 20(4):870−877. /1000-9825/3233.htm Abstract : Chinese chunking plays an important role in natural language processing. This paper presents a large margin method for Chinese chunking based on structural SVMs (support vector machines). First, a sequence labeling model and the formulation of the learning problem are introduced for Chinese chunking problem, and then the cutting plane algorithm is applied to efficiently approximate the optimal solution of the optimization problem. Finally, an improved F 1 loss function is proposed to tackle Chinese chunking. The loss function can scale the F 1 loss value to the length of the sentence to adjust the margin accordingly, leading to more effective