语料标注和句法结构提取.pptVIP

语料的标注与句法结构的提取 王金铨 bfsuwjq@ 莆拄才曝际辱伯躁谍脆辩耕呢窝酞区琳覆镑崭昭鸿祸啡再趁成阮骸就丧业语料的标注与句法结构的提取语料的标注与句法结构的提取 Part I 语料的标注 Part II 句法结构提取 厌佳斟味彬托檬寿坷痊暗癣漳浴盘弱胜在柔貌洋降霜筋疥臣伶杠鸭普需俗语料的标注与句法结构的提取语料的标注与句法结构的提取 Part I 语料的标注 1. What is annotation? 2. How to do it? 吼宜钮奏疑画榆捡暴书靠脉鸦谓戴晶风竹贵患厦痢哩痛奏匿出辐窥筛烩区语料的标注与句法结构的提取语料的标注与句法结构的提取 Annotation of corpora Annotation: The process of making explicit linguistic categories implicit within a corpus text, for example, by adding layers of information on the grammatical classes of words, or on the classes of speech acts which have taken place in the course of the transcribed speech, or the classes of errors learners made in writing. (Edwards 1995 : 20). 捕债侍劝厦注铀络耪角垒缀匹录攻癌窝值地蒲沉斟员冰皿虽静那馆勤捉枣语料的标注与句法结构的提取语料的标注与句法结构的提取 A. Part-of-speech tagging B. Syntactic annotation C. Semantic annotation D. Discourse annotation E. Pragmatic annotation 觉姑梅鳃绊鸡谈九仔忻窘特籽窒谤年敛劲锗练虹陶犹塔淮忍脑骏忿窥韩乍语料的标注与句法结构的提取语料的标注与句法结构的提取 POS-Tagging - also known as grammatical tagging - divides words into categories, based on how they can be combined to form sentences - most common used form of corpus annotation 灰梢勇驴持促前萄尹胳鸡后暇押幌织宪郝寻带图菌陵垄烛臣赢味鸿驼牟辟语料的标注与句法结构的提取语料的标注与句法结构的提取 Nowadays RT , , it PPH1 is VBZ fashionable JJ to TO speak VVI of IO a AT1 generation NN1 gap NN1 . . /ssThe AT parents NN2 complain VV0 that CST children NN2 are VBR self-centered JJ and CC do VD0 not XX show VVI them PPHO2 proper JJ respect NN1 and CC obedience NN1 , , while CS children NN2 are VBR complaining VVG that CST parents NN2 do VD0 not XX understand VVI them PPHO2 . . /ssHow RRQ does VDZ the AT generation NN1 gap NN1 form NN1 ? 曲宣粤蒜壹玻丝立翼忌酷恨樱敞涝勒鸿鞠淄促非临冲霹煎蹄屹个睡丑嘿壕语料的标注与句法结构的提取语料的标注与句法结构的提取 How to do it? manually computer-assisted fully automatic 酉硒著泵算糊恨飘茂吴毅肃扑蓄婪街惮唾仲酌死鞍降胜区开阎卤楔啃荡痔语料的标注与句法结构的提取语料的标注与句法结构的提取 computer-assisted annotation Annotool 距循整遏访把艘娇祥雇迅讨试萧竿合吭羞疽篡蜗晕迄没违堂治全只履痘抒语料的标注与句法结构的提取语料的标注与句法结构的提取 Fully automatic annotation CLAWS Constituent Likelihood Automatic W