语料的标注及句法结构的提取.pptVIP

语料的标注与句法结构的提取 王金铨 bfsuwjq@ Part I 语料的标注 Part II 句法结构提取 Part I 语料的标注 1. What is annotation? 2. How to do it? Annotation of corpora Annotation: The process of making explicit linguistic categories implicit within a corpus text, for example, by adding layers of information on the grammatical classes of words, or on the classes of speech acts which have taken place in the course of the transcribed speech, or the classes of errors learners made in writing. (Edwards 1995 : 20). A. Part-of-speech tagging B. Syntactic annotation C. Semantic annotation D. Discourse annotation E. Pragmatic annotation POS-Tagging - also known as grammatical tagging - divides words into categories, based on how they can be combined to form sentences - most common used form of corpus annotation Nowadays RT , , it PPH1 is VBZ fashionable JJ to TO speak VVI of IO a AT1 generation NN1 gap NN1 . . /ssThe AT parents NN2 complain VV0 that CST children NN2 are VBR self-centered JJ and CC do VD0 not XX show VVI them PPHO2 proper JJ respect NN1 and CC obedience NN1 , , while CS children NN2 are VBR complaining VVG that CST parents NN2 do VD0 not XX understand VVI them PPHO2 . . /ssHow RRQ does VDZ the AT generation NN1 gap NN1 form NN1 ? How to do it? manually computer-assisted fully automatic computer-assisted annotation Annotool Fully automatic annotation CLAWS Constituent Likelihood Automatic Word-tagging System developed by UCREL (University Centre for Computer Corpus Research on Language) at Lancaster POS-tagger for English exists since early 1980‘s has several tagsets Tagset variation Category Example CLAWS5 Adverb often AV0 Adverb, negative not XX0 Adverb, comparative faster AV0 Adverb, superlative fastest AV0 Adverb, particle up AVP Adverb, deictic here AV0 Adverb, intensifier very AV0 Adv, intensifier, postposed enough AV0 Adverb, question when AVQ Adv, question, intensifier how AVQ Fully automatic annotatio