Semantic classification of Chinese unknown words.ppt

Semantic classification of Chinese unknown words Huihsin Tseng LinguisticsUniversity of Colorado at Boulder Introduction The biggest problem :Incompleteness of Dictionaries For the Sinica Corpus, articles contain on average 3.51% words that were not listed in the Chinese Electronic Dictionary (1998) Unknown words makes NLP tasks difficultEx: Segmentation,  Word Sense Disambiguation Introduction (cont.) The Caraballo (1999)’s system Adopt the contextual information to assign nouns to their hyponyms. Roark and Charniak (1998) Use the co-occurrence of words as features to classify nouns. → Context is clearly an important feature Introduction (cont.) This paper focuses on non-contextual features Follow Ciaramita (2002), is morphological similarity to words whose semantic category is known. Introduction (cont.) 2 ways to generate new Chinese words: CompoundingA compound is a word made up of other words. （Ex: 光幻覺） AffixationA word is formed by affixation when a stem is combined with a prefix or a suffix morpheme. （Ex: 科學家） Introduction (cont.) The CiLin thesaurus 《同義詞詞林》CiLin (Mei et al 1986) The CiLin thesaurus (cont.) Corpus analysis of Chinese unknown words Unknown words are the Sinica Corpus lexicons that are not listed in the Chinese Electronic Dictionary of 80,000 lexicons and the CiLin. The focus of most other Chinese unknown word research is on identification of proper nouns, but the majority of unknown words in Chinese are lexical words. Corpus analysis of Chinese unknown words (cont.) Corpus analysis of Chinese unknown words (cont.) CompoundsChinese compounds are made up of words that are linked together by morpho-syntactic relations such as modifier-head, verb-object, and so on. AffixationChinese affix is a much weaker cue to the semantic category of the word than English -ist or -ian, because it is more ambiguous. （Ex. 家：expert / family and home / house） Semantic classification BaselineAssign the semantic category of the morphological head t