北野武(north.pptVIP

Using the Web for Automated Translation Extraction in Cross-Language Information Retrieval One of the major remaining reasons that CLIR does not perform as well as monolingual retrieval is the presence of out of vocabulary (OOV) terms. it will not be recognized, and segmented into either smaller sequences of characters or individual characters 北野武→(north limit military) Previous work has either relied on manual intervention or has only been partially successful in solving this problem. We propose a segmentation free method which can be applied to both Chinese-English and English-Chinese CLIR, correctly extracting translations of OOV terms from the Web automatically, and thus is a significant improvement on earlier work English translation extraction in Chinese-English CLIR Chinese OOV term detection 北野武(north limit military) → Pvalue given by the HMM will be very low if Pvalue Pmin → contains OOV terms web text extraction we extract strings that contain the Chinese query terms and some English text from the Web. collection of co-occurrence statistics, translation selection. Chinese translation extraction in English-Chinese CLIR Extraction of web text use Google to fetch the top100 Chinese documents with the English OOV term eoov as the query. Collection of co-occurrence statistics accumulate the frequency foov. considering all substrings in Sleft and Sright, and collecting the frequency fn and the length |sn| of each Chinese substring. Translation selection exclude any substring that already in the translation dictionary doesn’t occur in the document collection When translating from Chinese to English, a standard first step is to segment the text into words based on an existing segmentation dictionary. However where an OOV term occurs, it will not be recognized, and segmented into either smaller sequences of characters or individual characters. We propose a segmentation free method based on frequency and length analysis and corpus-based disambig