双语平行网页挖掘系统的设计与实现-计算机工程.PDF

35 14 2009 7 Vol.35 No.14 Computer Engineering July 2009 ·· 2009 A TP312 ( 210089) Design and Implementation of Bilingual Parallel Web Page Mining System CHEN Wei, HUANG Lei, LIU Feng, ZHAO Zhi-hong (Institute of Software, Nanjing University, Nanjing 210089) AbstractAiming at bilingual corpora is critical resources for developing statistical machine translation system, this paper presents a method which automatically mines bilingual parallel Web page form Web. Different from mining data from pre-specified Web sites, the system is developed to mine parallel Web page from the entire Web, it is greatly suitable for new content domains and language pairs. It implements a parallel Web page mining system. Experimental results show that the system can provide large scale and high quality parallel Web page for statistical machine translation. Key wordsnatural language processing; statistical machine translation; bilingual corpora; Web mining 1 [1-2] [3] [4] Hansard Corpus( ) 1 2.1 2 (1) Google, Yaho