Informationextraction system design and its commercial use.doc

Information extraction system: design and its commercial use After more than 30 years of development of the Information Extraction?(IE) system, it comes to be the focus of the attention of the researchers of information retrieval, database system and natural language processing. The reason is very simple. Because the traditional information search engine can only give the result of relevant pieces of documents and information users must read them by themself to check if the documents match their requirements or not, but the IE system give the facts directly to the users. The pressure of the information explosion makes it impossible to read all the documents, news or Internet pages to locate their interested facts. But all the facts are important for the information users to make any decision. IE system can help them to archive the goal, which is to know all the things that happened in the domain which they are interesting. The Information Extraction system filters the great amounts of documents that were written in nature human language or formatted in semi-structured to get the useful description of the facts which are interested by the information users. The shallow parsing technology in sentence semantic analysis is the most popular method in the IE system. Most of IE systems use such technology to catch the information points in the text. Then, after post processing, such as co-reference analysis or repeated-facts clearing, all the filtered information points were put into slots of a well-structured template. All the filled templates combine the database which will be outputted. The output data can be read by human being or transfer to an automatic analysis program to process. During the research of the IE system, we know it is very important to have the enough technology backup. The ability of nature language processing, large-scale programming system development and some very serious knowledge base, such as syntactic and semantic dictionary and tree-bank corp