面向互联网的计算语言学研究.pdfVIP

第1 卷 第1 期 智能计算机与应用 Vol． 1 No． 1 2011 年6 月 INTELLIGENT COMPUTER AND APPLICATIONS Jun． 2011 面向互联网的计算语言学研究 王海峰, 赵世奇 (百度公司, 北京 100085) 摘 要：近年来，计算语言学（Computational Linguistics: CL ）在学术界和工业界均得到了越来越多的关注，这主要得益于其在互联网领域 越来越广泛的应用，如搜索引擎、在线翻译系统、社交网络等。计算语言学的很多技术在互联网应用中都能找到用武之地。 这其中既包括词法、 句法、语义等基础技术，也包括问答、翻译、文摘等应用技术。 面对海量、高噪声的互联网数据及真实互联网应用需求，计算语言学技术也需要 进行调整与改进。 本文将主要讨论在互联网大背景下的计算语言学研究，包括新应用、新资源、新挑战，以及新方法等。 计算语言学 互联网 关键词： ; 中图分类号：TP393．01 文献标识码：A 文章编号：2095－2163 （2011）01－0008－06 Computational Linguistics for Web WANG Haifeng ，ZHAO Shiqi (Baidu Inc． , Beijing 100085, China) Abstract: Computational Linguistics (CL) has attracted more and more interest in both academic and industry communities in recent years, since it plays an essential role in many Internet applications, including search engines, online translation systems, social networks, and so forth. Almost all CL techniques, ranging from morphological, syntactic, and semantic analysis of texts, to question answering, machine translation, summarization, and oth- er complex techniques, can find their scopes in the Internet applications. However, conventional methodologies in CL research need to be adapted and improved, so as to deal with new challenges arising from the new application requirements as well as the large-scale and highly noisy web corpora. This paper discusses the CL research in the background of Internet, including the new applications, resources, challenges and methodologies. Key words: Computational Linguistics; Web 0 引言 用了计算语言学技术。计算语言学技术在这一领域的应用 计算语言学（Computational Linguistics: CL）是语言学 可以概括