基于信息论潜在概念获取与文本聚类.pdfVIP

ISSN 1000-9825, CODEN RUXUEW E-mail: jos@ Journal of Software , Vol.19, No.9, September 2008, pp.2276−2284 DOI: 10.3724/SP.J.1001.2008.02276 Tel/Fax: +86-10 © 2008 by Journal of Software . All rights reserved. ∗ 基于信息论的潜在概念获取与文本聚类 1+ 2 2 2 李晓光 , 于 戈 , 王大玲 , 鲍玉斌 1(辽宁大学 信息学院,辽宁 沈阳 110036) 2(东北大学 信息科学与工程学院,辽宁 沈阳 110004) * Latent Concept Extraction and Text Clustering Based on Information Theory 1+ 2 2 2 LI Xiao-Guang , YU Ge , WANG Da-Ling , BAO Yu-Bin 1(Department of Information, Liaoning University, Shenyang 110036, China) 2(Department of Information Science and Engineering, Northeastern University, Shenyang 110004, China) + Corresponding author: E-mail: xgli@ Li XG, Yu G, Wang DL, Bao YB. Latent concept extraction and text clustering based on information theory. Journal of Software, 2008,19(9):2276−2284. /1000-9825/19/2276.htm Abstract : To emphasize the fuzzy relation among words, latent concepts, text and topics, an information theory based approach to latent concept extraction and text clustering is proposed. Latent concept variable and topic variable are introduced to reveal such relation, and a global objective function is defined in the theme of rate-distortion theory. An anneal-like algorithm is designed to extract the hierarchical tree of latent concept, and to group the texts under corresponding concept hierarchy at the same time. Furthermore, it determines the number of concept and text clustering result with a concept selection method based on