基于隐含语义分析的微博话题发现方法-计算机工程与应用.PDFVIP

96 2014 ，50（1） Computer Engineering and Applications 计算机工程与应用 ⦾数据库、数据挖掘、机器学习⦾ 基于隐含语义分析的微博话题发现方法 1 1 1，2 马雯雯 ，魏文晗 ，邓一贵 1 1 1，2 MA Wenwen , WEI Wenhan , DEGN Yigui 1.重庆大学 计算机学院，重庆 400044 2.重庆大学 信息与网络管理中心，重庆 400044 1.School of Computer Science, Chongqing University, Chongqing 400044, China 2.Center of Information and Network, Chongqing University, Chongqing 400044, China MA Wenwen, WEI Wenhan, DEGN Yigui. Micro-blog topic detection method based on Latent Semantic Analysis. Computer Engineering and Applications, 2014, 50 （1）：96-100. Abstract ：As the large popularity of micro-blog and awareness continues to improve, hot topic of micro-blog detecting has become the current research focuses. For short texts, there exist high-dimension, sparse, synonymy and polysemy problems for Vector Space Model （VSM ）text presentation, making it difficult to measure the similarity of the texts accu- rately. This paper presents a two-stage cluster based on Latent Semantic Analysis （LSA ）topic detection approach. Firstly, the concept of hot topic is introduced to select micro-blogs with certain attention, using LSA to model the dataset. Then CURE algorithm of hierarchical clustering is employed to determine the initial centers. Finally, the hot topic clustering results are obtained through K -means clustering. Experimental results on real micro-blog dataset verify the validity of the method. Key words ：Latent Semantic Analysis （LSA ）; Vector Space Model（VSM ）; topic detection; micro-blog; two-stage clustering 摘 要：随着微博的大量普及和关注度的不断提高，微博热点话题发现已成为当前研究热点。针对于短文本、向量 空间模型（VSM ）文本表示方法存在高维度、稀疏，以及同义多义问题，导致难以准确度量文本相似度，提出一种基于 隐含语义分析的两阶段聚类话题发现方法。引入话题热度的概念来选取具有一定关注度的微博文本，用隐含语义 分析（LSA ）对数据集进行建模；用层次聚类的CURE 算法确定初始类中心；用K -means 聚类得到热点话题的聚类结 果。真实微博数据集的实验结果验证了该方法的有效性。 关键词：隐含语义分析；向量空间模型；话题发现；微博；两阶段聚类 文献标志码：A 中图分类号：TP393 doi ：10.3778/j.issn. 1002-8331.1203-0250 1