Web事务聚类分析的研究与实现论文.doc

PAGE 9 MACROBUTTON MTEditEquationSection2 SEQ MTEqn \r \h \* MERGEFORMAT SEQ MTSec \r 1 \h \* MERGEFORMAT SEQ MTChap \r 3 \h \* MERGEFORMAT Web事务聚类分析的研究与实现 Research and Implementation of Web 摘要 本文系统、完整地论述了Web事务聚类分析的两个阶段，即数据预处理和聚类分析阶段。其中数据预处理阶段又包括日志解析、数据清洗、用户识别和事务识别四个过程；同时，论文在此阶段引入了“概念URL”，以获得容易理解的聚类结果。在聚类分析阶段，本文结合蚁群优化的原理，建立了人工蚂蚁模型，并基于该模型实现了蚁群聚类分析算法。另外，本文还在聚类分析过程中使用了K均值算法，并比较了蚁群算法和K均值算法在Web事务聚类分析上的优劣。采用北京电子科技学院Web服务器（）日志作为数据集的试验表明，本文的技术和方法能够获得质量良好的聚类结果。 【关键词】Web事务 聚类分析 概念URL K均值 蚁群算法 Abstract This paper discusses the two phases, which are data preprocessing and clustering analysis, in Web transactions clustering analysis in a systematic and complete view. The data preprocessing phase also contains the procedures of log file interpretation, data washing, user identification and transaction identification; at the same time, in order to gain an easily interpreted result, the paper introduces the “Concept URL” in this phase. In clustering phase, a model of artificial ant is set up. Based on this model, the paper implements an ant-colony clustering algorithm. What’s more, k-means algorithm is also implemented in clustering analysis phase, the result is compared with that of ant colony algorithm. Experiment results are presented on web logs of to illustrate the techniques and methods. The quality of results is good. 【Keywords】Web Transaction; Clustering Analysis; Concept URL; k-means; Ant Colony Algorithm 目录 TOC \o 1-2 \h \z \u HYPERLINK \l _Toc199735741 1 绪论 PAGEREF _Toc199735741 \h 4 HYPERLINK \l _Toc199735742 1.1 问题的提出 PAGEREF _Toc199735742 \h 4 HYPERLINK \l _Toc199735743 1.2 数据挖掘 PAGEREF _Toc199735743 \h 4 HYPERLINK \l _Toc199735744 1.3 聚类分析 PAGEREF _Toc199735744 \h 6 HYPERLINK \l _Toc199735745 1.4 Web挖掘和Web事务聚类分析 PAGEREF _Toc199735745 \h 6 HYPERLINK \l _Toc199735746 2 Web事务聚类分析系统的总体设计 PAGEREF _Toc199735746 \h 8 HYPERLINK \l _Toc199735747 2.1 开发目标 PAGEREF _Toc199735747 \h 8 HYPERLINK \l _Toc199735748 2.2 挖掘数据源 PAGEREF _Toc199735748 \h 8 HYPER