基于贝叶斯分类算法的中文垃圾邮件过滤技术的研究-计算机应用技术专业论文.docxVIP

The The Research of Chinese Spam Filtering Technology Based on Na¨ve Bayes Classification Algorithm AB STRACT With the rapid popularization of computer and the development of the Imernet, Email service has become the most popular communication tool to most computer users．But the occurrence of Junk Email not only seriously disturbs and impacts the normal use of mail system，but also impedes the filrther development of Interact． At the beginning，this dissertation analyzes the defects of current email system and the reason of Junk email flooding；narrates current spam situation and the related measures and technology used to fight against spare；compares various spam filter algorithms，especially analyzes the one based on Narve Bayesian． This dissertation studies the general framework of spam filter,analyzes the differences of spam classifier be附een on English mails and Chinses mails；introduces the N—gram algorithm to resolve Chinese character segment processing．There still a陀 some defects and limitations about the mail classifier based on Naive Bayes algorithm, such as the limitation of independent assumption ere，this dissertation proposes some ideas to improve the Naive Bayes algorithm．Based Oil a deep investigation on the spam corpus，this dissertation proposes a 2-layer classification structure basod on mail length．In this dissertation,a Chinese mail classifier based on the improved Nafve Bayes algorithm is designed and some experiments is made to verify it． In the end，this dissertation also proposes a 2-layer filtering structure which combinates the rule based technique and the statistic based technique，and realizes the prototype of this structure．The related experiments show that this structure can embody the user’s preference． Keywords：Spare filtering；text classification；Naive Bayesian： 图表清单图2．1邮件传输过程图 图表清单 图2．1邮件传输过程图 6 图2．2邮件中继过程示意图 7 图2。3基于统计的自动文本分类模型图 12 图3．1朴素贝叶斯模型 15 图3．2 TAN网络模型 15 图3．3 BAN网络模型 16 图3．4 GBN网络模型 16 图3．5多变量伯努利事件模型的邮件分类示意图 17 图3．6多项式模型的邮件分类示意图 18