基于改进词向量模型的深度学习文本主题分类.pdf

Computer Science and Application 计算机科学与应用, 2016, 6(11), 629-637 Published Online November 2016 in Hans. /journal/csa /10.12677/csa.2016.611077 Deep Learning on Improved Word Embedding Model for Topic Classification Yingying Zhou, Lei Fan School of Information Security Engineering, Shanghai Jiao Tong University, Shanghai th th th Received: Oct. 18 , 2016; accepted: Nov. 6 , 2016; published: Nov. 9 , 2016 Copyright © 2016 by authors and Hans Publishers Inc. This work is licensed under the Creative Commons Attribution International License (CC BY). /licenses/by/4.0/ Open Access Abstract Topic classification has wide applications in content searching and information filtering. It can be divided into two core parts: text embedding and classification modeling. In recent years, methods have brought out significant results using distributed word embedding as input and convolutional neural network (CNN) as classifiers. This paper discusses the impact of different word embedding for CNN classifiers, proposes topic2vec, a new word embedding specifically suitable for Chinese corpora, and conducts an experiment on Zhihu, a representative content-oriented internet com- munity. The experiment turns out that CNN with topic2vec gains an accuracy of 98.06% for long content texts, 93.27% for short title texts and an improvement comparing with other word em- bedding models. Keywords Topic Classification, Deep Learning, Convolutional Neural Network, Word Embedding 基于改进词向量模型的深度学习文本主题分类 周盈盈，范 磊 上海交通大学信息安全工程学院，上海 收稿日期：2016年10月18 日；录用日期：2016年11月6 日；发布日期：2016年11月9 日 文章引用: 周盈盈, 范磊. 基于改进词向量模型的深度学习文本主题分类[J]. 计算机科学与应用,