基于递归神经网络的生物医学命名实体识别-计算机应用技术专业论文.docxVIP

大连理工大学硕士学位论文Named 大连理工大学硕士学位论文 Named Entities Recognition based on Recurrent Neural Network in Biomedical Literatures Abstract In bio—medical field，recognizing different types of entities is the first step in a number of information extraction tasks SUch as relation extraction，text classification，coreference resolution and event extraction．For the current existing methods，rich domain expert knowledge and amount of artificial features are rather important in the system construction．In this paper，pre-trained word embeddings and recurrent neural networks are mainly adopted to fulfill simple and effective named entities recognition system with a series of extensions and improvements．The performance and generalization on different corpus have been greatly improved． First，based on the conventional Recurrent Neural Network(RNN)，both hidden layer and output layer are added with recurrent connection．Thus．the hidden layer Can maintain and record the historical information and the output layer Can take advantage of probabilistic inf01Tnation from previous state．Besides．in order to solve the problem of incomplete information caused by subsequence division，brown clustering algorithm and Latent Dirichlet Allocation(LDA)are adopted to provide a contextual vector in associate with each word to model wider range of semantic information．Then two unidirectional I洲S with different directions are combined for bio．medical named entities recognition．And the F．score achieve 83．62％on the Biocreative II GM corpus． Second，to further improve the performance of named entity recognition and overcome vanishing gradient problem of conventional I心N when dealing with long sentence，Long Short—Term Memory(LSTM)is applied to the recurrent neural network．Then bidirectional recurrent neural network with LSTM unit iS built．Considering fine．tuning process of word embedding Can lead to change of pre-training word embedding which contains rich syntactic and semantics information，this paper use two different