A study on automatically extracted keywords in text.pptVIP

A study on automatically extracted keywords in text categorization Authors:Anette Hulth and Be′ata B. Megyesi From:ACL 2006 Reporter:陳永祥 Date:2007/10/16 Introduction If and how automatically extracted keywords can be used to improve text categorization The full-text representation is combined with the automatically extracted keywords Measure performance by micro-averaged F-measure on a standard text categorization collection Definition Automatic text categorization the task of assigning any of a set of predefined categories to a document the documents must be represented in a form that is understandable to the learning algorithm A keyword may consist of one or several tokens. In addition, a keyword may well be a whole expression or phrase such as snakes and ladders Major decisions for text categorization In order to perform a text categorization task, there are two major decisions to make: how to represent the text what features to select as input which type of value to assign to these features what learning algorithm to use to create the prediction model Related work A number of experiments have been performed in which richer representations have been evaluated compare unigrams and bigrams add complex nominals to bag-of-words representation automatically extracted sentences constitute the input to the representation Investigate of this research Keywords have been automatically extracted and are used as input to the learning Both on their own and in combination with a full-text representation Selecting the Keywords Method developed by Hulth (2003; 2004), was chosen it is tuned for short texts (more specifically for scientific journal abstracts) Supervised machine learning Prediction models were trained on manually annotated data Selecting the Keywords Candidate terms are selected from the document in three different manners statistically oriented extracts all uni-, bi-, and trigrams from a document linguistic oriented utilizing the words’