TML一种通用高效的文本挖掘语言.pdfVIP

计算机研 究 与发展 DOI：10．7544／issn1OOO1239．2015．2013l546 JournalofComputerResearchandDevelopment 52(3)：553-56O，2015 {l五 吉 TML：一种通用高效的文本挖掘q=：lF 李佳静 李晓明。孟 涛 (中国矿业大学(北京)机 电与信息工程学院 北京 l00083) 。(南京网感至察信息科技有限公司 南京 210014) 。(北京大学信息科学技术学院 北京 100871) (1ijiajing@tmlsystem．corn) TM L：A GeneralHigh-PerformanceTextM iningLanguage LiJiajing～，IiXiaoming。。andMengTao (SchoolofMechanicalElectronicand InformationEngineering，ChinaUniversityofM ining Technology (Beijing)， Beijing100083) (NanjingWangganzhichaInformationTechnologyLtd，Nanjing 。(SchoolofElectronicsEngineeringandComputerScience，PekingUniversity，Beijing100871) Abstract Thispaperproposesageneral—purposeprogramm inglanguagenamedTML fortextm ining． TM L istheabbreviation of “textmining language”．anditaimsatturning complicatedtextm ining tasksintoeasyjobs．TheimplementationofTML includesacompiler，aruntimevirtualmachine (interpreter)，and an IDE． TML has supplied mostusualtextmining techniques。which are implementedasgrammarsandreservedwords．UserscanuseTM L toprogram ，andthecodewillbe compiledintobytecodes，whichwillbenextinterpretedin thevirualruntimemachine．TML hasthe followingcharacteristics：1)Itsuppliesaformalwaytomodelthesearchingarea。objectdefinition andminingmethodsoftextminingjobs，SOuserscanprogram with ittomakeadeclarativetext miningeasily；2)TheTM L runtimemachineimplementsUSUaltextminingtechniques，andorganizes them intoan efficienttextanalysispipeline；3)TheTM L compilerfullyexploresthepossibility of concurrently executing its byte codes，and the execution has good performance on very large collectionsofdocumentsanduserwrittenrules．TML hasbeenusedinseverallarge—scaleonlinedata analysis applications， including commodity purchase intention analysis， fine—grained reputation analysisofbrandsandproducts，andlegaldocumentanalysis． Keyword