面向相似数据的无损压缩技术-OpenRepositoryofNationalNatural.PDFVIP

ISSN 1673-9418 CODEN JKYTA8 E-mail: fcst@ Journal of Frontiers of Computer Science and Technology 1673-9418/2010/04(08)-0700-12 Tel: +86-10 DOI: 10.3778/j.issn.1673-9418.2010.08.004 * + , , , 110819 * A Lossless Compression Technique for Similar Data + ZHAO Guoyi, YANG Xiaochun , WANG Bin College of Information Science and Engineering, Northeastern University, Shenyang 110819, China + Corresponding author: E-mail: yangxc@ ZHAO Guoyi, YANG Xiaochun, WANG Bin. A lossless compression technique for similar data. Journal of Frontiers of Computer Science and Technology, 2010, 4(8): 700-711. Abstract: As to tremendous similarity data in network information, observation data and biological information, using traditional compression methods cannot get better compression effect. A new lossless compression is proposed using base sequence and a group of variants with edit distance to express the whole dataset. Because real similar data have an overall similarity, a first clustering and then compressing method is presented. In each cluster, construct a virtual base sequence to make a largest compression ratio. A large number of experimental tests and analysis on real datasets show that the proposed lossless compression technique can achieve good compression ratio. Key words: lossless compression; variant expression; edit distance; cluster; base sequence , , ,