Delta-encoding与相似检测应用说明【外文翻译】.docVIP

本科毕业论文（设计）外文翻译 外文原文 Application-specific Delta-encoding via Resemblance Detection Fred Douglis IBM T.J.Watson Research Center Hawthorne， NY 10532douglis@acm.Org Arun Iyengar IBM T.?J.Watson Research Center Hawthorne， NY 10532aruni@ Abstract　 Many objects， such as files， electronic messages， and web pages， contain overlapping content. Numerous past research projects have observed that one can compress one object relative to another one by computing the differences between the two， but these delta-encoding systems have almost invariably required knowledge of a specific relationship between them. Most commonly， two versions us the same name at different points in time. We consider cases in which this relationship is determined dynamically，when a sufficient resemblance exists between two objects in a relatively large collection. We look at specific examples of this technique， namely web pages， email， and files in a file system， and evaluate the potential data reduction and the factors that influence this reduction. We find that delta-encoding using this resemblance detection technique can improve simple compression by up to a factor of two， depending on workload， and a small fraction of objects can potentially account for a large portion of these savings. Key words　 delta-encoding; Resemblance Detection Introduction Delta-encoding is the act of compressing a data object， such as a file or web page， relative to another object. Usually there is a temporal relationship between the two objects: the latter object exists， and when it is subsequently modified， the changes can be represented in a small fraction of the size of the entire object. There is often also a naming relationship between the objects， since a modified file can have the same name as the original copy. In these cases， identifying the base version against the one which to compute a delta is straightforward. Delta-encoding is particularly attractive for the situations where information is spreading through