Similarity Searching in High Dimensions viaHashing.pptVIP

Similarity Searching in High Dimensions viaHashing Paper by: Aristides Gionis, Poitr Indyk, Rajeev Motwani The approach of using the similarity searching is to be used only in high dimensions. The reason, or the idea behind the approach is that since the selection of features and the choice of distance is rather heuristic, determining an appropriate nearest neighbor should suffice for most practical purposes. The basic idea is to hash the points from the database so as to ascertain that the probability of collision is much higher for objects that are close to each other than for those that are far apart. The necessity arose from the so called ‘curse of dimensionality’ fact for the large databases. In this case all the searching techniques reduce to linear search, if are being searched for the appropriate answer. The similarity search problem involves the nearest ( most similar ) object in a given collection of objects to a given query. Typically the objects of interest are represented as points in ?d and a distance metric is used to measure the similarity of the objects. The basic problem is to perform indexing or similarity searching for query objects. The problem arises due to the fact that the present methods are not entirely satisfactory, for large d. And is based on the idea that for most applications it is not necessary for the exact answer. It also provides the user with a time-quality trade-off. The above statements are based on the assumption that the searching for approximate answers is faster than for finding the exact answers. The technique is to use locality-sensitive hashing instead of space sensitive hashing. The idea is to hash points points using several hash functions so as to ensure that, for each function the probability of collision is much higher for objects that are close to each other. Then, one can determine near neighbors by hashing the query point and retrieving elements stored in buckets containing that point. The LSH ( locality sensiti