Final Report of Implementing Large Scale Image Annotation精选.doc

Final Report of Implementing the Efficient Large-Scale Image Annotation by Probabilistic Collaborative Multi-Label Propagation 0. Introduction Our implementation includes three major parts: 1. A gradient histogram calculation that marks the feature of an image. 2. A local-sensitive hashing algorithm that maps similar images into same buckets. 3. A l1-norm optimization algorithm that calculate the weighted edge of a KNN graph. 4. A series of optimization that calculates the probability of a tag belongs to an untagged image. 1. A gradient histogram calculation that marks the feature of an image. In this section we found some papers and documents that explain how gradient histogram works on marking the main feature of an image, such as [1]. In implementation we first used Canny algorithm in OpenCV to recognize major gradient changes in an image, so the pixels that belongs to an edge are stored (see variable canny and canny_m in get_features() in HammingLSH.cpp). Then we used Sobel algorithm in OpenCV to measure the gradient drop intensity in both direction x and y, so that we can calculate all the gradient drop direction vectors. After that, a histogram that records how frequently those vectors appear in a certain angle range. In these steps a feature vector of an image is acquired. How to calculate the gradient drop angle Actually how gradient histogram of edges works on identifying an image from the others is a little vague. But we can indicate a major gradient change often mean there are edges around, and Canny algorithm is such a well-performed method recognizing edges. To our knowledge a gradient histogram records shapes of the objects, e.g., a circle distribute equally in a histogram while a square have only two angles of gradient drop. The global variable ‘dimention’(misspelled) defined in HammingLSH.cpp can be modified to change the columns in histograms , the same to feature vector dimension, so it can yield different results. If the histogram contains more co