image retrieval current techniques, promising directions, and.pptVIP

Image Retrieval: Current Techniques, Promising Directions, and Open Issues Yong Rui, Thomas Huang and Shih-Fu Chang Published in the Journal of Visual Communication and Image Representation. Presentation Outline History of image retrieval – Issues faced Solution – Content-based image retrieval Feature extraction Multidimensional indexing Current Systems Open issues Conclusion History of Image Retrieval Traditional text-based image search engines Manual annotation of images Use text-based retrieval methods E.g. Limitations of text-based approach Problem of image annotation Large volumes of databases Valid only for one language – with image retrieval this limitation should not exist Problem of human perception Subjectivity of human perception Too much responsibility on the end-user Problem of deeper (abstract) needs Queries that cannot be described at all, but tap into the visual features of images. Outline History of image retrieval – Issues faced Solution – Content-based image retrieval Feature extraction Multidimensional indexing Current Systems Open issues Conclusion What is CBIR? Images have rich content. This content can be extracted as various content features: Mean color , Color Histogram etc… Take the responsibility of forming the query away from the user. Each image will now be described by its own features. CBIR – A sample search query User wants to search for, say, many rose images He submits an existing rose picture as query. He submits his own sketch of rose as query. The system will extract image features for this query. It will compare these features with that of other images in a database. Relevant results will be displayed to the user. Sample Query Sample CBIR architecture Outline History of image retrieval – Issues faced Solution – Content-based image retrieval Feature extraction Multidimensional indexing Current Systems Open issues Conclusion Feature Extraction What are image features? Primitive features Mean color (RGB) Color Histogram Sem