Search Engines Information Retrieval in Practice PPT chap11.pptVIP

Video Video is segmented into shots or scenes continuous sequence of visually coherent frames boundaries detected by visual discontinuities Video represented by key frame images e.g., first frame in a shot Image Annotation Given training data, can learn a joint probability model for words and image features Enables automatic text annotation of images current techniques are moderately effective errors Music Music is even less associated with words than images Many different representations e.g., audio, MIDI, score Search based on features such as spectrogram peaks, note sequences, relative pitch, etc. Search Engines Information Retrieval in Practice All slides ?Addison Wesley, 2008 Beyond Bag of Words “Bag of Words” a document is considered to be an unordered collection of words with no relationships Extending representation feature-based models dependency models document structure question structure other media Feature-Based Retrieval Models Linear feature-based model Some models support non-linear functions, but linear is more common Linear Feature-Based Models To find best values for parameters need a set of training data T an evaluation function where RΛ is the set of rankings produced by the scoring function for all the queries Goal of a linear feature-based retrieval model is to find a parameter setting that maximizes E for the training data Term Dependence Models Term dependence models do not assume that words occur independently of each other e.g., Markov Random Field (MRF) model construct a graph that consists of a document node and one node per query term undirected graphical model models the joint distribution over the document random variable and query term random variables models dependencies between random variables by drawing an edge between them MRF Model Assumptions independence sequential dependence full dependence general dependence MRF Model Define a set of potential functions over the cliques of the graph these are the features of the linear