MAESTRO Conductor of Multimedia Analysis Technologies.pdf

MAESTRO: CONDUCTOR OF MULTIMEDIA ANALYSIS TECHNOLOGIES Ze’ev Rivlin, Douglas Appelt, Robert Bolles, Adam Cheyer, Dilek Hakkani-Tür, David Israel, Luc Julia, David Martin, Greg Myers, Ken Nitz, Bikash Sabata, Ananth Sankar, Elizabeth Shriberg, Kemal Sonmez, Andreas Stolcke, G?khan Tür SRI International Menlo Park, California 94025 /projects/Maestro.html Contact: julia@ Although keyword-based queries are now a fa- miliar part of any user’s experience with the World Wide Web, they are of limited direct applicability to the vast and growing quantity of multimedia infor- mation becoming available in materials such as broadcast news, video teleconferences, reconnais- sance data, and audio-visual recordings of corporate meetings and classroom lectures. Content-based in- dexing, archiving and retrieval would facilitate access to large databases of such materials. For example, in the broadcast news domain, content-based archiving is particularly useful. Ar- chiving can be done by exploiting the speech contained in the audio track, the images contained in the video track, and the text in video overlays. One application is to filter down huge volumes of raw news footage to create the nicely packaged news broadcasts that we watch on television. Another use is to create a news-on-demand system for viewing news more efficiently. We can create a database of news broadcasts annotated for later retrieval of news clips of interest. The query “Tell me about the recent elections in Bosnia” would bring up news clips re- lated to the elections. MAESTRO (Multimedia Annotation and En- hancement via a Synergy of Technologies and Reviewing Operators) is a research and demonstra- tion system developed at SRI International for exploring the contribution of a variety of analysis technologies — for example, speech recognition, im- age understanding, and optical character recognition — to the indexing and retrieval of multimedia. In- formedia [1] and Broadcast News Navigator [2] are similar p