DatabaseInspired Search VLDB 2005启发搜索数据库VLDB 2005.pptVIP

Database-Inspired Search David Konopnicki and Oded Shmueli IBM Haifa Technion Back in 1994-95… W3QL – W3QS: A database approach to Web data A way to “improve” search results A database language for searching the web Using full-text indexes as starting points Had conditions on “semi-structured” formats: n1.format eq “Latex File” n1.section[3].content =~ /zoo/ Would record form fillings and re-execute them automatically Basically, a way to define personal crawlers Contemporary Systems First generation languages: WebSQL (Mihaila, Mendelzon and Milo) Second generation languages: Weblog (Lakshmanan, Sadri, and Subramania) , Florid (Ludascher, Himmeroder, Lausen, May and Schlepphorst) Web restructuring languages: WebOQL (Arocena and Mendelzon) , StruQL (Fernandez, Florescu, Kang, Levy and Suciu), Araneus (Mecca, Atzeni, Masci, Merialdo and Sindoni) Lorel (Abiteboul, Quass, McHugh, Widom and Wiener) Present Trends Certainly, nowadays search engines are bigger and faster and more accurate A few new features: Is searching the web easier? Limitations Remain the Same Visually parsing results Search in context Searching beyond the first page of results Integrated search from my desktop, my enterprise and on to the world Visually Parsing Results Merging Documents and Object Retrieval Search Only the First Page of Results From a recent study on 12,500 queries: 73.9% of Ask Jeeves first page results were unique to Ask Jeeves 71.2% of Yahoo first page results were unique to Yahoo 70.8% of MSN search first page results were unique to MSN search 66.4% of Google first page results were unique to Google Need an automated way to search beyond the first page on several search engines simultaneously Desktop Search Quite different than web search No links - cannot use link analysis Information discoveryversus locating information Enterprise Search Search Architectures in the Enterprise An Example: DB2 Crawling in OmniFind For every table, sele