21 Kas Kasravi Presentation Unstructured Data Management英文资料.ppt

Unstructured Data Management Kas Kasravi EDS Fellow Topics Summary What is Unstructured Data? The Value in Unstructured Data Technologies Text Mining Audio Mining Image Mining Unstructured Data Management Issues Examples Summary Unstructured data consists of text, audio, images etc. Unstructured data contains significant business value Technologies and tools exist for leveraging the value in unstructured data The value in unstructured data is mostly untapped A paradigm shift is needed What is Unstructured Data? Any data without a well-defined model for information access Examples, Word documents E-mails Examples of what is structured Database tables Objects XML tags Unstructured Data Management (UDM) The process of mining and analyzing unstructured data to capture actionable information Market size $100M for text mining Much greater IT impact The Value in Unstructured Data “Amount of text-based data alone will grow to over 800 terabytes by 2004” - Forrester “Amount of unstructured data in large corporations doubles every?2 months” - IDC Companies with a UDM system in place are, on average, at least 15% more productive - Basex The Value in Unstructured Data “The average knowledge worker spends 2.5 hours per day searching for documents” - IDC – March 2002 “80-90% of information on the net and corporate networks is unstructured” - Goldman Sachs UDM Increases Informational Content UDM Complements Structured Data The Value in Unstructured Data Business Value Better information More timely information More relevant information Better decision support IT Impact More information to store and manage More complex analysis Greater business impact UDM Technologies Text Mining The process of extracting information from textual data, and utilizing it for better business decisions Based on multiple technologies, e.g., Computational linguistics Statistics A new business intelligence tool Focus on semantics and not keywords An emerging technology Computational Lingu