(在资料时代中挖掘知识).pptVIP

Mining Knowledge in Data Explosion Age（在資料爆炸時代中挖掘知識） 廖宜恩 中興大學資訊科學系 Outline Why Data Mining What is Data Mining Knowledge Discovery Process Data Mining Functionalities Data Mining Process Conclusions Why Data Mining Data Explosion Problem（資料爆炸問題） Data in the world doubles every 20 months! NASA’s Earth Orbiting System: forty-six megabytes of data per second 4,000,000,000,000 bytes a day（4 TeraByte/day；20×200GB Hard Disk） FBI fingerprints image library: 200,000,000,000,000 bytes（200 TB） In-line image analysis for particle detection: 1 megabyte in one second Why Data Mining? Commercial Viewpoint Lots of data is being collected and warehoused Web data, e-commerce purchases at department/grocery stores Bank/Credit Card transactions Competitive Pressure is Strong Provide better, customized services for an edge (e.g. in Customer Relationship Management) Why Data Mining? Scientific Viewpoint Data collected and stored at enormous speeds (GB/hour) remote sensors on a satellite telescopes scanning the skies microarrays generating gene expression data scientific simulations generating terabytes of data Traditional techniques infeasible for raw data Mining Large Data Sets - Motivation There is often information “hidden” in the data that is not readily evident Human analysts may take weeks to discover useful information Much of the data is never analyzed at all We are drowning in data, but starving for knowledge! （淹沒於資料，飢渴於知識） What is Data Mining? Data Mining (Knowledge Discovery in Databases, KDD) （資料挖掘、資料探勘、資料採礦）: Exploration analysis, by automatic or semi-automatic means, of large quantities of data in order to discover meaningful patterns and rules（以自動化或半自動化方式探索、分析大量資料以發現有意義的樣式和規則） Knowledge Discovery Process Data mining: the core of knowledge discovery process. Origins of Data Mining Draws ideas from machine learning/AI, pattern recognition, statistics, and database systems Traditional Techniquesmay be unsuitable due to Enormity of data （龐大的資料） C