Data Warehouse Architecture Infrastructure数据仓库建筑和基础设施.pptVIP

Source Data Component Production data Internal data Archive data External data Data staging component Extraction Transformation Cleaning standardization Loading Data storage component Information delivery component Metadata component Management and control component Overview of the Components Data Warehouse Architecture Extract Transform Load Refresh Serve External Sources Operational Dbs Analysis Query/Reporting Data Mining Monitoring Administration Metadata Repository DATA SOURCES TOOLS DATA MARTS OLAP Servers Reconciled data Data Acquisition Data Storage Information Delivery Architectural Framework Data Acquisition You are the data analyst on the project team building a DW for an insurance company. List the possible data sources from which you will bring data into DW Production data: data from various operational systems External data: for finding trends and comparisons against other organizations. Internal data: private confidential data important to an organization Archived data: for getting some historical information Architectural Framework Data Staging Performs ETL Extraction Select data sources, determine filters Automatic replicate Create intermediary files Transformation Clean, merge, de-duplicate data Covert data types Calculate derived data Resolve synonyms and homonyms Loading Initial loading Incremental loading Why is a separate data staging area required? Data is across various operational databases It should be subject-oriented data Data staging is mandatory Architectural Framework Characteristics of data storage area Separate repository Data content Read only Integrated High volumes Grouped by business subjects Metadata driven Data from DW is aggregated in MDDBs Architectural Framework Information delivery component Depends on the user Novice user: prefabricated reports, preset queries Casual user: once in a while information business analyst: complex analysis Power users: picks up interesting data Information delivery component Archit