ExperienceswithReal-TimeDataWarehousingUsingOracle.pptVIP

Experiences with Real-Time Data Warehousing Using Oracle Database 10G Mike Schmitz High Performance Data Warehousing mike.schmitz@ Michael Brey Principal Member Technical Staff ST/NEDC Oracle Engineering Oracle Corporation Agenda The meaning of Real-Time in Data Warehousing Customer Business Scenario Customer Environment “Real-Time” Requirement Our Real-Time Solution Real-Time data architecture Incremental Operational Source Change Capture Transformation and Population into DW Target Simplified Functional Demonstration Asynchronous Change Data Capture (Oracle) Performance Characteristics and Considerations My Background Real-Time in Data Warehousing Data Warehousing Systems are complex environments Business rules Various data process flows and dependencies Almost never pure Real-Time Some latency is a given What do you need? Real Time Near Real-Time Just in Time for the business Customer Business Scenario Client provides software solutions for utility companies Utility companies have plants generating energy supply Recommended maximum output capacity Reserve Capacity Buy supplemental energy as needed Peak demand periods are somewhat predictable Each day is pre-planned on historical behavior Cheaper to buy energy ahead Expensive to have unused capacity Existing data warehouse supports the planning function Reduced option expenses Cut down of supplemental energy costs Customer “Real-Time” Requirement Getting more in-time accuracy enhances operational business Compare todays plant output volumes to yesterdays or last week’s average Know when to purchase additional options or supplies Customer Target Actual data within a 5 minute lag Use a single query Use a single tool Sample Analysis Graph Our Real-Time SolutionOverview Three-Step Approach: Implement a real-time DW data architecture Near real-time incremental change capture from operational system Transformation and Propagation (population) of change data to DW Our Real-Time SolutionReal-Time DW Data Architect