HybridPeer-to-PeerMediaDistributionSystema.pptVIP

DEXA 2005 DEXA 2005 Control-based Quality Adaptation in Data Stream Management Systems (DSMS) Yicheng Tu?, Song Liu?, Sunil Prabhakar?, and Bin Yao? ?Department of Computer Sciences, Purdue University, USA ?School of Mechanical Engineering, Purdue University, USA Data Stream Management Continuous data, discarded after being processed Continuous query Data-active query-passive model Applications Financial analysis Mobile services Sensor networks Network monitoring More … DSMS architecture Network of query operators (O1 – O3) Each operator has its own queue (q1 – q4) Scheduler decides which operator to execute Query results (Q1, Q2) pushed to clients Example systems: Aurora/Borealis STREAM Quality-of-Service (QoS) in DSM Data processing is QoS-critical in DSMS Tuple delay is the major concern: results generated from old data are useless! Highly dynamic environment ? hard to maintain QoS Bursty data input Unpredictable unit processing cost Overloading during spikes ? degraded (delay) QoS Solution: adjust data loss ? load shedding Load Shedding Eliminating excessive load by dropping data items ? less QoS violations Key questions When? How much? Where? Which tuples? Basic algorithm (Tatbul et al., 2003): periodically What’s wrong? Fail to capture current system status (queue length) and output (delay) Delay positively related to queue length Examples 1. Unbounded increase of delay Example 2. Unnecessary data loss Our approach Why Feedback Control ? The feedback control loop Controller design Performed all three steps in a real DSMS – the Borealis system We set output to average delay System identification gives a first-order model structure Control function Controller analysis gives the following set of parameters: Experiments Experimental results Experimental results Experimental results Experimental results Summary Load shedding is an important quality adaptation method Current solutions focusing on steady-state performance do not work well under burst