Models and Sensor Networks模型和传感器网络.pptVIP

Sensor Data Management:Challenges and (some) Solutions Amol Deshpande, University of Maryland Motivation Unprecedented, and rapidly increasing, instrumentation of our every-day world Sensor Data Processing: Now Sensor Data Processing: What we want Data Management Challenges Very, very large scale Spatio-temporal querying essential Need new indexing techniques, data description formats, techniques for “data ingest” (cleaning the data etc) Much work in scientific data management E.g. SkyServer Data is typically imprecise, unreliable, or incomplete (data quality) Measurement noise, failures in sensor/GPS data High message loss rate in wireless/RFID Data Management Challenges Data is generated continuously and must be processed in real-time (distributed data streams) Need different query processing paradigms Typically very high data rates Must be able to handle a large number of continuous queries efficiently Much recent work on “Data Streams” Research systems: TelegraphCQ [Berkeley], STREAM [Stanford], Aurora [Brown/MIT/Brandeis] etc… Commercial systems: Streambase, TruViso, … Data Management Challenges Need for real-time statistical modeling of data Eliminate spatial/temporal biases, handle missing data through extrapolation (e.g. regression, interpolation models) Filter measurement noise (e.g. Kalman Filters) Infer hidden variables, pattern recognition (e.g. HMMs) Fault or anomaly detection Forecasting/prediction (e.g. ARIMA) Data Management Challenges The applications have strong acquisitional aspects Data has to be actively acquired as needed Typically high data acquisition costs(e.g. energy consumption in battery-powered devices) Data provenance Being able to trace something back to its origins Data exploration and visualization Data interoperability Data security and privacy … My Research Interests Managing imprecise and incomplete data Support statistical modeling and querying of sensor data in relational databases Clean, declarative abstractions Real-time