在大数据上近似查询.pdf

Approximate Queries on Very Large Data Sameer Agarwal Joint work with Ariel Kleiner, Henry Milner, Barzan Mozafari, Ameet Talwalkar, Michael Jordan, Samuel Madden, Ion Stoica UC Berkeley Our Goal Support interactive SQL-like aggregate queries over massive sets of data Our Goal Support interactive SQL-like aggregate queries over massive sets of data blinkdb SELECT AVG(jobtime) FROM very_big_log AVG, COUNT, SUM, STDEV, PERCENTILE etc. Our Goal Support interactive SQL-like aggregate queries over massive sets of data blinkdb SELECT AVG(jobtime) FROM very_big_log WHERE src = ‘hadoop’ FILTERS, GROUP BY clauses Our Goal Support interactive SQL-like aggregate queries over massive sets of data blinkdb SELECT AVG(jobtime) FROM very_big_log WHERE src = ‘hadoop’ LEFT OUTER JOIN logs2 ON very_big_log.id = logs.id JOINS, Nested Queries etc. Our Goal Support interactive SQL-like aggregate queries over massive sets of data blinkdb SELECT my_function(jobtime) FROM very_big_log ML Primitives, WHERE src = ‘hadoop’ User Defined Functions LEFT OUTER JOIN logs2 ON very_big_log.id = logs.id 100 TB on 1000 machines ½ - 1 Hour 1 - 5 Minutes 1 second ? Hard Disks Memory Query Execution on Samples Query Execution on Samples ID City Buff Ratio