Ion Stoica：将数据转化为价值.pdf

Turning Data into Value Ion Stoica CEO, Databricks (also, UC Berkeley and Conviva) UC BERKELEY Data is Everywhere Easier and cheaper than ever to collect Data grows faster than Moore’s law 14 12 Moores Law 10 Overall Data 8 6 4 2 0 2010 2011 2012 2013 2014 2015 (IDC report*) The New Gold Rush Everyone wants to extract value from data » Big companies startups alike Huge potential » Already demonstrated by Google, Facebook, … But, untapped by most companies » “We have lots of data but no one is looking at it!” Extracting Value from Data Hard Data is massive, unstructured, and dirty Question are complex Processing, analysis tools still in their “infancy” Need tools that are » Faster » More sophisticated » Easier to use Turning Data into Value Insights, diagnosis, e.g., » Why is user engagement dropping? » Why is the system slow? » Detect spam, DDoS attacks Decisions, e.g., » Decide what feature to add to a product » Personalized medical treatment » Decide when to change an aircraft engine part » Decide what ads to show Data only as useful as the decisions it enables What do We Need? Interactive queries: enable faster decisions » E.g., identify why a site is slow and fix it Queries on streaming data: enable decisions on real-time data » E.g., fraud detection, detect DDoS attacks Sophisticated data processing: enable better decisions » E.g., anomaly detection, trend analysis Our Goal Batch