Big Data Flowsvs. Wicked Leaks.ppt

Background Early 80’s: Founded Systems Research Development (SRD), a custom software consultancy 1989 – 2003: Built numerous systems for Las Vegas casinos including a technology known as Non-Obvious Relationship Awareness (NORA) 2005: IBM acquires SRD, now chief scientist of IBM Entity Analytics Personally designed and deployed +/- 100 systems, a number of which contained multi-billions of transactions describing 100’s of millions of entities Today: My focus is in the area of ‘sensemaking on streams’ with special attention towards privacy and civil liberties protections Markle Foundation, Member, Task Force on National Security EPIC, Member, Advisory Board Data Volumes Exploding Big Data Flows: How Many Copies? Blog Post: How Many Copies of Your Data? Is Somewhat Like Asking: How Many Licks to the Center of the Tootsie Pop? Often, at minimum, 144 copies Backups Internal transfers Other operational systems Operational data stores Data warehouses Data marts Testing systems Training systems Their backups External transfers (information sharing partners) And then their entire ecosystem (from warehouses to backups) And their information sharing partners Sometimes 10,000’s of copies What’s driving information sharing and big data? Organizations Are Getting Dumber Information in Context … and Accumulating Flows vs. Leaks Most flows are by design Better context Better prediction Unintended disclosure flows External: e.g., Cyber Internal: e.g., Insider threats Recent WikiLeaks Devastating consequences Could have been worse. What if the leaks were not made public rather selectively and quietly passed around to others? Wicked Leaks, Prediction Sudden change of leak cadence – so much, so fast, no considered intolerable May result in new harsh laws and prosecutions Receiving stolen property (e.g., data) and benefiting from it … met with severe pursuit and prosecution Stealing party The information exchange points (e.g., Wikileaks) Those publishing the contents (e.