The Age of Big Data：大数据时代.ppt

* * * * * * * * * * The Age of Big Data Kayvan Tirdad Tirdad@Yorku.ca 1 1 Introduction: Explosion in Quantity of Data Big Data Characteristics 2 Usage Example in Big Data 3 4 Importance of Big Data 5 Cost Problem (example) 2 3 4 5 Contents 1 1 6 Some Challenges in Big Data Other Aspects of Big Data 2 Book Review 3 4 Zeta-Byte Horizon 5 7 8 9 10 Contents 2 Implementation of Big Data Introduction: Explosion in Quantity of Data 3 1946 2012 Eniac LHC X 6000000 = 1 (40 TB/S) Air Bus A380 - 1 billion line of code - each engine generate 10 TB every 30 min 640TB per Flight Twitter Generate approximately 12 TB of data per day New York Stock Exchange 1TB of data everyday storage capacity has doubled roughly every three years since the 1980s 4 Introduction: Explosion in Quantity of Data Our Data-driven World Science Data bases from astronomy, genomics, environmental data, transportation data, … Humanities and Social Sciences Scanned books, historical documents, social interactions data, new technology like GPS … Business Commerce Corporate sales, stock market transactions, census, airline traffic, … Entertainment Internet images, Hollywood movies, MP3 files, … Medicine MRI CT scans, patient records, … 5 Introduction: Explosion in Quantity of Data Our Data-driven World What we do with these amount of data? Ignore - Fish and Oceans of Data Big Data Characteristics 6 How big is the Big Data? - What is big today maybe not big tomorrow Big Data Vectors (3Vs) Any data that can challenge our current technology in some manner can consider as Big Data Volume Communication Speed of Generating Meaningful Analysis Big Data are high-volume, high-velocity, and/or high-variety information assets that require new forms of processing to enable enhanced decision making, insight discovery and process optimization” Gartner 2012 Big Data Characteristics 7 Big Data Vectors (3Vs) high-volume amount of data high-velocity Speed rate in collect