大数据技术与解决方案.PDFVIP

Big Data 大数据技术与解决方案 — Big Data Techniques and Big Data Solutions 刘鹏 管理学博士/教授 上海财经大学信息管理与工程学院 liupeng@ The Elements of Persuasion: Big Data Techniques Big Data is a catchall, an umbrella classification that encompasses many fields and subfields. In this lecture, we drill down and explore those specific fields and subfields. 目标：大数据是由什么具体元素或领域构成？ 这些领域如何帮助我们理解大数据  2011年5月, McKinsey发布了一本电子书: Big Data: The Next Frontier for Innovation, Competition, and Productivity, /~/media/McKinsey/dotcom/Insights%20and%20pubs/MGI/Research/Technology%20and%20Innovation/Big%20Data/Big_Data_The_next_frontier_for_innovation_epub.ashx 作者列出了很多分析大数据的技术,例如:  A/B testing, association rule learning, classification, cluster analysis, collaborative filtering, crowdsourcing, data fusion and integration, data mining, ensemble learning, genetic algorithms, machine learning, natural language processing (NLP), neural networks, pattern recognition, predictive modeling, regression, radio-frequency identification (RFID), sentiment analysis, signal processing, supervised and unsupervised learning, simulation, text analytics, time series analysis, and visualization Prof./Dr. LIU Peng Page 2 The Elements of Persuasion: Big Data Techniques 说明: 一些技术已经先于大数据或类大数据而存在 例如:回归分析,无线射频识别(RFID), A/B测试 如此长的大数据元素列表,因为大数据的确很大,每种技 术都可能有效(针对特定类型和来源的数据) 例如：电话呼叫(呼叫中心服务代表和客户之间的 交谈记录)使用文本或语音分析，而非回归分析 这些工具经常放在一起综合使用 很多技术在功能上有重叠 Big Data is far too big and dynamic, and its tools are far too numerous Prof./Dr. LIU Peng Page 3 The Elements of Persuasion: Big Data Techniques