基于物联网服务平台的海量传感信息Hadoop处理方法和系统设计电子与通信工程专业论文.docxVIP

II II Abstract IOT(Internet of Things) service platform provides customers with a variety of intelligent services through processing sensor information. The sensor information has its special features: big data, complex sources and openness.As a result, single node processing methods or independent processing system can not meet requirements. So it is essential to research methods of processing massive sensor information in IOT service platform. This thesis is done in this context. Cloud computing is the key technology of IOT service platform, users can make use of distributed sensor information, computing resources and storage resources as demand. On the basis of integrated analysis of IOT services platform and key techniques of cloud computing, system of processing massive sensor information is proposed. Firstly, a technical framework of the system is presented. Second, its functional modules are detailed designed using distributed and parallel computing.The system takes advantage of the Hadoop, including MapReduce programming model, HBase distributed database and distributed file system HDFS, besides, Oracle database is also used as a supplement, so that the system achieves high availability and scalability. Finally, the system is implemented in the intelligent transportation services. Programming and demonstrations shows that the system is suitable to massive sensor information processing. At last, conclusion and future research direction is presented. Key words: cloud computing, big data, sensor information, distributed computing, parallel computing, Hadoop PAGE PAGE IV 目录 摘要 I Abstract II 第一章 绪论 1 1.1 项目背景 1 1.2 传感信息特点 3 1.3 技术背景 4 1.3.1 SaaS 服务模式 4 1.3.2 分布式和并行计算 6 1.4 论文主要工作和安排 8 第二章 Hadoop 处理方法与体系架构 9 Hadoop 的组件描述 9 MapReduce 9 HDFS 11 HBase 12 2.4.1 数据模型 12 2.4.2 和关系型数据库的比较 14 2.5 本章总结 15 第三章 服务平台传感信息处理系统设计 16 3.1 物联网服务平台 16 3.2 服务平台传感信息处理系统模型设计 17 3.3 分布式和并行处理模型 20 3.3.1 结构设计 21 3.3.2 接口设计 23 HYPERLINK \l _TOC_250007 Oracle 的输入 24 HYPERLINK \l _