基于Hadoop数据分析系统设计(优秀毕业设计)要点.docx

广州大学华软软件学院 某某企业数据分析系统设计 PAGE \* MERGEFORMAT107 摘要 随着云时代的来临，大数据也吸引越来越多的关注，企业在日常运营中生成、积累的用户网络行为数据。这些数据是如此庞大，计量单位通常达到了PB、EB甚至是ZB。Hadoop作为一个开源的分布式文件系统和并行计算编程模型得到了广泛的部署和应用。本文将介绍Hadoop完全分布式集群的具体搭建过程与基于Hive的数据分析平台的设计与实现。 关键字 Hadoop，MapReduce，Hive Abstract With the advent of cloud, big data also attract more and more attention, the enterprise of the generation and accumulation in the daily operation of the user network behavior data. The data is so large, the measuring unit is usually achieved the PB, EB, and even the ZB. The Hadoop distributed file system as an open source, and parallel computing programming model has been widely deployed and application. This article introduces Hadoop completely distributed cluster process of concrete structures, and the design and implementation of data analysis platform based on the Hive. key words Hadoop，MapReduce，Hive 目录  TOC \h \z \t 新标题1,1,新标题2,2,新标题3,3 HYPERLINK \l _Toc386042585 第一章 某某企业数据分析系统设计需求分析  PAGEREF _Toc386042585 \h 4 HYPERLINK \l _Toc386042586 第二章 Hadoop简介  PAGEREF _Toc386042586 \h 5 HYPERLINK \l _Toc386042587 第三章 Hadoop单一部署  PAGEREF _Toc386042587 \h 8 HYPERLINK \l _Toc386042588 3.1 Hadoop集群部署拓扑图  PAGEREF _Toc386042588 \h 8 HYPERLINK \l _Toc386042589 3.2 安装操作系统Centos  PAGEREF _Toc386042589 \h 9 HYPERLINK \l _Toc386042590 3.3 Hadoop基础配置  PAGEREF _Toc386042590 \h 15 HYPERLINK \l _Toc386042591 3.4 SSH免密码登录  PAGEREF _Toc386042591 \h 18 HYPERLINK \l _Toc386042592 3.5 安装JDK  PAGEREF _Toc386042592 \h 19 HYPERLINK \l _Toc386042593 3.6 安装Hadoop  PAGEREF _Toc386042593 \h 20 HYPERLINK \l _Toc386042594 3.6.1安装32位Hadoop  PAGEREF _Toc386042594 \h 20 HYPERLINK \l _Toc386042595 3.6.2安装64位Hadoop  PAGEREF _Toc386042595 \h 29 HYPERLINK \l _Toc386042596 3.7 Hadoop优化  PAGEREF _Toc386042596 \h 33 HYPERLINK \l _Toc386042597 3.8 Hive安装与配置  PAGEREF _Toc386042597 \h 34 HYPERLINK \l _Toc386042598 3.8.1 Hi