Hadoop2虚拟机3节点安装.docxVIP

摘要：本文记录了Hadoop2.2.0版本多节点集群安装过程，并做了基本配置，启动运行和测试了一个单词统计例子。环境说明：基于Windows下的VMware Player4.0.3中的Ubuntu12.04-64server安装，先把基础软件安装到一个虚拟机中，然后拷贝两份再配置下即可。三台机器的分工如下：Hadoop1(Master): NameNode/ResouceManagerHadoop2(Slave):DataNode/NodeManagerHadoop3(Slave): DataNode/NodeManager假定三台虚拟机的IP地址如下，后面会用到。Hadoop1:30Hadoop2:31Hadoop3:321、环境准备：下载免费的VMware Player并安装好;?下载免费的Ubuntu 12.04 server版并在VMware中安装好；2、基础安装：执行如下命令升级部分软件和把ssh安装好? (1)sudo apt-get update;? (2)sudo apt-get upgrade;? (3)sudo apt-get install openssh-server;安装Oracle?JDK通过webupd8team自动安装，执行命令如下：(1)? sudo apt-get install python-software-properties(2)? sudo add-apt-repository ppa:webupd8team/java(3)? sudo apt-get update(4)? sudo apt-get install oracle-java6-installer创建hadoop用户(1)? sudoaddgrouphadoop(2)? sudoadduser –ingrouphadoophduser编辑/etc/sudoers编辑文件，在root ALL=(ALL)ALL行下添加hduser ALL=(ALL)ALL。如果不添加这行，hduser将不能执行sudo操作。★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★注：以下操作均用hduser用户登录后操作。★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★3、公共安装：下载Hadoop2.2.0版本(1)? $ cd /home/hduser(2)? $ wget/hadoop/common/hadoop-2.2.0/hadoop-2.2.0.tar.gz(3)? $ tar zxf hadoop-2.2.0.tar.gz(4)? $ mv hadoop-2.2.0 hadoop配置Hadoop：(1)? 配置/home/hduser/hadoop/etc/hadoop/hadoop-env.sh替换exportJAVA_HOME=${JAVA_HOME}为如下：export JAVA_HOME=/usr/lib/jvm/java-6-oracle(2) 配置/home/hduser/hadoop/etc/hadoop/core-site.xml，在configuration中添加如下：property? namehadoop.tmp.dir/name?value/home/hduser/hadoop/tmp/hadoop-${}/value?descriptionA base for other temporary directories./description/propertyproperty?name/name?valuehdfs://30:8010/value?descriptionThe name of the default file system.? A URI whose? schemeand authority determine the FileSystem implementation.? The? uri’sscheme determines the config property (fs.SCHEME.impl) naming? theFileSystem implementation class.? Theuri’s authority is used to?determine the host, port, etc. for a filesystem./description/property注意：以下两点务必确保正确，否则后面会出错。a. 需执行mkdir home/hduser/hadoop/tmp创建这个临时目录;b. 这个值的IP地址为NameNode的地址，即Hadoop1。配置/home/hduser/hadoop/etc/hadoop/mapred-sit