ubuntu上hadoop安装及配置.docx

1.安装VMware虚拟机，在其中安装三台Ubuntu10.10 maverick系统的机器，其中VMware自动为三台机器配好了本地IP。网络设置为NAT方式。node1: 用户名：root, 密码：root. IP: 31node2: 用户名：root, 密码：root. IP: 29node3: 用户名：root, 密码：root. IP: 332.修改hostsgedit /etc/hosts加入31node129node230node32.编辑每个主机的hostnamevi /etc/hostnamenode1: node1node2: node2node3: node33.安装jdk在oracle官网下载jdk1.7.0_02，放在home目录。1)解压压缩包mkdir/usr/javacp~/ jdk-7u2-linux-i586.tar.gz/usr/java/cd/usr/java/tar-xzvfjdk-7u2-linux-i586.tar.gz2)编辑/etc/profilegedit /etc/profile在最后加入:export JAVA_HOME=/usr/java/jdk1.7.0_02export JRE_HOME=/usr/java/jdk1.7.0_02/jreexport CLASSPATH=.:$JAVA_HOME/lib:$JRE_HOME/lib:$CLASSPATHexport PATH=$JAVA_HOME/bin:$JRE_HOME/bin:$PATH3)重新启动Ubuntu4.安装ssh在每台主机上安装ssh1)apt-get install ssh-server2)配置无密码登录node1:ssh-keygen -t rsacd .sshcat id_rsa.pub authorized_keys (实现无密码登录本机)node2:ssh-keygen -t rsacd .sshcat id_rsa.pub authorized_keys (实现无密码登录本机)scp node1:/root/.ssh/id_rsa.pub ~/cat ~/id_rsa.pub ~/.ssh/authorized_keys (实现node1无密码登录node2)node2:ssh-keygen -t rsacd .sshcat id_rsa.pub authorized_keys (实现无密码登录本机)scp node1:/root/.ssh/id_rsa.pub ~/cat ~/id_rsa.pub ~/.ssh/authorized_keys (实现node1无密码登录node2)5.安装hadoop下载hadoop-1.0.0.tar.gz 解压到/home/hadoop 把Hadoop 的安装路径添加到环/etc/profile 中:export HADOOP_HOME=/home/hadoop/hadoop-1.0.0export PATH=$HADOOP_HOME/bin:$PATH6.配置hadoopHadoop 的主要配置都在hadoop-1.0.0/conf 下。在conf/hadoop-env.sh中配置Java环境export JAVA_HOME=/usr/java/jdk1.7.0_02配置conf/masters 和conf/slaves 文件(1)在namenode中：Mastersnode1Slavesnode1node2node3(2)在datanode中Mastersnode1Slaveslocalhosthadoop/hadoop1.0.0/conf/core-site.xml:?xml version=1.0??xml-stylesheet type=text/xsl href=configuration.xsl?!-- Put site-specific property overrides in this file. --configurationproperty namehadoop.tmp.dir/name value/app/hadoop/tmp/value descriptionA base for other temporary directories./description/propertyproperty name/name valuehdfs://node1:54310/value descriptionThe name of the default file system. A URI whose scheme and authority determine