部署hadoop集群.docx

Hadoop集群部署手册环境准备：节点数量：至少3台节点Distributor ID: CentOSDescription: CentOS release 6.5 (Final)Release: 6.5Codename: FinaHadoop版本：2.6.0Hbase版本：1.2.0JDK版本：jdk1.8.0_66编辑节点hosts配置：1.vi /etc/hosts （3节点都修改）01ct102ct203ct3关闭防火墙：1、关闭firewall：systemctl stop firewalld.service #停止firewallsystemctl disable firewalld.service #禁止firewall开机启动firewall-cmd --state #查看默认防火墙状态（关闭后显示notrunning，开启后显示running）查看 rpm -qa | grep java：显示如下信息： java-1.4.2-gcj-compat--40jpp.115 java-1.6.0-openjdk--1.7.b09.el5卸载： rpm -e --nodeps java-1.4.2-gcj-compat--40jpp.115 rpm -e --nodeps java-1.6.0-openjdk--1.7.b09.el52.3台机器 创建hadoop 用户：hadoop 初始密码:1233.安装JDK (3台都安装)：[root@h201 hadoop]# cp jdk-7u25-linux-i586.tar.gz /usr/[root@h201 usr]# tar -zxvf jdk-7u25-linux-i586.tar.gz [root@h201 ~]# vi /etc/profileexport JAVA_HOME=/usr/jdk1.8.0_66export JAVA_BIN=/usr/jdk1.8.0_66/binexport PATH=$PATH:$JAVA_HOME/binexport CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jarexport JAVA_HOME JAVA_BIN PATH CLASSPATH[root@h201 ~]# reboot4.安装ssh 证书[hadoop@h201 ~]$ ssh-keygen -t rsa[hadoop@h202 ~]$ ssh-keygen -t rsa[hadoop@h203 ~]$ ssh-keygen -t rsa[hadoop@h201 ~]$ ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub ct1[hadoop@h201 ~]$ ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub ct2[hadoop@h201 ~]$ ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub ct3[hadoop@h202 ~]$ ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pubct1[hadoop@h202 ~]$ ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub ct2[hadoop@h202 ~]$ ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub ct3[hadoop@h203 ~]$ ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub ct1[hadoop@h203 ~]$ ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub ct2[hadoop@h203 ~]$ ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub ct3#############################################################SSH免密码登录，因为Hadoop需要通过SSH登录到各个节点进行操作，我用的是root用户，每台服务器都生成公钥，再合并到authorized_keys(1)CentOS默认没有启动ssh无密登录，去掉/etc/ssh/sshd_config其中2行的注释，每台服务器都要设置，#RSAAuthentication yes#PubkeyAuthentication yes(2)输入命令，ssh-keygen -t rsa，生成key，都不输入密码，一直回车，/root就会生成.ssh