hadoop2.7分布式安装.doc

hadoop 2.7.1 jdk openjdk-7-jdk ssh rsync 1配置hosts 21 host1 14 host2 26 host3 21修改/etc/hosts和/etc/hostname 21 host1 14 host2 26 host3 /etc/hostname host1 14和26修改如上 启动一下网络配置脚本： /etc/init.d/hostname.sh?start 2安装SSH，并让master免验证登陆自身服务器、节点服务器 ssh-keygen -t dsa -P -f ~/.ssh/id_dsa cat ~/.ssh/id_dsa.pub ~/.ssh/authorized_keys 让主结点(master)能通过SSH免密码登录两个子结点（slave） 首先把master上面的id_rsa.pub 文件考到数据节点上面 scp conca@21:~/.ssh/id_rsa.pub . cat ~/id_rsa.pub ~/.ssh/authorized_keys 如果master ssh连接数据节点还需要密码请给数据节点的.ss权限设置 ~/.ssh权限设置为700 ~/.ssh/authorized_keys的权限设置为600 3、name节点hadoop安装 解压hadoop-2.7.1.tar.gz 到/usr/local hadoop-2.7.1重命名hadoop hadoop配置文件位置/usr/local/hadoop/etc/hadoop 配置core-site.xml： configuration property namefs.defaultFS/name valuehdfs://host1:9000/value /property property name.dir/name valuefile:/usr/local/data/hadoop/name/value /property property namedfs.datanode.data.dir/name valuefile:/usr/local/data/hadoop/data/value /property property ???namehadoop.tmp.dir/name ???value/usr/local/data/hadoop/tmp/value ???descriptionA base for other temporary directories./description /property /configuration 配置hdfs-site.xml： configuration property namedfs.replication/name value2/value /property property namenode.secondary.http-address/name valuehost1:9001/value /property /configuration 配置mapred-site.xml： configuration property name/name valueyarn/value /property property namemapreduce.jobhistory.address/name valuehost1:10020/value /property property namemapreduce.jobhistory.webapp.address/name valuehost1:19888/value /property /configuration 配置yarn-site.xml： configuration property nameyarn.nodemanager.aux-services/name valuemapreduce_shuffle/value /property property nameyarn.nodemanager.aux-services.mapreduce.shuffle.class/name valueorg.apache.hadoop.mapred.ShuffleHandler/value /property property nameyarn.resourcemanager.address/name