[Hadoop]1 单节点Hadoop安装.docx

装备软件CentOS 6.5 jdk-8u91-linux-x64.tar.gzhadoop-3.0.0-alpha1.tar.gz参考文档/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html步骤1、安装JDK 8解压mkdir/usr/java?cd?/usr/javatar?-zxvf?jdk-8u91-linux-x64.tar.gz配置环境变量JAVA_HOME=/usr/java/jdk1.8.0_79JRE_HOME=$JAVA_HOME/jreCLASS_PATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/libPATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/binexport?JAVA_HOME?JRE_HOME?CLASS_PATH?PATH让修改生效source?/etc/profile2、安装Hadoop解压tar -zxvf hadoop-3.0.0-alpha1.tar.gz修改配置文件etc/hadoop/hadoop-env.shexport JAVA_HOME=/usr/java/jdk1.8.0_79Standalone OperationBy default, Hadoop is configured to run in a non-distributed mode, as a single Java process. This is useful for debugging.The following example copies the unpacked conf directory to use as input and then finds and displays every match of the given regular expression. Output is written to the given output directory. $ mkdir input $ cp etc/hadoop/*.xml input $ bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1.jar grep input output dfs[a-z.]+ $ cat output/*Pseudo-Distributed OperationHadoop can also be run on a single-node in a pseudo-distributed mode where each Hadoop daemon runs in a separate Java process.ConfigurationUse the following:etc/hadoop/core-site.xml:configuration property namefs.defaultFS/name valuehdfs://localhost:9000/value /property/configurationetc/hadoop/hdfs-site.xml:configuration property namedfs.replication/name value1/value /property/configurationSetup passphraseless sshNow check that you can ssh to the localhost without a passphrase: $ ssh localhostIf you cannot ssh to localhost without a passphrase, execute the following commands: $ ssh-keygen -t rsa -P -f ~/.ssh/id_rsa $ cat ~/.ssh/id_rsa.pub ~/.ssh/authorized_keys $ chmod 0600 ~/.ssh/authorized_keysExecutionThe following instructions are to run a MapReduce job locally. If you want to execute a job on YARN, see?/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.htmlYARN on Single No