Single Node Setup Apache Hadoop（单节点设置Apache Hadoop）.pdf

Single Node Setup Table of contents 1 Purpose 2 2 Prerequisites2 2.1 Supported Platforms2 2.2 Required Software 2 2.3 Installing Software2 3 Download2 4 Prepare to Start the Hadoop Cluster 3 5 Standalone Operation 3 6 Pseudo-Distributed Operation 3 6.1 Configuration 3 6.2 Setup passphraseless ssh4 6.3 Execution 4 7 Fully-Distributed Operation 5 Copyright © 2008 The Apache Software Foundation. All rights reserved. Single Node Setup 1 Purpose This document describes how to set up and configure a single-node Hadoop installation so that you can quickly perform simple operations using Hadoop MapReduce and the Hadoop Distributed File System (HDFS). 2 Prerequisites 2.1 Supported Platforms • GNU/Linux is supported as a development and production platform. Hadoop has been demonstrated on GNU/Linux clusters with 2000 nodes. • Win32 is supported as a development platform. Distributed operation has not been well tested on Win32, so it is not supported as a production platform . 2.2 Required Software Required software for Linux and Windows include: 1. TM Java 1.6.x, preferably from Sun, must be installed. 2. ssh must be installed and sshd must be running to use the Hadoop scripts that manage remote Hadoop daemons. Additional requirements for Windows include: 1. Cygwin - Required for shell support in addition to the required software above. 2.3 Installing Software If your cluster doesnt have the requisite software you will need to install it. For example on Ubuntu Linux: $ sudo apt-get install ssh $ sudo apt-get install rsync On Windows, if you did not install the required software when you installed cygwin, start the cygwin installer and select the packages: • openssh - the Net category 3 Download To get a Hadoop distri