Lecture4_Hadoop.pptVIP

* * * * * * * * * * * * * * * * * * * * Hadoop 大连理工大学计算机科学与技术学院 2011年春季 Hadoop Open Source Apache Project Hadoop Core includes: Distributed File System - distributes data Map/Reduce - distributes application Written in Java Runs on Linux, Mac OS/X, Windows, and Solaris Commodity hardware Commodity Hardware Cluster Typically in 2 level architecture Nodes are commodity PCs 40 nodes/rack Uplink from rack is 8 gigabit Rack-internal is 1 gigabit Hadoop File System HDFS Distributed File System Single namespace for entire cluster Managed by a single namenode. Files are single-writer and append-only.