141.3. 单机安装 CentOS 5 + hadoop-0.20.0

这种安装方式仅仅适用于做实验，快速搭建Hadoop环境，不适合生产环境。

Ubuntu 环境

$ sudo apt-get install openjdk-7-jre
		

过程 141.1. Master configure

1. Download and Installing Software

   $ cd /usr/local/src/
   $ wget http://apache.etoak.com/hadoop/core/hadoop-0.20.0/hadoop-0.20.0.tar.gz
   $ tar zxvf hadoop-0.20.0.tar.gz
   $ sudo cp -r hadoop-0.20.0 ..
   $ sudo ln -s hadoop-0.20.0 hadoop
   $ cd hadoop
   

2. Configuration

   hadoop-env.sh

   $ vim conf/hadoop-env.sh
   export JAVA_HOME=/usr
   

   conf/core-site.xml

   $ vim conf/core-site.xml
   
   <configuration>
     <property>
       <name>fs.default.name</name>
       <value>hdfs://localhost:9000</value>
     </property>
   </configuration>
   

   conf/hdfs-site.xml

   $ vim conf/hdfs-site.xml
   
   <configuration>
     <property>
       <name>dfs.replication</name>
       <value>1</value>
     </property>
   </configuration>
   

   conf/mapred-site.xml

   $ vim conf/mapred-site.xml
   
   <configuration>
     <property>
       <name>mapred.job.tracker</name>
       <value>localhost:9001</value>
     </property>
   </configuration>
   

3. Setup passphraseless ssh

   Now check that you can ssh to the localhost without a passphrase:
   $ ssh localhost
   
   If you cannot ssh to localhost without a passphrase, execute the following commands:
   $ ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
   $ cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
   

4. Execution

    Format a new distributed-filesystem:
   $ bin/hadoop namenode -format
   
   Start the hadoop daemons:
   $ bin/start-all.sh
   
   When you're done, stop the daemons with:
   $ bin/stop-all.sh
   				

5. Monitor

   Browse the web interface for the NameNode and the JobTracker; by default they are available at:

   • NameNode - http://localhost:50070/
   • JobTracker - http://localhost:50030/
6. Test

   $ bin/hadoop dfs -mkdir test
   $ echo helloworld > testfile
   $ bin/hadoop dfs -copyFromLocal testfile test/
   $ bin/hadoop dfs -ls
   Found 1 items
   drwxr-xr-x   - neo supergroup          0 2009-07-10 14:18 /user/neo/test
   
   $ bin/hadoop dfs -ls test
   
   $ bin/hadoop dfs –cat test/file
   

过程 141.2. slave config

1. SSH

   $ scp neo@master:~/.ssh/id_dsa.pub .ssh/master.pub
   $ cat .ssh/master.pub >> .ssh/authorized_keys
   

2. Hadoop

   $ scp neo@master:/usr/local/hadoop /usr/local/hadoop
   

原文出处：Netkiller 系列 手札
本文作者：陈景峯
转载请与作者联系，同时请务必标明文章原始出处和作者信息及本声明。