You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2008/02/17 11:55:10 UTC

[Hadoop Wiki] Update of "Running Hadoop On Ubuntu Linux (Single-Node Cluster)" by ChristopheTaton

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The following page has been changed by ChristopheTaton:
http://wiki.apache.org/hadoop/Running_Hadoop_On_Ubuntu_Linux_%28Single-Node_Cluster%29

------------------------------------------------------------------------------
  
  = What we want to do =
  
- In this short tutorial, I will describe the required steps for setting up a single-node [http://lucene.apache.org/hadoop/ Hadoop] cluster using the [http://lucene.apache.org/hadoop/hdfs_design.html Hadoop Distributed File System (HDFS)] on [http://www.ubuntu.com/ Ubuntu Linux].
+ In this short tutorial, I will describe the required steps for setting up a single-node [http://hadoop.apache.org/core/ Hadoop] cluster using the [http://hadoop.apache.org/core/hdfs_design.html Hadoop Distributed File System (HDFS)] on [http://www.ubuntu.com/ Ubuntu Linux].
  
- [http://lucene.apache.org/hadoop/ Hadoop] is a framework written in Java for running applications on large clusters of commodity hardware and incorporates features similar to those of the [http://en.wikipedia.org/wiki/Google_File_System Google File System] and of [http://en.wikipedia.org/wiki/MapReduce MapReduce]. [http://lucene.apache.org/hadoop/hdfs_design.html HDFS] is a highly fault-tolerant distributed file system and like Hadoop designed to be deployed on low-cost hardware. It provides high throughput access to application data and is suitable for applications that have large data sets.
+ [http://hadoop.apache.org/core/ Hadoop] is a framework written in Java for running applications on large clusters of commodity hardware and incorporates features similar to those of the [http://en.wikipedia.org/wiki/Google_File_System Google File System] and of [http://en.wikipedia.org/wiki/MapReduce MapReduce]. [http://hadoop.apache.org/core/hdfs_design.html HDFS] is a highly fault-tolerant distributed file system and like Hadoop designed to be deployed on low-cost hardware. It provides high throughput access to application data and is suitable for applications that have large data sets.
  
  The main goal of this tutorial is to get a ''simple'' Hadoop installation up and running so that you can play around with the software and learn more about it.
  
  This tutorial has been tested with the following software versions:
  
   * [http://www.ubuntu.com/ Ubuntu Linux] 7.10, 7.04
-  * [http://lucene.apache.org/hadoop/ Hadoop] 0.14.2, released October 2007 (also works with 0.13.0)
+  * [http://hadoop.apache.org/core/ Hadoop] 0.14.2, released October 2007 (also works with 0.13.0)
  
  You can find the time of the last document update at the very bottom of this page.
  
@@ -161, +161 @@

  
  === hadoop-site.xml ===
  
- Any site-specific configuration of Hadoop is configured in {{{<HADOOP_INSTALL>/conf/hadoop-site.xml}}}. Here we will configure the directory where Hadoop will store its data files, the ports it listens to, etc. Our setup will use Hadoop's Distributed File System, [http://lucene.apache.org/hadoop/hdfs_design.html HDFS], even though our little "cluster" only contains our single local machine.
+ Any site-specific configuration of Hadoop is configured in {{{<HADOOP_INSTALL>/conf/hadoop-site.xml}}}. Here we will configure the directory where Hadoop will store its data files, the ports it listens to, etc. Our setup will use Hadoop's Distributed File System, [http://hadoop.apache.org/core/hdfs_design.html HDFS], even though our little "cluster" only contains our single local machine.
  
  You can leave the settings below as is with the exception of the {{{hadoop.tmp.dir}}} variable which you have to change to the directory of your choice, for example {{{/usr/local/hadoop-datastore/hadoop-${user.name}}}}. Hadoop will expand {{{${user.name}}}} to the system user which is running Hadoop, so in our case this will be {{{hadoop}}} and thus the final path will be {{{/usr/local/hadoop-datastore/hadoop-hadoop}}}.
  
@@ -212, +212 @@

  </configuration>
  }}}
  
- See GettingStartedWithHadoop and the documentation in [http://lucene.apache.org/hadoop/api/overview-summary.html Hadoop's API Overview] if you have any questions about Hadoop's configuration options.
+ See GettingStartedWithHadoop and the documentation in [http://hadoop.apache.org/core/api/overview-summary.html Hadoop's API Overview] if you have any questions about Hadoop's configuration options.
  
  == Formatting the name node ==
  
@@ -352, +352 @@

  
  === Copy local example data to HDFS ===
  
- Before we run the actual MapReduce job, we first have to copy the files from our local file system to Hadoop's [http://lucene.apache.org/hadoop/hdfs_design.html HDFS]. See ImportantConcepts for more information about this step.
+ Before we run the actual MapReduce job, we first have to copy the files from our local file system to Hadoop's [http://hadoop.apache.org/core/hdfs_design.html HDFS]. See ImportantConcepts for more information about this step.
  
  {{{
    hadoop@ubuntu:/usr/local/hadoop$ bin/hadoop dfs -copyFromLocal /tmp/gutenberg gutenberg