[CONF] Apache Lucene Mahout > canopy-commandline

[co...@apache.org]

Space: Apache Lucene Mahout (http://cwiki.apache.org/confluence/display/MAHOUT)
Page: canopy-commandline (http://cwiki.apache.org/confluence/display/MAHOUT/canopy-commandline)

Added by Isabel Drost:
---------------------------------------------------------------------
h1. Introduction

This quick start page describes how to run the meanshift canopy clustering algorithm on a Hadoop cluster.

h1. Steps

h2. Testing it on one single machine w/o cluster

In the examples directory type:
{code}
mvn -q exec:java -Dexec.mainClass="org.apache.mahout.clustering.meanshift.MeanShiftCanopyJob" -Dexec.args="<OPTIONS>"
{code}

h2. Running it on the cluster

* In $MAHOUT_HOME/, build the jar containing the job (mvn install) The job will be generated in $MAHOUT_HOME/core/target/ and it's name will contain the Mahout version number. For example, when using Mahout 0.1 release, the job will be mahout-core-0.1.jar
* (Optional) 1 Start up Hadoop: $HADOOP_HOME/bin/start-all.sh
* Put the data: $HADOOP_HOME/bin/hadoop fs -put <PATH TO DATA> testdata
* Run the Job: $HADOOP_HOME/bin/hadoop jar $MAHOUT_HOME/core/target/mahout-core-<MAHOUT VERSION>.job org.apache.mahout.clustering.meanshift.MeanShiftCanopyJob <OPTIONS>
* Get the data out of HDFS and have a look. Use bin/hadoop fs -lsr output to view all outputs.

h1. Command line options
{code}
org.apache.mahout.clustering.meanshift.MeanShiftCanopyJob

  --input (-i) input                          The Path for input Vectors. Must be a SequenceFile of Writable, Vector.
  --output (-o) output                        The directory pathname for output points.
  --distanceClass (-d) distanceClass          The distance measure class name.
  --help (-h)                                 Print out help.
  --convergencedelta (-v) convergenceDelta    The convergence delta value.
  --threshold_1 (-t1) threshold_1             The T1 distance threshold.
  --maxIter (-x) maxIter                      The maximum number of iterations.
  --threshold_2 (-t2) threshold_2             The T1 distance threshold.
{code}

{code}
org.apache.mahout.clustering.meanshift.MeanShiftCanopyDriver
  --input (-i) input                          The Path for input Vectors.       
  --output (-o) output                        The directory pathname for output points.                           
  --distanceClass (-d) distanceClass          The distance measure class name.
  --help (-h)                                 Print out help.
  --convergencedelta (-v) convergenceDelta    The convergence delta value.
  --threshold_1 (-t1) threshold_1             The T1 distance threshold.
  --threshold_2 (-t2) threshold_2             The T1 distance threshold.
{code}

Change your notification preferences: http://cwiki.apache.org/confluence/users/viewnotifications.action