[CONF] Apache Lucene Mahout > dirichlet-commandline

[co...@apache.org]

Space: Apache Lucene Mahout (http://cwiki.apache.org/confluence/display/MAHOUT)
Page: dirichlet-commandline (http://cwiki.apache.org/confluence/display/MAHOUT/dirichlet-commandline)

Added by Isabel Drost:
---------------------------------------------------------------------

h1. Introduction

This quick start page describes how to run the dirichlet based clustering algorithm on a Hadoop cluster.

h1. Steps

h2. Testing it on one single machine w/o cluster

In the examples directory type:

mvn -q exec:java -Dexec.mainClass="org.apache.mahout.clustering.dirichlet.DirichleJob" -Dexec.args="<OPTIONS>"

h2. Running it on the cluster

* In $MAHOUT_HOME/, build the jar containing the job (mvn install) The job will be generated in $MAHOUT_HOME/core/target/ and it's name will contain the Mahout version number. For example, when using Mahout 0.1 release, the job will be mahout-core-0.1.jar
* (Optional) 1 Start up Hadoop: $HADOOP_HOME/bin/start-all.sh
* Put the data: $HADOOP_HOME/bin/hadoop fs -put <PATH TO DATA> testdata
* Run the Job: $HADOOP_HOME/bin/hadoop jar $MAHOUT_HOME/core/target/mahout-core-<MAHOUT VERSION>.job org.apache.mahout.clustering.dirichlet.DirichletJob <OPTIONS>
* Get the data out of HDFS and have a look. Use bin/hadoop fs -lsr output to view all outputs.

h1. Command line options
{code}
org.apache.mahout.clustering.dirichlet.DirichletJob

  --input (-i) input              The Path for input Vectors. Must be a SequenceFile of Writable, Vector.
  --output (-o) output            The directory pathname for output points.
  --modelClass (-d) modelClass    The ModelDistribution class name.
  --maxIter (-x) maxIter          The maximum number of iterations.
  --alpha (-m) alpha              The alpha0 value for the DirichletDistribution.
  --numModels (-k) numModels      The number of models.
  --help (-h)                     Print out help.
{code}

{code}
org.apache.mahout.clustering.dirichlet.DirichletDriver



{code}

Change your notification preferences: http://cwiki.apache.org/confluence/users/viewnotifications.action