You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mrql.apache.org by Apache Wiki <wi...@apache.org> on 2013/04/22 21:02:39 UTC

[Mrql Wiki] Update of "GettingStarted" by LeonidasFegaras

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Mrql Wiki" for change notification.

The "GettingStarted" page has been changed by LeonidasFegaras:
http://wiki.apache.org/mrql/GettingStarted

New page:
= Getting Started with MRQL =

== MRQL: Installation Instructions ==

Apache MRQL can run in two modes: in Map-Reduce mode using [[http://hadoop.apache.org/|Apache Hadoop]]
and in BSP mode (Bulk Synchronous Parallel mode) using [[http://hama.apache.org/|Apache Hama]].
The BSP mode is currently experimental and lacks any fault-tolerance (if an error occurs, the entire job must be restarted).

The MRQL map-reduce mode has been tested on Hadoop !MapReduce releases 1.0.1, and 1.0.3. 
You can download the latest tarball from [[http://hadoop.apache.org/mapreduce/|Apache Hadoop]].
The BSP mode is optional. It has been tested on Hama 0.5.0. It does not work correctly on Hama 0.6.*.
You can download the latest tarball from [[http://hama.apache.org/|Apache Hama]].

The following instructions assume that you have already installed Hadoop MapReduce
and you have deployed it on your cluster successfully.
Otherwise, follow the directions in
[[http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/|Running Hadoop On Ubuntu Linux]].
A necessary change is to replace the JAVA_HOME in {{{conf/hadoop-env.sh}}} to point to your Java installation directory.

=== How to install MRQL ===

Download the latest MRQL release and extract the files.
The jar files {{{mrql.jar}}} and {{{mrql-bsp.jar}}} contain the code for MRQL !MapReduce and BSP, respectively.
They can be run using the scripts {{{bin/mrql}}} and {{{bin/mrql.bsp}}}.

=== How to run MRQL on a Hadoop MapReduce cluster: ===

 * Change the first lines of {{{Makefile}}} and {{{bin/mrql}}} to point to your directories. One of these directories must be your existing Hadoop configuration directory.

 * To validate your installation, run {{{make validate_hadoop}}}.

For a real test, run the [[Pagerank|PageRank example]] or the [[Kmeans|k-means clustering example]] on a small Hadoop !MapReduce cluster.

=== How to run MRQL on a Hama cluster: ===

 * Follow the instructions in [[http://hama.apache.org/getting_started_with_hama.html|Getting Started with Hama]] to set up and start Hama.

 * Change the first lines of {{{Makefile}}} and {{{bin/mrql.bsp}}} to point to your directories. One of these directories must be your existing Hama configuration directory.

 * To validate your installation, run {{{make validate_hama}}}.

For a real test, run the [[Pagerank|PageRank example]] or the [[Kmeans|k-means clustering example]] on a Hama cluster.

=== How to Recompile MRQL ===

You may use either {{{make}}} or {{{ant}}}. Change the first lines of {{{Makefile}}} and {{{build.xml}}} to point to your directories.
{{{make}}} or {{{ant}}} rebuilds the {{{lib/mrql.jar}}}.
{{{make bsp}}} or {{{ant bsp}}} rebuilds the {{{lib/mrql-bsp.jar}}}.