You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mrql.apache.org by Apache Wiki <wi...@apache.org> on 2013/04/22 21:02:39 UTC
[Mrql Wiki] Update of "GettingStarted" by LeonidasFegaras
Dear Wiki user,
You have subscribed to a wiki page or wiki category on "Mrql Wiki" for change notification.
The "GettingStarted" page has been changed by LeonidasFegaras:
http://wiki.apache.org/mrql/GettingStarted
New page:
= Getting Started with MRQL =
== MRQL: Installation Instructions ==
Apache MRQL can run in two modes: in Map-Reduce mode using [[http://hadoop.apache.org/|Apache Hadoop]]
and in BSP mode (Bulk Synchronous Parallel mode) using [[http://hama.apache.org/|Apache Hama]].
The BSP mode is currently experimental and lacks any fault-tolerance (if an error occurs, the entire job must be restarted).
The MRQL map-reduce mode has been tested on Hadoop !MapReduce releases 1.0.1, and 1.0.3.
You can download the latest tarball from [[http://hadoop.apache.org/mapreduce/|Apache Hadoop]].
The BSP mode is optional. It has been tested on Hama 0.5.0. It does not work correctly on Hama 0.6.*.
You can download the latest tarball from [[http://hama.apache.org/|Apache Hama]].
The following instructions assume that you have already installed Hadoop MapReduce
and you have deployed it on your cluster successfully.
Otherwise, follow the directions in
[[http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/|Running Hadoop On Ubuntu Linux]].
A necessary change is to replace the JAVA_HOME in {{{conf/hadoop-env.sh}}} to point to your Java installation directory.
=== How to install MRQL ===
Download the latest MRQL release and extract the files.
The jar files {{{mrql.jar}}} and {{{mrql-bsp.jar}}} contain the code for MRQL !MapReduce and BSP, respectively.
They can be run using the scripts {{{bin/mrql}}} and {{{bin/mrql.bsp}}}.
=== How to run MRQL on a Hadoop MapReduce cluster: ===
* Change the first lines of {{{Makefile}}} and {{{bin/mrql}}} to point to your directories. One of these directories must be your existing Hadoop configuration directory.
* To validate your installation, run {{{make validate_hadoop}}}.
For a real test, run the [[Pagerank|PageRank example]] or the [[Kmeans|k-means clustering example]] on a small Hadoop !MapReduce cluster.
=== How to run MRQL on a Hama cluster: ===
* Follow the instructions in [[http://hama.apache.org/getting_started_with_hama.html|Getting Started with Hama]] to set up and start Hama.
* Change the first lines of {{{Makefile}}} and {{{bin/mrql.bsp}}} to point to your directories. One of these directories must be your existing Hama configuration directory.
* To validate your installation, run {{{make validate_hama}}}.
For a real test, run the [[Pagerank|PageRank example]] or the [[Kmeans|k-means clustering example]] on a Hama cluster.
=== How to Recompile MRQL ===
You may use either {{{make}}} or {{{ant}}}. Change the first lines of {{{Makefile}}} and {{{build.xml}}} to point to your directories.
{{{make}}} or {{{ant}}} rebuilds the {{{lib/mrql.jar}}}.
{{{make bsp}}} or {{{ant bsp}}} rebuilds the {{{lib/mrql-bsp.jar}}}.