You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mrql.apache.org by Apache Wiki <wi...@apache.org> on 2015/02/10 15:37:24 UTC
[Mrql Wiki] Update of "GettingStarted" by LeonidasFegaras
Dear Wiki user,
You have subscribed to a wiki page or wiki category on "Mrql Wiki" for change notification.
The "GettingStarted" page has been changed by LeonidasFegaras:
https://wiki.apache.org/mrql/GettingStarted?action=diff&rev1=14&rev2=15
Comment:
update release numbers
Apache MRQL can run in 4 modes: in Map-Reduce mode using [[http://hadoop.apache.org/|Apache Hadoop]],
in BSP mode (Bulk Synchronous Parallel mode) using [[http://hama.apache.org/|Apache Hama]],
- in Spark mode using [[http://spark.apache.org/|Apache Spark]], and in Flink mode using [[http://flink.incubator.apache.org|Apache Flink]] (only in MRQL-0.9.4-incubating).
+ in Spark mode using [[http://spark.apache.org/|Apache Spark]], and in Flink mode using [[http://flink.apache.org|Apache Flink]] (only in MRQL-0.9.4-incubating).
- The latest stable MRQL version, MRQL-0.9.2-incubating, is compatible with the following Apache releases:
+ The latest stable MRQL version, MRQL-0.9.4-incubating, is compatible with the following Apache releases:
The MRQL !MapReduce mode is compatible with Apache Hadoop releases 1.x and 2.x (Yarn).
You can download the Hadoop tarball from [[http://hadoop.apache.org/releases.html|Apache Hadoop]].
The BSP and Spark modes are optional. The BSP mode is compatible with Apache Hama 0.6.2, 0.6.3, and 0.6.4.
You can download the latest tarball from [[http://hama.apache.org/|Apache Hama]].
- The Spark mode is compatible with Apache Spark 1.0.0 and 1.0.2.
+ The Spark mode is compatible with Apache Spark 1.0.0 through 1.2.0.
You can download the latest tarball prebuilt for Hadoop1 or Hadoop2 from [[http://spark.apache.org/|Apache Spark]].
+ The Flink mode is compatible with Apache Flink 0.6-incubating through 0.8.0 in local and Yarn modes.
+ You can download the latest tarball prebuilt for Hadoop2 from [[http://flink.apache.org/downloads.html|Apache Flink]].
The following instructions assume that you have already installed Hadoop !MapReduce
and you have deployed it on your cluster successfully.
@@ -22, +24 @@
=== How to install MRQL ===
Download the latest stable MRQL binary release from [[http://www.apache.org/dyn/closer.cgi/incubator/mrql]] and extract the files.
- The scripts {{{bin/mrql}}}, {{{bin/mrql.bsp}}}, and {{{bin/mrql.spark}}} evaluate MRQL queries in Hadoop, Hama, and Spark modes, respectively.
+ The scripts {{{bin/mrql}}}, {{{bin/mrql.bsp}}}, {{{bin/mrql.spark}}}, and {{{bin/mrql.flink}}} evaluate MRQL queries in Hadoop, Hama, Spark, and Flink modes, respectively.
=== How to run MRQL on a Hadoop MapReduce cluster: ===
@@ -51, +53 @@
=== How to run MRQL in Flink mode on a Yarn cluster: ===
- First, start the Flink application manager on Yarn using {{{${FLINK_HOME}/bin/yarn-session.sh -n #_of_nodes}}} (see [[http://flink.incubator.apache.org/docs/0.6-incubating/yarn_setup.html|Yarn Setup]]).
+ First, start the Flink application manager on Yarn using {{{${FLINK_HOME}/bin/yarn-session.sh -n #_of_nodes}}} (see [[http://flink.apache.org/docs/0.8/yarn_setup.html|Yarn Setup]]).
The run the [[Pagerank|PageRank example]] or the [[Kmeans|k-means clustering example]] using the {{{bin/mrql.flink}}} script.
=== How to Recompile MRQL ===
@@ -75, +77 @@
mvn -DskipTests=false clean install
}}}
- which runs the queries in {{{tests/queries}}} in memory, local Hadoop mode, local Hama mode, and local Spark mode.
+ which runs the queries in {{{tests/queries}}} in memory, local Hadoop mode, local Hama mode, local Spark mode, and local Flink mode.
- Currently, the "mvn install" builds MRQL with Hadoop 1.2.1, Hama 0.6.3, and Spark 1.0.0.
+ Currently, the "mvn install" builds MRQL with Hadoop 1.2.1, Hama 0.6.4, Spark 1.2.0, and Flink 0.8.0.
To build MRQL on some other Hadoop 1.x, such as 1.0.3, use:
{{{
@@ -87, +89 @@
To build MRQL on Hadoop 2.x (yarn) use:
{{{
- mvn -Pyarn -Dyarn.version=2.2.0 -Dhadoop.version=1.2.1 clean install
+ mvn -Dyarn -Dyarn.version=2.2.0 -Dhadoop.version=1.2.1 clean install
}}}