[jira] [Created] (MRQL-27) Improve the build process and support hadoop 0.20.x

["Leonidas Fegaras (JIRA)" <ji...@apache.org>]

Leonidas Fegaras created MRQL-27:
------------------------------------

             Summary: Improve the build process and support hadoop 0.20.x
                 Key: MRQL-27
                 URL: https://issues.apache.org/jira/browse/MRQL-27
             Project: MRQL
          Issue Type: Improvement
            Reporter: Leonidas Fegaras
            Assignee: Leonidas Fegaras
            Priority: Critical


The attached patch improves the MRQL build process in many ways:
1) it now supports hadoop 0.20.x. It uses the new extra source directory src/main/java/MultipleInputs, which was taken from hadoop 1.x sources, because 0.20.x didn't support MultipleInputs.
2) it corrects the classpath for hadoop 2.x (yarn).
3) it changes the scripts bin/mrql and bin/mrql.bsp to build a single jar file that contains all classes. This was done because in some cases the hadoop/hama -libjar parameter does not work correctly in distributed mode.

Currently, the "mvn install" builds MRQL with Hadoop 1.2.1, Hama 0.6.3, and Spark 0.8.1-incubating.
To build MRQL on some other Hadoop 1.x, such as 1.0.3, use:
mvn -Dhadoop.version=1.0.3 install
To build MRQL on Hadoop 2.x (yarn) use:
mvn -Pyarn -Dyarn.version=2.2.0 -Dhadoop.version=1.2.1 install
To build MRQL on Hadoop 0.20.x use:
mvn -PMultipleInputs -Dhadoop.version=0.20.2 install




--
This message was sent by Atlassian JIRA
(v6.1.5#6160)