[jira] [Commented] (TRAFODION-1521) Trafodion build should not require HBase to be installed

["Hans Zeller (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TRAFODION-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14954099#comment-14954099 ] 

Hans Zeller commented on TRAFODION-1521:
----------------------------------------

The fix will do several things:

To address issue #1, it will add a new script, core/sqf/sql/scripts/get_libhdfs_files. The new script will download Google Protocol Buffers 2.5.0 and a source tar file for Hadoop and build protobuf-2.5.0 and the Hadoop native libraries. It will then copy the libraries (libhadoop.so and libhdfs.so) to $MY_SQROOT/export/lib${SQ_MBTYPE}. It will also copy the include file hdfs.h to $MY_SQROOG/include. Since this step is very time-consuming, it will take a shortcut if Hadoop is installed (e.g. with install_local_hadoop), in that case it will copy the existing native libraries.

To address the remaining needs for jar files during the build, the hbasetmlib2 build will be converted to Maven.

We will also remove the case in sqenvcom.sh where a configuration does not have install_local_hadoop, Cloudera, Hortonworks or MapR installed, but has a TOOLSDIR. Such cases should use the recently added case for a native Apache Hadoop installation or the case where no HBase installation is found. That last case will print out a reminder that can be ignored.

> Trafodion build should not require HBase to be installed
> --------------------------------------------------------
>
>                 Key: TRAFODION-1521
>                 URL: https://issues.apache.org/jira/browse/TRAFODION-1521
>             Project: Apache Trafodion
>          Issue Type: Bug
>          Components: sql-general
>    Affects Versions: 1.1 (pre-incubation)
>         Environment: Any
>            Reporter: Hans Zeller
>              Labels: build
>             Fix For: 1.2-incubating
>
>   Original Estimate: 96h
>  Remaining Estimate: 96h
>
> When we build Trafodion in a source tree, it should not be necessary to install HBase first.
> Until now, several build steps relied on an HBase installation:
> 1. Files in core/sql/executor include the libhdfs header file, hdfs.h. This file isn't available in the Trafodion source tree.
> 2. When we link certain executables like mxosrvr and sqlci, we specify -lhdfs, requiring the libhdfs.so DLL as well as the DLLs it depends on, libhadoop.so and libjvm.so.
> 3. Until recently, executor Java (core/sql/executor) files were compiled with javac invocations from a Makefile, requiring the HBase client jar files in the CLASSPATH. This got changed with TRAFODION-1502.
> 4. I missed some more Java files in the fix for TRAFODION-1502: core/sqf/src/seatrans/tm/hbasetmlib2. Those should also be moved to Maven.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)