You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "Suresh Subbiah (JIRA)" <ji...@apache.org> on 2015/10/08 06:35:27 UTC
[jira] [Assigned] (TRAFODION-1512) Build infrastructure -
install_local_hadoop using incorrect download package
[ https://issues.apache.org/jira/browse/TRAFODION-1512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Subbiah reassigned TRAFODION-1512:
-----------------------------------------
Assignee: Roberta Marton
> Build infrastructure - install_local_hadoop using incorrect download package
> ----------------------------------------------------------------------------
>
> Key: TRAFODION-1512
> URL: https://issues.apache.org/jira/browse/TRAFODION-1512
> Project: Apache Trafodion
> Issue Type: Bug
> Components: Build Infrastructure
> Affects Versions: 1.2-incubating
> Environment: Installing local hadoop when the pregenerated tools repository is not available.
> Reporter: Roberta Marton
> Assignee: Roberta Marton
> Fix For: 1.2-incubating
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Much of Trafodion is written in C++ and use C++ to make calls to HDFS API's. Therefore, anyone building Trafodion must download a Hadoop version that contain native library binaries.
> Trafodion provides a convenience script, called install_local_hadoop, that sets up the Hadoop eco-system that can be used to build and test the product. This script downloads Cloudera based versions of Hadoop and HBase. In addition, install_local_hadoop allows you to specify a environment variable called MY_LOCAL_SW_DIST where you can store tar files for these products. So when you run install_local_hadoop, it gets the tar files from the location specified in MY_LOCAL_SW_DIST thereby not requiring a download from the web.
> If MY_LOCAL_SW_DIST is not specified, install_local_hadoop downloads the files from hard coded locations. The hard coded location for Hadoop is: http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.5.0-cdh5.3.0.tar.gz. Unfortunately, this version no longer contains the native Hadoop libraries. When Trafodion is built, an error that the hdfs library is not found is returned.
> Many of the Trafodion contributors use the precreated files stored in MY_LOCAL_SW_DIST, therefore, we just cannot change the location in install_local_hadoop. It needs to be coordinated with Trafodion contributors who use a precreated directory called MY_LOCAL_SW_DIST.
> This JIRA has been written to resolve this issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)