You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/03/09 22:23:38 UTC
[jira] [Commented] (TRAFODION-2528) Classpath spec for
hadoop-hdfs-*.jar needs to be changed in Trafodion env
[ https://issues.apache.org/jira/browse/TRAFODION-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903973#comment-15903973 ]
ASF GitHub Bot commented on TRAFODION-2528:
-------------------------------------------
GitHub user sandhyasun opened a pull request:
https://github.com/apache/incubator-trafodion/pull/1002
Change file location of Hadoop hdfs jar file [TRAFODION-2528]
Some HDP installations d not have the directory /usr/hdp/current/hadoop-client/client .
Eg Hbase version 1.1.2.2.3.4.7-4
This caused errors when running Trafodion .
This could be the result of changes due to the following 2 JIRAs
https://issues.apache.org/jira/browse/HDFS-9815
https://issues.apache.org/jira/browse/HDFS-6200
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sandhyasun/incubator-trafodion r2.1_work
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-trafodion/pull/1002.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1002
----
commit 108530796f9d6af1d48763a729dabe629146a8c7
Author: Sandhya Sundaresan <sa...@apache.org>
Date: 2017-03-09T22:18:17Z
Change file location of Hadoop hdfs jar file
----
> Classpath spec for hadoop-hdfs-*.jar needs to be changed in Trafodion env
> --------------------------------------------------------------------------
>
> Key: TRAFODION-2528
> URL: https://issues.apache.org/jira/browse/TRAFODION-2528
> Project: Apache Trafodion
> Issue Type: Bug
> Components: sql-general
> Affects Versions: any
> Reporter: Sandhya Sundaresan
> Assignee: Sandhya Sundaresan
> Fix For: 2.1-incubating
>
>
> Certain HDP installations - eg HBase version 1.1.2.2.3.4.7-4 does not have the directory "/usr/hdp/current/hadoop-client/client/.
> Currently this is how the hadoop JARs are picked up for HDP.
> export HADOOP_JAR_FILES="/usr/hdp/current/hadoop-client/client/hadoop-hdfs-*.jar"
> SO in some installations this JAR isn't foudn and calls to HDFS interface fail with this kind of an error :
> *** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::addToHFile returned error HBASE_ADD_TO_HFILE_ERROR(-713). Cause: java.io.IOException: No FileSystem for scheme: hdfs
> org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2644)
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2651)
> org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92)
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687)
> org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669)
> org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371)
> org.apache.hadoop.fs.FileSystem.get(FileSystem.java:170)
> org.trafodion.sql.HBulkLoadClient.doCreateHFile(HBulkLoadClient.java:182)
> org.trafodion.sql.HBulkLoadClient.addToHFile(HBulkLoadClient.java:226).
> *** ERROR[1081] Loading of index TRAFODION.SEABASE.I failed unexpectedly.
> Need to change the path to the hadoop-hdfs.jar file to be :
> export HADOOP_JAR_FILES="/usr/hdp/current/hadoop-hdfs-client/hadoop-hdfs-*.jar
> This si related to changes made in this 2 JIRAs. At some point, the directory current/hadoop-client was dropped from the distribution.
> https://issues.apache.org/jira/browse/HDFS-9815
> https://issues.apache.org/jira/browse/HDFS-6200
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)