You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Joep Rottinghuis (JIRA)" <ji...@apache.org> on 2011/02/14 23:17:57 UTC

[jira] Commented: (HIVE-1992) NCDFE: o.a.commons/configuration/Configuration with Hadoop 0.20.100

    [ https://issues.apache.org/jira/browse/HIVE-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12994527#comment-12994527 ] 

Joep Rottinghuis commented on HIVE-1992:
----------------------------------------

Applied patch (to update README indicating source of jar).
Added jar to lib directory.
However, I did NOT update the ivy/librarties.properties as it seems that no Hive code itself has direct dependency on commons-configuration as of 0.6.

Unchanged ivy/libraries.properties:
{code}
#These are the versions of our dependencies (in alphabetical order)
apacheant.version=1.7.1
ant-task.version=2.0.10
checkstyle.version=5.0
commons-cli.version=2.0
commons-codec.version=1.3
commons-collections.version=3.2.1
commons-lang.version=2.4
commons-logging.version=1.0.4
commons-logging-api.version=1.0.4
jdom.version=1.1
ivy.version=2.1.0
log4j.version=1.2.15
{code}

Not sure what other people's take on this is (having a library in lib directory without entry in ivy file).

> NCDFE: o.a.commons/configuration/Configuration with Hadoop 0.20.100
> -------------------------------------------------------------------
>
>                 Key: HIVE-1992
>                 URL: https://issues.apache.org/jira/browse/HIVE-1992
>             Project: Hive
>          Issue Type: Bug
>          Components: CLI
>    Affects Versions: 0.6.0
>         Environment: Red Hat 2.6.18
>            Reporter: Joep Rottinghuis
>             Fix For: 0.6.0
>
>         Attachments: commons-configuration-1.6.jar, hive-1992.patch
>
>
> When compiling Hive against Hadoop 0.20.100 all tests and CLI commands fail with NoClassDefFoundError: org/apache/commons/configuration/Configuration (see log output example below):
> Hadoop classes depend on commons.configuration which is not available on classpath with Hive 0.6.
> Sample test case failure (one of many):
> {code}
> test:
>     [junit] Running org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore
>     [junit] Unable to open the metastore
>     [junit] java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration
>     [junit] 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<init>(DefaultMetricsSystem.java:37)
>     [junit] 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<clinit>(DefaultMetricsSystem.java:34)
>     [junit] 	at org.apache.hadoop.security.UgiInstrumentation.create(UgiInstrumentation.java:51)
>     [junit] 	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:196)
>     [junit] 	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:159)
>     [junit] 	at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:216)
>     [junit] 	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:409)
>     [junit] 	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:395)
>     [junit] 	at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1418)
>     [junit] 	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1319)
>     [junit] 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
>     [junit] 	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:183)
>     [junit] 	at org.apache.hadoop.hive.metastore.Warehouse.getFs(Warehouse.java:72)
>     [junit] 	at org.apache.hadoop.hive.metastore.Warehouse.getDnsPath(Warehouse.java:104)
>     [junit] 	at org.apache.hadoop.hive.metastore.Warehouse.getWhRoot(Warehouse.java:119)
> {code}
> As with HIVE-1990, I first applied HIVE-1264 and tweaked the build.properties to compile Hive against locally built Hadoop 0.20.100 (see HADOOP-7108).

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira