You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by Valencia Serrao <vs...@us.ibm.com> on 2016/04/25 12:23:47 UTC
Issues with generating testdata for Impala
Hi,
I'm trying to execute the front end tests for Impala. I tried ti generate
the testdata using the command: ${IMPALA_HOME}/buildall.sh -noclean
-testdata -format. However, it fails with the following error:
**********************************************************************************************************************************************************************************************************************
Running mvn package
Directory: /root/Impala/testdata
========================================================================
[WARNING] Could not transfer metadata
com.cloudera.cdh:cdh-root:5.8.0-SNAPSHOT/maven-metadata.xml from/to $
{distMgmtSnapshotsId} (${distMgmtSnapshotsUrl}): No connector available to
access repository ${distMgmtSnapshotsId} (${distMgmtSnapshotsUrl}) of type
default using the available factories WagonRepositoryConnectorFactory
[INFO] BUILD SUCCESS
------------------------------------------------------------------------
/root/Impala/testdata/target
SUCCESS, data generated into /root/Impala/testdata/target
Loading Hive Builtins (logging to load-hive-builtins.log)... OK
Generating HBase data (logging to create-hbase.log)... FAILED
'/root/Impala/testdata/bin/create-hbase.sh' failed. Tail of log:
Log for command '/root/Impala/testdata/bin/create-hbase.sh'
16/04/25 15:45:09 INFO Configuration.deprecation: hadoop.native.lib is
deprecated. Instead, use io.native.lib.available
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/root/Impala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/root/ImpalaPrerequisites/hadoop-2.6.0-cdh5.5.1/src/hadoop-dist/target/hadoop-2.6.0-cdh5.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
NativeException: java.io.IOException:
java.lang.reflect.InvocationTargetException
initialize
at /root/mpala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT//lib/ruby/hbase/hbase.rb:42
(root)
at /root/Impala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT//bin/hirb.rb:130
16/04/25 15:45:14 INFO Configuration.deprecation: hadoop.native.lib is
deprecated. Instead, use io.native.lib.available
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/root/Impala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/root/ImpalaPrerequisites/hadoop-2.6.0-cdh5.5.1/src/hadoop-dist/target/hadoop-2.6.0-cdh5.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
NativeException: java.io.IOException:
java.lang.reflect.InvocationTargetException
initialize
at /root/Impala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT//lib/ruby/hbase/hbase.rb:42
(root)
at /root/Impala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT//bin/hirb.rb:130
Error in /root/Impala/testdata/bin/create-load-data.sh at line 41: while
[ -n "$*" ]
Error in /root/Impala/buildall.sh at line 368: $
{IMPALA_HOME}/testdata/bin/create-load-data.sh ${CREATE_LOAD_DATA_ARGS} <<<
Y
***************************************************************************************************************************************************************************************************************************
Kindly guide me on this issue.
Regards,
Valencia
Re: Issues with generating testdata for Impala
Posted by Alex Behm <al...@cloudera.com>.
Hi Valencia,
hard to say what's going on without access to the cluster logs, but it's
quite likely some of your services did not come up.
One thing I'd strongly recommend is to use consistent versions of the
Hadoop components, especially HDFS, Hive and HBase. In your setup you seem
to have HBase CDH5.8-SNAPSHOT, but HDFS CDH 5.5.1, It "might" work, but
it's not a setup we typically use in our Impala dev environment.
I'd recommend poking around in the cluster_logs to see if some services
failed to start, or any other more detailed info.
Alex
On Mon, Apr 25, 2016 at 3:23 AM, Valencia Serrao <vs...@us.ibm.com> wrote:
>
>
> Hi,
>
> I'm trying to execute the front end tests for Impala. I tried ti generate
> the testdata using the command: ${IMPALA_HOME}/buildall.sh -noclean
> -testdata -format. However, it fails with the following error:
>
>
> **********************************************************************************************************************************************************************************************************************
> Running mvn package
> Directory: /root/Impala/testdata
> ========================================================================
> [WARNING] Could not transfer metadata
> com.cloudera.cdh:cdh-root:5.8.0-SNAPSHOT/maven-metadata.xml from/to $
> {distMgmtSnapshotsId} (${distMgmtSnapshotsUrl}): No connector available to
> access repository ${distMgmtSnapshotsId} (${distMgmtSnapshotsUrl}) of type
> default using the available factories WagonRepositoryConnectorFactory
> [INFO] BUILD SUCCESS
> ------------------------------------------------------------------------
>
> /root/Impala/testdata/target
> SUCCESS, data generated into /root/Impala/testdata/target
> Loading Hive Builtins (logging to load-hive-builtins.log)... OK
> Generating HBase data (logging to create-hbase.log)... FAILED
> '/root/Impala/testdata/bin/create-hbase.sh' failed. Tail of log:
> Log for command '/root/Impala/testdata/bin/create-hbase.sh'
> 16/04/25 15:45:09 INFO Configuration.deprecation: hadoop.native.lib is
> deprecated. Instead, use io.native.lib.available
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
>
> [jar:file:/root/Impala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
>
> [jar:file:/root/ImpalaPrerequisites/hadoop-2.6.0-cdh5.5.1/src/hadoop-dist/target/hadoop-2.6.0-cdh5.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> NativeException: java.io.IOException:
> java.lang.reflect.InvocationTargetException
> initialize
> at
> /root/mpala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT//lib/ruby/hbase/hbase.rb:42
> (root)
> at /root/Impala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT//bin/hirb.rb:130
> 16/04/25 15:45:14 INFO Configuration.deprecation: hadoop.native.lib is
> deprecated. Instead, use io.native.lib.available
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
>
> [jar:file:/root/Impala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
>
> [jar:file:/root/ImpalaPrerequisites/hadoop-2.6.0-cdh5.5.1/src/hadoop-dist/target/hadoop-2.6.0-cdh5.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> NativeException: java.io.IOException:
> java.lang.reflect.InvocationTargetException
> initialize
> at
> /root/Impala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT//lib/ruby/hbase/hbase.rb:42
> (root)
> at /root/Impala/thirdparty/hbase-1.2.0-cdh5.8.0-SNAPSHOT//bin/hirb.rb:130
> Error in /root/Impala/testdata/bin/create-load-data.sh at line 41: while
> [ -n "$*" ]
> Error in /root/Impala/buildall.sh at line 368: $
> {IMPALA_HOME}/testdata/bin/create-load-data.sh ${CREATE_LOAD_DATA_ARGS} <<<
> Y
>
> ***************************************************************************************************************************************************************************************************************************
>
>
> Kindly guide me on this issue.
>
> Regards,
> Valencia
>