You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Kengo Seki (Jira)" <ji...@apache.org> on 2022/05/10 14:35:00 UTC
[jira] [Commented] (BIGTOP-3680) HBase smoke test fails on ppc64le
[ https://issues.apache.org/jira/browse/BIGTOP-3680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17534369#comment-17534369 ]
Kengo Seki commented on BIGTOP-3680:
------------------------------------
Currently, [JRuby 1.7.23 is used|https://github.com/apache/bigtop/blob/01b3dbe89819b70fb664d56f5cea3de428789193/bigtop-packages/src/common/hbase/do-component-build#L38] on ppc64le instead of [9.2.13.0|https://github.com/apache/hbase/blob/rel/2.4.11/pom.xml#L1484].
But it seems to cause the error in question.
{code}
jenkins@bigtop1slave:/tmp/bigtop/provisioner/docker$ ./docker-hadoop.sh -d -k hdfs,hbase -r http://repos.bigtop.apache.org/releases/3.1.0/centos/7/ppc64le -c 1
...
jenkins@bigtop1slave:/tmp/bigtop/provisioner/docker$ docker exec -it 20220510_140855_r29689_bigtop_1 bash
[root@cea164d58683 /]# . /usr/lib/bigtop-utils/bigtop-detect-javahome
[root@cea164d58683 /]# echo $JAVA_HOME
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.322.b06-1.el7_9.ppc64le
[root@cea164d58683 /]# hbase shell
OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hbase/lib/client-facing-thirdparty/slf4j-reload4j-1.7.33.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
TypeError: nil is not a string
private at org/jruby/RubyModule.java:2253
Table at file:/usr/lib/hbase/lib/hbase-shell-2.4.11.jar!/hbase/table.rb:846
Hbase at file:/usr/lib/hbase/lib/hbase-shell-2.4.11.jar!/hbase/table.rb:29
(root) at file:/usr/lib/hbase/lib/hbase-shell-2.4.11.jar!/hbase/table.rb:27
require at org/jruby/RubyKernel.java:1040
(root) at /usr/lib/hbase/lib/ruby/jruby-complete-1.7.23.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:1
require at /usr/lib/hbase/lib/ruby/jruby-complete-1.7.23.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:54
require at org/jruby/RubyKernel.java:1040
(root) at file:/usr/lib/hbase/lib/hbase-shell-2.4.11.jar!/hbase/hbase.rb:25
(root) at /usr/lib/hbase/lib/ruby/jruby-complete-1.7.23.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:1
require at org/jruby/RubyKernel.java:1040
require at /usr/lib/hbase/lib/ruby/jruby-complete-1.7.23.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:54
(root) at classpath:jar-bootstrap.rb:143
{code}
It seems to be avoided by replacing JRuby with 9.2.13.0.
{code}
[root@cea164d58683 /]# curl -sLO https://repo1.maven.org/maven2/org/jruby/jruby-dist/9.2.13.0/jruby-dist-9.2.13.0-bin.tar.gz
[root@cea164d58683 /]# tar xf jruby-dist-9.2.13.0-bin.tar.gz
[root@cea164d58683 /]# export JRUBY_HOME=/jruby-9.2.13.0
[root@cea164d58683 /]# hbase shell
OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/lib/hbase/lib/client-facing-thirdparty/slf4j-reload4j-1.7.33.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
HBase Shell
Use "help" to get list of supported commands.
Use "exit" to quit this interactive shell.
For Reference, please visit: http://hbase.apache.org/2.0/book.html#shell
Version 2.4.11, rUnknown, Mon May 9 09:59:40 UTC 2022
Took 0.0146 seconds
hbase:001:0>
{code}
> HBase smoke test fails on ppc64le
> ---------------------------------
>
> Key: BIGTOP-3680
> URL: https://issues.apache.org/jira/browse/BIGTOP-3680
> Project: Bigtop
> Issue Type: Bug
> Components: hbase, ppc64le, tests
> Reporter: Kengo Seki
> Priority: Major
> Fix For: 3.1.0
>
>
> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.1.0-smoke-tests/26/COMPONENTS=hdfs.hbase@hbase,OS=fedora-35-ppc64le-deploy/console
> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.1.0-smoke-tests/26/COMPONENTS=hdfs.hbase@hbase,OS=ubuntu-18.04-ppc64el-deploy/console
> https://ci.bigtop.apache.org/view/Test/job/Bigtop-3.1.0-smoke-tests/27/COMPONENTS=hdfs.hbase@hbase,OS=ubuntu-20.04-ppc64el-deploy/console
> {code}
> org.apache.bigtop.itest.hbase.smoke.TestHBaseBalancer > testBalancer STANDARD_OUT
> Failed command: balance_switch true
> error code: 1
> stdout: []
> stderr: [/usr/lib/hadoop/libexec/hadoop-functions.sh: line 2381: HADOOP_ORG.APACHE.HADOOP.HBASE.UTIL.GETJAVAPROPERTY_USER: invalid variable name, /usr/lib/hadoop/libexec/hadoop-functions.sh: line 2346: HADOOP_ORG.APACHE.HADOOP.HBASE.UTIL.GETJAVAPROPERTY_USER: invalid variable name, /usr/lib/hadoop/libexec/hadoop-functions.sh: line 2441: HADOOP_ORG.APACHE.HADOOP.HBASE.UTIL.GETJAVAPROPERTY_OPTS: invalid variable name, OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release, SLF4J: Class path contains multiple SLF4J bindings., SLF4J: Found binding in [jar:file:/usr/lib/hbase/lib/client-facing-thirdparty/slf4j-reload4j-1.7.33.jar!/org/slf4j/impl/StaticLoggerBinder.class], SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class], SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation., SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory], TypeError: nil is not a string, private at org/jruby/RubyModule.java:2253, Table at file:/usr/lib/hbase/lib/hbase-shell-2.4.11.jar!/hbase/table.rb:846, Hbase at file:/usr/lib/hbase/lib/hbase-shell-2.4.11.jar!/hbase/table.rb:29, (root) at file:/usr/lib/hbase/lib/hbase-shell-2.4.11.jar!/hbase/table.rb:27, require at org/jruby/RubyKernel.java:1040, (root) at /usr/lib/hbase/lib/ruby/jruby-complete-1.7.23.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:1, require at /usr/lib/hbase/lib/ruby/jruby-complete-1.7.23.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:54, require at org/jruby/RubyKernel.java:1040, (root) at file:/usr/lib/hbase/lib/hbase-shell-2.4.11.jar!/hbase/hbase.rb:25, (root) at /usr/lib/hbase/lib/ruby/jruby-complete-1.7.23.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:1, require at org/jruby/RubyKernel.java:1040, require at /usr/lib/hbase/lib/ruby/jruby-complete-1.7.23.jar!/META-INF/jruby.home/lib/ruby/shared/rubygems/core_ext/kernel_require.rb:54, (root) at classpath:jar-bootstrap.rb:143]
> org.apache.bigtop.itest.hbase.smoke.TestHBaseBalancer > testBalancer FAILED
> java.lang.AssertionError
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at org.junit.Assert$assertTrue.callStatic(Unknown Source)
> at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:55)
> at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:196)
> at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:208)
> at org.apache.bigtop.itest.hbase.smoke.TestHBaseBalancer.testBalancer(TestHBaseBalancer.groovy:40)
> Gradle Test Executor 2 finished executing tests.
> > Task :bigtop-tests:smoke-tests:hbase:test FAILED
> 17 tests completed, 1 failed, 4 skipped
> {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)