You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Masatake Iwasaki (Jira)" <ji...@apache.org> on 2025/05/25 14:13:00 UTC
[jira] [Commented] (BIGTOP-4432) Fix flaky smoke-test of Hive executing command before HiveServer2 is ready
[ https://issues.apache.org/jira/browse/BIGTOP-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17953918#comment-17953918 ]
Masatake Iwasaki commented on BIGTOP-4432:
------------------------------------------
HiveServer2 sleeps 60s if it fails to connect to HDFS on startup. Starting HiveServer2 after HDFS is ready should mitigate the issue.
{noformat}
2025-05-25T11:42:21,331 WARN [main] server.HiveServer2: Error starting HiveServer2 on attempt 1, will retry in 60000ms
java.lang.RuntimeException: Error applying authorization policy on hive configuration: java.net.ConnectException: Call From df7e4a3bc0d2.bigtop.apache.org/172.19.0.2 to df7e4a3bc0d2.bigtop.apache.org:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more detail\
s
see: http://wiki.apache.org/hadoop/ConnectionRefused
at org.apache.hive.service.cli.CLIService.init(CLIService.java:122) ~[hive-service-4.0.1.jar:4.0.1]
at org.apache.hive.service.CompositeService.init(CompositeService.java:59) ~[hive-service-4.0.1.jar:4.0.1]
at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:241) ~[hive-service-4.0.1.jar:4.0.1]
at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:1112) ~[hive-service-4.0.1.jar:4.0.1]
at org.apache.hive.service.server.HiveServer2.access$1500(HiveServer2.java:144) ~[hive-service-4.0.1.jar:4.0.1]
at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:1474) ~[hive-service-4.0.1.jar:4.0.1]
at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:1281) ~[hive-service-4.0.1.jar:4.0.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_452]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_452]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_452]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_452]
at org.apache.hadoop.util.RunJar.run(RunJar.java:328) ~[hadoop-common-3.3.6.jar:?]
at org.apache.hadoop.util.RunJar.main(RunJar.java:241) ~[hadoop-common-3.3.6.jar:?]
{noformat}
> Fix flaky smoke-test of Hive executing command before HiveServer2 is ready
> --------------------------------------------------------------------------
>
> Key: BIGTOP-4432
> URL: https://issues.apache.org/jira/browse/BIGTOP-4432
> Project: Bigtop
> Issue Type: Bug
> Reporter: Masatake Iwasaki
> Priority: Major
>
> smoke-tests of Hive intermittently fails due to "connection refused". Retrying the test succeeded after waiting for HiveServer2 startup.
> {noformat}
> org.apache.bigtop.itest.hive.TestHiveSmoke > test FAILED
> java.lang.AssertionError: Example hive count failed. [] [SLF4J: Class path contains multiple SLF4J bindings., SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/log4j-slf4j-impl-2.18.0.jar!/org/slf4j/impl/StaticLoggerBinder.class], SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-re\
> load4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class], SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation., SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory], SLF4J: Class path contains multiple SLF4J bindings., SLF4J: Found binding in\
> [jar:file:/usr/lib/hive/lib/log4j-slf4j-impl-2.18.0.jar!/org/slf4j/impl/StaticLoggerBinder.class], SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class], SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanat\
> ion., SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory], Connecting to jdbc:hive2://localhost:10000/default, 25/05/22 13:33:41 [main]: WARN jdbc.HiveConnection: Failed to connect to localhost:10000, Could not open connection to the HS2 server. Please check the server UR\
> I and if the URI is correct, then ask the administrator to check the server status. Enable verbose error messages (--verbose=true) for more information., Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/default: java.net.ConnectException: Connection refused (Connec\
> tion refused) (state=08S01,code=0)]
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert$assertTrue.callStatic(Unknown Source)
> at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:55)
> at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:196)
> at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:216)
> at org.apache.bigtop.itest.hive.TestHiveSmoke.test(TestHiveSimple.groovy:55)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)