You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Michael Smith (Jira)" <ji...@apache.org> on 2022/11/14 21:26:00 UTC

[jira] [Created] (IMPALA-11724) Ozone tests fail after CDP build number update

Michael Smith created IMPALA-11724:
--------------------------------------

             Summary: Ozone tests fail after CDP build number update
                 Key: IMPALA-11724
                 URL: https://issues.apache.org/jira/browse/IMPALA-11724
             Project: IMPALA
          Issue Type: Bug
            Reporter: Michael Smith


After IMPALA-11524, the test custom_cluster.test_custom_hive_configs.TestCustomHiveConfigs.test_ctas_read_write_consistence fails when run with Ozone because the hive server fails to come up
{code}
common/custom_cluster_test_suite.py:150: in setup_method
    self._start_hive_service(method.func_dict[HIVE_CONF_DIR])
common/custom_cluster_test_suite.py:248: in _start_hive_service
    raise RuntimeError("Unable to start Hive")
E   RuntimeError: Unable to start Hive{code}

Hive server logs show
{code}
java.lang.RuntimeException: Error applying authorization policy on hive configuration: VOLUME_NOT_FOUND org.apache.hadoop.ozone.om.exceptions.OMException: Volume tmp is not found
	at org.apache.hive.service.cli.CLIService.init(CLIService.java:121) ~[hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hive.service.CompositeService.init(CompositeService.java:59) ~[hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hive.service.server.HiveServer2.init(HiveServer2.java:247) ~[hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:1152) [hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hive.service.server.HiveServer2.access$1400(HiveServer2.java:144) [hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:1454) [hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:1267) [hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_352]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_352]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_352]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_352]
	at org.apache.hadoop.util.RunJar.run(RunJar.java:318) [hadoop-common-3.1.1.7.2.16.0-233.jar:?]
	at org.apache.hadoop.util.RunJar.main(RunJar.java:232) [hadoop-common-3.1.1.7.2.16.0-233.jar:?]
Caused by: java.lang.RuntimeException: VOLUME_NOT_FOUND org.apache.hadoop.ozone.om.exceptions.OMException: Volume tmp is not found
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:755) ~[hive-exec-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:690) ~[hive-exec-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hive.service.cli.CLIService.applyAuthorizationConfigPolicy(CLIService.java:133) ~[hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hive.service.cli.CLIService.init(CLIService.java:118) ~[hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	... 12 more
Caused by: org.apache.hadoop.ozone.om.exceptions.OMException: Volume tmp is not found
	at org.apache.hadoop.ozone.om.protocolPB.OzoneManagerProtocolClientSideTranslatorPB.handleError(OzoneManagerProtocolClientSideTranslatorPB.java:696) ~[ozone-filesystem-hadoop3-1.3.0.7.2.16.0-233.jar:?]
	at org.apache.hadoop.ozone.om.protocolPB.OzoneManagerProtocolClientSideTranslatorPB.getVolumeInfo(OzoneManagerProtocolClientSideTranslatorPB.java:404) ~[ozone-filesystem-hadoop3-1.3.0.7.2.16.0-233.jar:?]
	at org.apache.hadoop.ozone.client.rpc.RpcClient.getVolumeDetails(RpcClient.java:503) ~[ozone-filesystem-hadoop3-1.3.0.7.2.16.0-233.jar:?]
	at org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.getBucket(BasicRootedOzoneClientAdapterImpl.java:294) ~[ozone-filesystem-hadoop3-1.3.0.7.2.16.0-233.jar:?]
	at org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.getBucket(BasicRootedOzoneClientAdapterImpl.java:239) ~[ozone-filesystem-hadoop3-1.3.0.7.2.16.0-233.jar:?]
	at org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.createDirectory(BasicRootedOzoneClientAdapterImpl.java:469) ~[ozone-filesystem-hadoop3-1.3.0.7.2.16.0-233.jar:?]
	at org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.mkdir(BasicRootedOzoneFileSystem.java:824) ~[ozone-filesystem-hadoop3-1.3.0.7.2.16.0-233.jar:?]
	at org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.mkdirs(BasicRootedOzoneFileSystem.java:835) ~[ozone-filesystem-hadoop3-1.3.0.7.2.16.0-233.jar:?]
	at org.apache.hadoop.hive.ql.exec.Utilities.createDirsWithPermission(Utilities.java:3991) ~[hive-exec-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hadoop.hive.ql.exec.Utilities.ensurePathIsWritable(Utilities.java:5030) ~[hive-exec-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hadoop.hive.ql.session.SessionState.createRootHDFSDir(SessionState.java:878) ~[hive-exec-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hadoop.hive.ql.session.SessionState.createSessionDirs(SessionState.java:819) ~[hive-exec-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:731) ~[hive-exec-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:690) ~[hive-exec-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hive.service.cli.CLIService.applyAuthorizationConfigPolicy(CLIService.java:133) ~[hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	at org.apache.hive.service.cli.CLIService.init(CLIService.java:118) ~[hive-service-3.1.3000.7.2.16.0-233.jar:3.1.3000.7.2.16.0-233]
	... 12 more
{code}

It looks like the build of Hive being used here requires a pre-release version of Ozone.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org