You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/25 03:31:00 UTC
[jira] [Work logged] (HIVE-27289) Check for proxy hosts with subnet in IP results in exception
[ https://issues.apache.org/jira/browse/HIVE-27289?focusedWorklogId=858833&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-858833 ]
ASF GitHub Bot logged work on HIVE-27289:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 25/Apr/23 03:30
Start Date: 25/Apr/23 03:30
Worklog Time Spent: 10m
Work Description: nrg4878 opened a new pull request, #4263:
URL: https://github.com/apache/hive/pull/4263
### What changes were proposed in this pull request?
In MetastoreServerUtils.checkUserHasHostProxyPrivileges(), the check is to see if hadoop.proxyuser* settings in core-site.xml allow this user to execute this. One of the arguments to this method is an IpAddress that it is being executed on, which is fetched from HMSHandler.getIpAddress(). However, when running schematool, this is never is set during initialization. In this case, because it is not HMS server, the SaslServer is not initialized.
When the core-site.xml has CIDR configurations, SubnetInfo.inRange() check throws an exception when the ip we are checking on in EMPTY.
So in case of schematool, try to use the hostaddress before resorting to empty ip address.
### Why are the changes needed?
HIVE-27289. To avoid exception during upgrades.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Manually.
Issue Time Tracking
-------------------
Worklog Id: (was: 858833)
Remaining Estimate: 0h
Time Spent: 10m
> Check for proxy hosts with subnet in IP results in exception
> -------------------------------------------------------------
>
> Key: HIVE-27289
> URL: https://issues.apache.org/jira/browse/HIVE-27289
> Project: Hive
> Issue Type: Bug
> Components: Standalone Metastore
> Affects Versions: 4.0.0-alpha-2
> Reporter: Naveen Gangam
> Assignee: Naveen Gangam
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> When running schematool for sysdb setup in a kerberized environment, the check to see if the user is a super user fails when the hadoop.proxyuser.hive.hosts contains a subnet in IPAddresses. (for example: 192.168.0.3/23)
> {noformat}
> exec /opt/cloudera/parcels/CDH-7.1.8-1.cdh7.1.8.p11.35002917/lib/hadoop/bin/hadoop jar /opt/cloudera/parcels/CDH-7.1.8-1.cdh7.1.8.p11.35002917/lib/hive/lib/hive-cli-3.1.3000.7.1.8.11-3.jar org.apache.hive.beeline.schematool.HiveSchemaTool -verbose -dbType hive -metaDbType mysql -initOrUpgradeSchema
> WARNING: Use "yarn jar" to launch YARN applications.
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.8-1.cdh7.1.8.p11.35002917/jars/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.8-1.cdh7.1.8.p11.35002917/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
> Hive Session ID = 93d863d8-cbe6-47fc-8817-49074841f9f1
> WARNING: An illegal reflective access operation has occurred
> WARNING: Illegal reflective access by org.apache.hadoop.hive.common.StringInternUtils (file:/opt/cloudera/parcels/CDH-7.1.8-1.cdh7.1.8.p11.35002917/jars/hive-common-3.1.3000.7.1.8.11-3.jar) to field java.net.URI.string
> WARNING: Please consider reporting this to the maintainers of org.apache.hadoop.hive.common.StringInternUtils
> WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
> WARNING: All illegal access operations will be denied in a future release
> 23/04/22 12:01:38 ERROR metastore.HiveMetaStoreAuthorizer: [main]: HiveMetaStoreAuthorizer.onEvent(): failed
> java.lang.IllegalArgumentException: Could not parse []
> at org.apache.commons.net.util.SubnetUtils.toInteger(SubnetUtils.java:287) ~[commons-net-3.6.jar:3.6]
> at org.apache.commons.net.util.SubnetUtils.access$400(SubnetUtils.java:27) ~[commons-net-3.6.jar:3.6]
> at org.apache.commons.net.util.SubnetUtils$SubnetInfo.isInRange(SubnetUtils.java:125) ~[commons-net-3.6.jar:3.6]
> at org.apache.hadoop.util.MachineList.includes(MachineList.java:155) ~[hadoop-common-3.1.1.7.1.8.11-3.jar:?]
> at org.apache.hadoop.hive.metastore.utils.MetaStoreUtils.checkUserHasHostProxyPrivileges(MetaStoreUtils.java:1347) ~[hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.isSuperUser(HiveMetaStoreAuthorizer.java:495) ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.skipAuthorization(HiveMetaStoreAuthorizer.java:558) ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.onEvent(HiveMetaStoreAuthorizer.java:104) [hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:4026) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_database_req(HiveMetaStore.java:1695) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
> at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
> at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at com.sun.proxy.$Proxy43.get_database_req(Unknown Source) [?:?]
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1946) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1930) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
> at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
> at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:213) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at com.sun.proxy.$Proxy44.getDatabase(Unknown Source) [?:?]
> at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:2161) [hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.session.HiveSessionImpl.configureSession(HiveSessionImpl.java:296) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:188) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.session.SessionManager.createSession(SessionManager.java:480) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:420) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.CLIService.openSession(CLIService.java:190) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:499) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:341) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:1006) [hive-jdbc-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:313) [hive-jdbc-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) [hive-jdbc-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at java.sql.DriverManager.getConnection(DriverManager.java:677) [java.sql:?]
> at java.sql.DriverManager.getConnection(DriverManager.java:228) [java.sql:?]
> at org.apache.hadoop.hive.metastore.tools.schematool.HiveSchemaHelper.getConnectionToMetastore(HiveSchemaHelper.java:88) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.tools.schematool.HiveSchemaHelper.getConnectionToMetastore(HiveSchemaHelper.java:103) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.CDHMetaStoreSchemaInfo.getMetaStoreSchemaVersion(CDHMetaStoreSchemaInfo.java:345) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.tools.schematool.SchemaToolTaskInitOrUpgrade.execute(SchemaToolTaskInitOrUpgrade.java:41) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.tools.schematool.MetastoreSchemaTool.run(MetastoreSchemaTool.java:454) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.beeline.schematool.HiveSchemaTool.main(HiveSchemaTool.java:138) [hive-beeline-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
> at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
> at org.apache.hadoop.util.RunJar.run(RunJar.java:318) [hadoop-common-3.1.1.7.1.8.11-3.jar:?]
> at org.apache.hadoop.util.RunJar.main(RunJar.java:232) [hadoop-common-3.1.1.7.1.8.11-3.jar:?]
> 23/04/22 12:01:38 ERROR metastore.HiveMetaStoreAuthorizer: [main]: HiveMetaStoreAuthorizer.onEvent(): failed
> java.lang.IllegalArgumentException: Could not parse []
> at org.apache.commons.net.util.SubnetUtils.toInteger(SubnetUtils.java:287) ~[commons-net-3.6.jar:3.6]
> at org.apache.commons.net.util.SubnetUtils.access$400(SubnetUtils.java:27) ~[commons-net-3.6.jar:3.6]
> at org.apache.commons.net.util.SubnetUtils$SubnetInfo.isInRange(SubnetUtils.java:125) ~[commons-net-3.6.jar:3.6]
> at org.apache.hadoop.util.MachineList.includes(MachineList.java:155) ~[hadoop-common-3.1.1.7.1.8.11-3.jar:?]
> at org.apache.hadoop.hive.metastore.utils.MetaStoreUtils.checkUserHasHostProxyPrivileges(MetaStoreUtils.java:1347) ~[hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.isSuperUser(HiveMetaStoreAuthorizer.java:495) ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.skipAuthorization(HiveMetaStoreAuthorizer.java:558) ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.onEvent(HiveMetaStoreAuthorizer.java:104) [hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:4026) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_database_req(HiveMetaStore.java:1695) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
> at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
> at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at com.sun.proxy.$Proxy43.get_database_req(Unknown Source) [?:?]
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1946) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1930) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
> at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
> at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:213) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at com.sun.proxy.$Proxy44.getDatabase(Unknown Source) [?:?]
> at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:2161) [hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.session.HiveSessionImpl.configureSession(HiveSessionImpl.java:296) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:188) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.session.SessionManager.createSession(SessionManager.java:480) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:420) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.CLIService.openSession(CLIService.java:190) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:499) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:341) [hive-service-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:1006) [hive-jdbc-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:313) [hive-jdbc-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) [hive-jdbc-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at java.sql.DriverManager.getConnection(DriverManager.java:677) [java.sql:?]
> at java.sql.DriverManager.getConnection(DriverManager.java:228) [java.sql:?]
> at org.apache.hadoop.hive.metastore.tools.schematool.HiveSchemaHelper.getConnectionToMetastore(HiveSchemaHelper.java:88) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.tools.schematool.HiveSchemaHelper.getConnectionToMetastore(HiveSchemaHelper.java:103) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.CDHMetaStoreSchemaInfo.getMetaStoreSchemaVersion(CDHMetaStoreSchemaInfo.java:345) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.tools.schematool.SchemaToolTaskInitOrUpgrade.execute(SchemaToolTaskInitOrUpgrade.java:41) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hadoop.hive.metastore.tools.schematool.MetastoreSchemaTool.run(MetastoreSchemaTool.java:454) [hive-standalone-metastore-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at org.apache.hive.beeline.schematool.HiveSchemaTool.main(HiveSchemaTool.java:138) [hive-beeline-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
> at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
> at org.apache.hadoop.util.RunJar.run(RunJar.java:318) [hadoop-common-3.1.1.7.1.8.11-3.jar:?]
> at org.apache.hadoop.util.RunJar.main(RunJar.java:232) [hadoop-common-3.1.1.7.1.8.11-3.jar:?]
> 23/04/22 12:01:38 ERROR metastore.RetryingHMSHandler: [main]: MetaException(message:Could not parse [])
> at org.apache.hadoop.hive.ql.security.authorization.plugin.metastore.HiveMetaStoreAuthorizer.onEvent(HiveMetaStoreAuthorizer.java:110)
> at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:4026)
> at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_database_req(HiveMetaStore.java:1695)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
> at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
> at com.sun.proxy.$Proxy43.get_database_req(Unknown Source)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1946)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1930)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:213)
> at com.sun.proxy.$Proxy44.getDatabase(Unknown Source)
> at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:2161)
> at org.apache.hive.service.cli.session.HiveSessionImpl.configureSession(HiveSessionImpl.java:296)
> at org.apache.hive.service.cli.session.HiveSessionImpl.open(HiveSessionImpl.java:188)
> at org.apache.hive.service.cli.session.SessionManager.createSession(SessionManager.java:480)
> at org.apache.hive.service.cli.session.SessionManager.openSession(SessionManager.java:420)
> at org.apache.hive.service.cli.CLIService.openSession(CLIService.java:190)
> at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:499)
> at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:341)
> at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:1006)
> at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:313)
> at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107)
> at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
> at java.sql/java.sql.DriverManager.getConnection(DriverManager.java:228)
> at org.apache.hadoop.hive.metastore.tools.schematool.HiveSchemaHelper.getConnectionToMetastore(HiveSchemaHelper.java:88)
> at org.apache.hadoop.hive.metastore.tools.schematool.HiveSchemaHelper.getConnectionToMetastore(HiveSchemaHelper.java:103)
> at org.apache.hadoop.hive.metastore.CDHMetaStoreSchemaInfo.getMetaStoreSchemaVersion(CDHMetaStoreSchemaInfo.java:345)
> at org.apache.hadoop.hive.metastore.tools.schematool.SchemaToolTaskInitOrUpgrade.execute(SchemaToolTaskInitOrUpgrade.java:41)
> at org.apache.hadoop.hive.metastore.tools.schematool.MetastoreSchemaTool.run(MetastoreSchemaTool.java:454)
> at org.apache.hive.beeline.schematool.HiveSchemaTool.main(HiveSchemaTool.java:138)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
> {noformat}
> The root cause being HiveMetaStoreAuthorizer.isSuperUser()
> String ipAddress = HiveMetaStore.HMSHandler.getIPAddress();
> --> this is null is kerberized environments when running from something like schematool (and perhaps metatool as well).
> when you have a CIDR representation in the IPAddress, then SubnetInfo.isInRange("") throws the above exception.
> So in such cases, it is better to use the localhost address before resorting to "".
--
This message was sent by Atlassian Jira
(v8.20.10#820010)