You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Ayush Saxena (Jira)" <ji...@apache.org> on 2024/05/01 08:13:00 UTC
[jira] [Commented] (HIVE-28241) beeline does not connect to hive in kerberos environment hadoop3.3.6 hive3.1.3
[ https://issues.apache.org/jira/browse/HIVE-28241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842579#comment-17842579 ]
Ayush Saxena commented on HIVE-28241:
-------------------------------------
The supported hadoop version for hive 3.1.3 is 3.1.0
https://github.com/apache/hive/blob/rel/release-3.1.3/pom.xml#L150
Try with that, if you want to use Hadoop-3.3.6, the use Hive-4 release, that supports 3.3.6 hadoop
> beeline does not connect to hive in kerberos environment hadoop3.3.6 hive3.1.3
> -------------------------------------------------------------------------------
>
> Key: HIVE-28241
> URL: https://issues.apache.org/jira/browse/HIVE-28241
> Project: Hive
> Issue Type: Bug
> Components: Beeline
> Affects Versions: 3.1.3
> Reporter: manoj kumar
> Priority: Major
>
> 24/04/30 12:52:03 [main]: DEBUG security.HadoopThriftAuthBridge: Current authMethod = KERBEROS
> 24/04/30 12:52:03 [main]: DEBUG security.HadoopThriftAuthBridge: Not setting UGI conf as passed-in authMethod of kerberos = current.
> 24/04/30 12:52:03 [main]: DEBUG security.UserGroupInformation: PrivilegedAction [as: hive/mk2.example.com@JIO.COM (auth:KERBEROS)][action: org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Client$1@61a1ea2c]
> java.lang.Exception: null
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1896) [hadoop-common-3.3.6.jar:?]
> at org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Client.createClientTransport(HadoopThriftAuthBridge.java:234) [hive-exec-3.1.3.jar:3.1.3]
> at org.apache.hive.service.auth.KerberosSaslHelper.getKerberosTransport(KerberosSaslHelper.java:56) [hive-service-3.1.3.jar:3.1.3]
> at org.apache.hive.jdbc.HiveConnection.createBinaryTransport(HiveConnection.java:601) [hive-jdbc-3.1.3.jar:3.1.3]
> at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:341) [hive-jdbc-3.1.3.jar:3.1.3]
> at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:228) [hive-jdbc-3.1.3.jar:3.1.3]
> at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) [hive-jdbc-3.1.3.jar:3.1.3]
> at java.sql.DriverManager.getConnection(DriverManager.java:664) [?:1.8.0_371]
> at java.sql.DriverManager.getConnection(DriverManager.java:208) [?:1.8.0_371]
> at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:145) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:209) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.Commands.connect(Commands.java:1641) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.Commands.connect(Commands.java:1536) [hive-beeline-3.1.3.jar:3.1.3]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_371]
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_371]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_371]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371]
> at org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:56) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1384) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1423) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1287) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1071) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:538) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.main(BeeLine.java:520) [hive-beeline-3.1.3.jar:3.1.3]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_371]
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_371]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_371]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371]
> at org.apache.hadoop.util.RunJar.run(RunJar.java:328) [hadoop-common-3.3.6.jar:?]
> at org.apache.hadoop.util.RunJar.main(RunJar.java:241) [hadoop-common-3.3.6.jar:?]
> 24/04/30 12:52:03 [main]: DEBUG security.UserGroupInformation: PrivilegedAction [as: hive/mk2.example.com@JIO.COM (auth:KERBEROS)][action: org.apache.hadoop.hive.metastore.security.TUGIAssumingTransport$1@149debbb]
> java.lang.Exception: null
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1896) [hadoop-common-3.3.6.jar:?]
> at org.apache.hadoop.hive.metastore.security.TUGIAssumingTransport.open(TUGIAssumingTransport.java:48) [hive-exec-3.1.3.jar:3.1.3]
> at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:343) [hive-jdbc-3.1.3.jar:3.1.3]
> at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:228) [hive-jdbc-3.1.3.jar:3.1.3]
> at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) [hive-jdbc-3.1.3.jar:3.1.3]
> at java.sql.DriverManager.getConnection(DriverManager.java:664) [?:1.8.0_371]
> at java.sql.DriverManager.getConnection(DriverManager.java:208) [?:1.8.0_371]
> at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:145) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:209) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.Commands.connect(Commands.java:1641) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.Commands.connect(Commands.java:1536) [hive-beeline-3.1.3.jar:3.1.3]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_371]
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_371]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_371]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371]
> at org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:56) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1384) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1423) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1287) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1071) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:538) [hive-beeline-3.1.3.jar:3.1.3]
> at org.apache.hive.beeline.BeeLine.main(BeeLine.java:520) [hive-beeline-3.1.3.jar:3.1.3]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_371]
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_371]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_371]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_371]
> at org.apache.hadoop.util.RunJar.run(RunJar.java:328) [hadoop-common-3.3.6.jar:?]
> at org.apache.hadoop.util.RunJar.main(RunJar.java:241) [hadoop-common-3.3.6.jar:?]
> 24/04/30 12:52:03 [main]: DEBUG transport.TSaslTransport: opening transport org.apache.thrift.transport.TSaslClientTransport@25cd49a4
> 24/04/30 12:52:03 [main-EventThread]: INFO zookeeper.ClientCnxn: EventThread shut down
> 24/04/30 12:52:03 [main]: DEBUG transport.TSaslClientTransport: Sending mechanism name GSSAPI and initial response of length 621
> 24/04/30 12:52:03 [main]: DEBUG transport.TSaslTransport: CLIENT: Writing message with status START and payload length 6
> 24/04/30 12:52:03 [main]: DEBUG transport.TSaslTransport: CLIENT: Writing message with status OK and payload length 621
> 24/04/30 12:52:03 [main]: DEBUG transport.TSaslTransport: CLIENT: Start message handled
> 24/04/30 12:52:03 [main]: WARN jdbc.HiveConnection: Failed to connect to mk3.example.com:10000
> 24/04/30 12:52:03 [main]: INFO imps.CuratorFrameworkImpl: Starting
> 24/04/30 12:52:03 [main]: DEBUG curator.CuratorZookeeperClient: Starting
> 24/04/30 12:52:03 [main]: DEBUG curator.ConnectionState: Starting
> 24/04/30 12:52:03 [main]: DEBUG curator.ConnectionState: reset
> 24/04/30 12:52:03 [main]: INFO zookeeper.ZooKeeper: Initiating client connection, connectString=10.161.171.36:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@e9dc4d0
> 24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: INFO zookeeper.ClientCnxn: Opening socket connection to server 10.161.171.36/10.161.171.36:2181. Will not attempt to authenticate using SASL (unknown error)
> 24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: INFO zookeeper.ClientCnxn: Socket connection established to 10.161.171.36/10.161.171.36:2181, initiating session
> 24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: DEBUG zookeeper.ClientCnxn: Session establishment request sent on 10.161.171.36/10.161.171.36:2181
> 24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: INFO zookeeper.ClientCnxn: Session establishment complete on server 10.161.171.36/10.161.171.36:2181, sessionid = 0x300001b577d001d, negotiated timeout = 40000
> 24/04/30 12:52:03 [main-EventThread]: INFO state.ConnectionStateManager: State change: CONNECTED
> 24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: DEBUG zookeeper.ClientCnxn: Reading reply sessionid:0x300001b577d001d, packet:: clientPath:null serverPath:null finished:false header:: 1,12 replyHeader:: 1,12884902102,0 request:: '/hiveserver2,F response:: v\{'serverUri=mk5.example.com:10000;version=3.1.3;sequence=0000000004,'serverUri=mk1.example.com:10000;version=3.1.3;sequence=0000000006,'serverUri=mk3.example.com:10000;version=3.1.3;sequence=0000000005},s\{8589935031,8589935031,1714458097538,1714458097538,0,13,0,0,13,3,12884902062}
> 24/04/30 12:52:03 [main]: DEBUG imps.CuratorFrameworkImpl: Closing
> 24/04/30 12:52:03 [Curator-Framework-0]: INFO imps.CuratorFrameworkImpl: backgroundOperationsLoop exiting
> 24/04/30 12:52:03 [main]: DEBUG curator.CuratorZookeeperClient: Closing
> 24/04/30 12:52:03 [main]: DEBUG curator.ConnectionState: Closing
> 24/04/30 12:52:03 [main]: DEBUG zookeeper.ZooKeeper: Closing session: 0x300001b577d001d
> 24/04/30 12:52:03 [main]: DEBUG zookeeper.ClientCnxn: Closing client for session: 0x300001b577d001d
> 24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: DEBUG zookeeper.ClientCnxn: Reading reply sessionid:0x300001b577d001d, packet:: clientPath:null serverPath:null finished:false header:: 2,-11 replyHeader:: 2,12884902103,0 request:: null response:: null
> 24/04/30 12:52:03 [main-SendThread(10.161.171.36:2181)]: DEBUG zookeeper.ClientCnxn: An exception was thrown while closing send thread for session 0x300001b577d001d : Unable to read additional data from server sessionid 0x300001b577d001d, likely server has closed socket
> 24/04/30 12:52:03 [main]: DEBUG zookeeper.ClientCnxn: Disconnecting client for session: 0x300001b577d001d
> 24/04/30 12:52:03 [main]: INFO zookeeper.ZooKeeper: Session: 0x300001b577d001d closed
> 24/04/30 12:52:03 [main]: ERROR jdbc.Utils: Unable to read HiveServer2 configs from ZooKeeper
> 24/04/30 12:52:03 [main-EventThread]: INFO zookeeper.ClientCnxn: EventThread shut down
> Unknown HS2 problem when communicating with Thrift server.
> Error: Could not open client transport for any of the Server URI's in ZooKeeper: Peer indicated failure: Unsupported mechanism type GSSAPI (state=08S01,code=0)
> beeline>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)