You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by "hejian1@tuhu.cn" <he...@tuhu.cn> on 2022/06/07 04:56:19 UTC

Bug : Hive LB based on zookeeper occured some probability of connect failured

This is my first time to feedback questions at apache hive,Not very familiar with the ways of how to submit a question.I want to know whether hive-developer have received my questions or not? Generally how long i can get the replies?



hejian1@tuhu.cn
 
发件人: hejian1@tuhu.cn
发送时间: 2022-06-07 12:25
收件人: user-subscribe
主题: Bug : Hive LB based on zookeeper occured some probability of connect failured
Hello,hive-developers ,I hope your help sincerely!!
(1) I set LB properties  in hive-site.xml
hive.server2.support.dynamic.service.discovery=true
hive.server2.active.passive.ha.enable=false
 (2) My hive product cluster info 
hive  version: Apache 3.1.2
hadoop version: Apache 3.1.4
zookeeper version: Apache 3.5.9
URL:  jdbc:hive2://host1:2181,host2:2181,host3:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
my hive cluster have 3 hiveserver2 :  host1:10000,host2:10000,host3:10000
(3)when use beeline -u '${URL}'  -n 'hive' -p 'xxxx'  at hive client host, some probability of connect failured or connect success.
After lots of test connect ,i find when connect success,it can connect anyone of 3 hiveserver2 randomly and successfully. When i connect anyone using hostX:10000 singly,they are all OK.
(4)When connect Failed,failed logs  as following

22/06/07 11:14:59 INFO X509Util: Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
22/06/07 11:14:59 INFO ClientCnxnSocket: jute.maxbuffer value is 4194304 Bytes
22/06/07 11:14:59 INFO ClientCnxn: zookeeper.request.timeout value is 0. feature enabled=
22/06/07 11:14:59 INFO ClientCnxn: Opening socket connection to server host3/10.2.52.73:2181. Will not attempt to authenticate using SASL (unknown error)
22/06/07 11:14:59 INFO ClientCnxn: Socket connection established, initiating session, client: /10.2.52.110:61210, server: sh1-bigdata-master03/10.2.52.73:2181
22/06/07 11:14:59 INFO ClientCnxn: Session establishment complete on server host3/10.2.52.73:2181, sessionid = 0x301b42644c8001c, negotiated timeout = 60000
22/06/07 11:14:59 INFO ConnectionStateManager: State change: CONNECTED
22/06/07 11:14:59 INFO CuratorFrameworkImpl: backgroundOperationsLoop exiting
22/06/07 11:14:59 INFO ZooKeeper: Session: 0x301b42644c8001c closed
22/06/07 11:14:59 INFO ClientCnxn: EventThread shut down for session: 0x301b42644c8001c
Error: org.apache.hive.jdbc.ZooKeeperHiveClientException: Unable to read HiveServer2 configs from ZooKeeper (state=,code=0)
Beeline version 3.1.2 by Apache Hive



hejian1@tuhu.cn

回复: Bug : Hive LB based on zookeeper occured some probability of connect failured

Posted by "eabour@163.com" <ea...@163.com>.
I think you should use zk client `ls /` to confirm whether the `hiveserver2 ` path exists, only connect to host3/10.2.52.73:2181.



eabour@163.com
 
发件人: hejian1@tuhu.cn
发送时间: 2022-06-07 12:56
收件人: user
主题: Bug : Hive LB based on zookeeper occured some probability of connect failured

This is my first time to feedback questions at apache hive,Not very familiar with the ways of how to submit a question.I want to know whether hive-developer have received my questions or not? Generally how long i can get the replies?



hejian1@tuhu.cn
 
发件人: hejian1@tuhu.cn
发送时间: 2022-06-07 12:25
收件人: user-subscribe
主题: Bug : Hive LB based on zookeeper occured some probability of connect failured
Hello,hive-developers ,I hope your help sincerely!!
(1) I set LB properties  in hive-site.xml
hive.server2.support.dynamic.service.discovery=true
hive.server2.active.passive.ha.enable=false
 (2) My hive product cluster info 
hive  version: Apache 3.1.2
hadoop version: Apache 3.1.4
zookeeper version: Apache 3.5.9
URL:  jdbc:hive2://host1:2181,host2:2181,host3:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
my hive cluster have 3 hiveserver2 :  host1:10000,host2:10000,host3:10000
(3)when use beeline -u '${URL}'  -n 'hive' -p 'xxxx'  at hive client host, some probability of connect failured or connect success.
After lots of test connect ,i find when connect success,it can connect anyone of 3 hiveserver2 randomly and successfully. When i connect anyone using hostX:10000 singly,they are all OK.
(4)When connect Failed,failed logs  as following

22/06/07 11:14:59 INFO X509Util: Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
22/06/07 11:14:59 INFO ClientCnxnSocket: jute.maxbuffer value is 4194304 Bytes
22/06/07 11:14:59 INFO ClientCnxn: zookeeper.request.timeout value is 0. feature enabled=
22/06/07 11:14:59 INFO ClientCnxn: Opening socket connection to server host3/10.2.52.73:2181. Will not attempt to authenticate using SASL (unknown error)
22/06/07 11:14:59 INFO ClientCnxn: Socket connection established, initiating session, client: /10.2.52.110:61210, server: sh1-bigdata-master03/10.2.52.73:2181
22/06/07 11:14:59 INFO ClientCnxn: Session establishment complete on server host3/10.2.52.73:2181, sessionid = 0x301b42644c8001c, negotiated timeout = 60000
22/06/07 11:14:59 INFO ConnectionStateManager: State change: CONNECTED
22/06/07 11:14:59 INFO CuratorFrameworkImpl: backgroundOperationsLoop exiting
22/06/07 11:14:59 INFO ZooKeeper: Session: 0x301b42644c8001c closed
22/06/07 11:14:59 INFO ClientCnxn: EventThread shut down for session: 0x301b42644c8001c
Error: org.apache.hive.jdbc.ZooKeeperHiveClientException: Unable to read HiveServer2 configs from ZooKeeper (state=,code=0)
Beeline version 3.1.2 by Apache Hive



hejian1@tuhu.cn