You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@zookeeper.apache.org by "maoling (Jira)" <ji...@apache.org> on 2020/08/05 02:34:00 UTC
[jira] [Commented] (ZOOKEEPER-3906) Data Inconsistency Between
Zookeeper Leader and zookeeper Followers
[ https://issues.apache.org/jira/browse/ZOOKEEPER-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171234#comment-17171234 ]
maoling commented on ZOOKEEPER-3906:
------------------------------------
[~gangasai42642]
Any other info? it's not easy for us to diagnose this issue. The *Error* info you provided are all *INFO* level.
> Data Inconsistency Between Zookeeper Leader and zookeeper Followers
> -------------------------------------------------------------------
>
> Key: ZOOKEEPER-3906
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3906
> Project: ZooKeeper
> Issue Type: Bug
> Components: quorum
> Affects Versions: 3.5.7
> Reporter: Gangadhar
> Priority: Major
>
> *Issue*: Data Inconsistency Between Zookeeper Leader and zookeeper Followers. zookeeper followers and zookeeper leaders have other information. We try to delete the information from the follower's, but information not present in zookeeper leader, it's throwing error like *Node does not exist:*
> *Expected behaviour:* Data consistency between zookeeper leader and Zookeeper followers should be same.
>
> Steps followed as part of troubleshooting:
> We have 5 zookeepers in clusters.
> *Step1:* verified all zookeepers are following the leader or not?. As per below information its following all 4 zookeepers to zookeeper leader
> zk_version 3.5.7-f0fdd52973d373ffd9c86b81d99842dc2c7f660e, built on 02/11/2020 11:30 GMT
> zk_avg_latency 0
> zk_max_latency 823
> zk_min_latency 0
> zk_packets_received 30214264
> zk_packets_sent 32424272
> zk_num_alive_connections 7
> zk_outstanding_requests 0
> zk_server_state leader
> zk_znode_count 75190
> zk_watch_count 21394
> zk_ephemerals_count 793
> zk_approximate_data_size 24706628
> zk_open_file_descriptor_count 281
> zk_max_file_descriptor_count 4096
> zk_followers 4
> zk_synced_followers 4
> zk_pending_syncs 0
> zk_last_proposal_size 166
> zk_max_proposal_size 121947
> zk_min_proposal_size 32
> *Step 2:* Verified znode in all the zookeepers , but we are not getting same information from zookeeper leader and followers.
> *Step 3:* Try to delete the Zookeeper node and received below error. Also, we are suspecting that when trying to delete the info of znode, it's trying to reach zookeeper leader and throwing *Node does not exist* error.
> *Error:*
> 14:04:54.769 [main] INFO org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 10485760 Bytes
> 14:04:54.775 [main] INFO org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=
> 14:04:54.824 [main-SendThread(11.111.226.146:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server 11-111-226-146.ebiz.verizon.com/11.111.226.146:2181. Will not attempt to authenticate using SASL (unknown error)
> 14:04:54.831 [main-SendThread(11.111.226.146:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /11.111.225.75:38804, server: 11-111-226-146.ebiz.verizon.com/11.111.20.146:2181
> 14:04:54.835 [main-SendThread(11.111.226.146:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server 11-111-226-146.ebiz.verizon.com/11.111.226.146:2181, sessionid = 0x500001bbbeb0651, negotiated timeout = 20000
> WATCHER::
> WatchedEvent state:SyncConnected type:None path:null
> *Node does not exist: /namespace/$tenant/$Namespace/$zk-path*
--
This message was sent by Atlassian Jira
(v8.3.4#803005)