[jira] [Created] (PHOENIX-5868) Failed to write replication wal position

["luodx (Jira)" <ji...@apache.org>]

luodx created PHOENIX-5868:
------------------------------

             Summary: Failed to write replication wal position
                 Key: PHOENIX-5868
                 URL: https://issues.apache.org/jira/browse/PHOENIX-5868
             Project: Phoenix
          Issue Type: Bug
          Components: core
    Affects Versions: 4.15.0
         Environment: apache-phoenix-4.15.0-HBase-1.5
            Reporter: luodx


In the case where I used phoenix for write performance tests, it was very easy for hregionserver to die.

I turned on replication for tables, index tables did not, wrote data using phoneix, and hbase regionserver went down after running for a while.

 

regionserver log:

2020-04-20 19:22:49,531 FATAL [main-EventThread.replicationSource,1.replicationSource.a2-test-regionserver-52-23.sh%2C16020%2C1587378758523,1] regionserver.HRegionServe 
r: ABORTING region server a2- test-regionserver-52-23.sh,16020,1587378758523: Failed to write replication wal position (filename=a2-test-regionserver-52-23.sh%2C16020%2C 
1587378758523.1587381739689, position=3388929) 
org.apache.zookeeper. KeeperException$NoNodeException: KeeperErrorCode = NoNode for /hbase/replication/rs/a2-test-regionserver-52-23.sh,16020,1587378758523/1/a2-test-reg 
ionserver-52-23.sh%2C16020%2C1587378758523. 1587381739689 
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) 
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1327) 
at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.setData(RecoverableZooKeeper.java:510) 
at org.apache.hadoop.hbase.zookeeper.ZKUtil .setData(ZKUtil.java:867) 
at org.apache.hadoop.hbase.zookeeper.ZKUtil.setData(ZKUtil.java:917) 
at org.apache.hadoop.hbase.zookeeper.ZKUtil.setData(ZKUtil.java:911 ) 
at org.apache.hadoop.hbase.replication.ReplicationQueuesZKImpl.setLogPosition(ReplicationQueuesZKImpl.java:155) 
at org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceManager.logPositionAndCleanOldLogs(ReplicationSourceManager.java:197)
at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource$ReplicationSourceShipperThread.updateLogPosition(ReplicationSource.java:791) 
at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource$ReplicationSourceShipperThread.shipEdits(ReplicationSource.java:762) 
at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource$ReplicationSourceShipperThread.run(ReplicationSource.java:601)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)