You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2022/06/21 08:05:00 UTC

[jira] [Created] (IOTDB-3584) Write data for a long time (19 hours),IP_40010@group-000100000004 is in LEADER state but not ready yet

刘珍 created IOTDB-3584:
-------------------------

             Summary: Write data for a long time (19 hours),IP_40010@group-000100000004 is in LEADER state but not ready yet
                 Key: IOTDB-3584
                 URL: https://issues.apache.org/jira/browse/IOTDB-3584
             Project: Apache IoTDB
          Issue Type: Bug
          Components: mpp-cluster
    Affects Versions: 0.14.0-SNAPSHOT
            Reporter: 刘珍
            Assignee: Song Ziyang
         Attachments: image-2022-06-21-15-50-54-369.png

master_0620_3c88dfb
benchmark写入19小时,bm连接的datanode :
2022-06-21 11:46:05,486 [192.168.130.3_40010@group-000100000006-FollowerState] INFO  o.a.r.s.i.FollowerState:108 - 192.168.130.3_40010@group-000100000006-FollowerState: Skipping leader election since it stepped down recently (elapsed = 14682ms < waitTime = 30s)
2022-06-21 11:46:05,692 [null-request--thread1] INFO  o.a.r.g.s.GrpcClientProtocolService$UnorderedRequestStreamObserver:284 - Failed RaftClientRequest:client-6B295D30FFBC->192.168.130.3_40010@group-000100000004, cid=201437, seq=0, RW, Message:000d00000018726f6f74...(size=41220), reply=RaftClientReply:client-6B295D30FFBC->192.168.130.3_40010@group-000100000004, cid=201437, FAILED org.apache.ratis.protocol.exceptions.LeaderNotReadyException: 192.168.130.3_40010@group-000100000004{color:#DE350B}* is in LEADER state but not ready yet., *{color}logIndex=0, commits[192.168.130.3_40010:c400003, 192.168.130.4_40010:c400003, 192.168.130.5_40010:c400003]


{color:#DE350B}*metric监控的insertTablet延迟陡升*{color}
 !image-2022-06-21-15-50-54-369.png! 
FollowerState线程一直销毁,创建,销毁,且其cpu占用高。

复现流程
1. 192.168.130.3/4/5  16C32G
data_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
schema_region_consensus_protocol_class=org.apache.iotdb.consensus.standalone.StandAloneConsensus
schema_replication_factor=1
data_replication_factor=3

数据库路径:
/data3/cluster_test/master_0620_3c88dfb

2. benchmark 配置见附件
benchmark在192.168.130.2 /home/benchmark/bm_0527_e7b23aa





--
This message was sent by Atlassian Jira
(v8.20.7#820007)