[jira] [Created] (IOTDB-5512) [ IoTConsensus Resend log ] The unsequence tsfile is generated after the cluster is restarted (

["刘珍 (Jira)" <ji...@apache.org>]

刘珍 created IOTDB-5512:
-------------------------

             Summary: [ IoTConsensus Resend log ] The unsequence tsfile is generated after the cluster is restarted (
                 Key: IOTDB-5512
                 URL: https://issues.apache.org/jira/browse/IOTDB-5512
             Project: Apache IoTDB
          Issue Type: Improvement
          Components: mpp-cluster
            Reporter: 刘珍
            Assignee: Xinyu Tan
         Attachments: image-2023-02-09-15-45-05-253.png, image-2023-02-09-15-52-51-085.png, insert_no_overflow.config.properties

测试版本：rc/1.0.1 20230202  63b16f2
问题描述：
3副本3节点集群，benchmark写入顺序数据，重启前检查data 为全顺序，重启集群后，会生成部分乱序tsfile。

重启集群前查看所有dataregion的log同步情况，已同步完成：
 !image-2023-02-09-15-45-05-253.png! 
consensus 文件记录的已同步的log index是100000
 !image-2023-02-09-15-52-51-085.png! 
重启集群后，这90条log会重发，导致有乱序tsfile生成，可以优化一下，解决这个问题。

测试流程：
1. 私有云3期
1ConfigNode 172.20.70.5
3DataNode 172.20.70.2/4/14
benchmark 在172.20.70.13 （配置见附件）
集群配置参数
ConfigNode
MAX_HEAP_SIZE="20G"
MAX_DIRECT_MEMORY_SIZE="6G"

DataNode
MAX_HEAP_SIZE="20G"
MAX_DIRECT_MEMORY_SIZE="6G"
dn_max_connection_for_internal_service=300

common文件
schema_replication_factor=3
data_replication_factor=3
enable_seq_space_compaction=false
enable_unseq_space_compaction=false
enable_cross_space_compaction=false

config_node_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
data_region_consensus_protocol_class=org.apache.iotdb.consensus.iot.IoTConsensus

2. 运行benchmark

3. 写入完成，检查data ，无乱序tsfile，log同步完成，重启集群。
预期结果，重启后，无乱序tsfile。



--
This message was sent by Atlassian Jira
(v8.20.10#820010)