You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "Yongzao Dan (Jira)" <ji...@apache.org> on 2023/03/06 08:06:00 UTC

[jira] [Reopened] (IOTDB-5115) [ ConfigNode ] “ConfigNodeRPC-Processor” thread leaks

     [ https://issues.apache.org/jira/browse/IOTDB-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yongzao Dan reopened IOTDB-5115:
--------------------------------

> [ ConfigNode ] “ConfigNodeRPC-Processor” thread leaks
> -----------------------------------------------------
>
>                 Key: IOTDB-5115
>                 URL: https://issues.apache.org/jira/browse/IOTDB-5115
>             Project: Apache IoTDB
>          Issue Type: Bug
>          Components: mpp-cluster
>    Affects Versions: 1.0.0
>            Reporter: 刘珍
>            Assignee: Yongzao Dan
>            Priority: Major
>         Attachments: image-2022-12-05-09-13-14-368.png
>
>
> rel/1.0 fbbca3f ,1副本,schema/data region CUSTOM 策略
> 启动1个datanode,启动1个BM连接这个datanode创建元数据,每个序列写入1个点。
> 再启动到第15个datanode,15个BM创建原数据时,元数据不能继续创建(实际创建144799 设备,预期应该创建150000),ConfigNode Leader 的ConfigNodeRPC-Processor线程数在不断增长:
> !image-2022-12-05-09-13-14-368.png|width=831,height=444! 
> 测试环境-私有云1期
> 1.172.16.2.2~22 是DataNode(共21台 8C32GB)
> BM :172.16.2.26~46 运行BM (共21台 4C16GB)
> ConfigNode :172.16.2.23~25 (共3台 8C32GB)
> 配置参数
>  # config_node_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
>  # schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
>  # data_region_consensus_protocol_class=org.apache.iotdb.consensus.iot.IoTConsensus
>  # schema_replication_factor=1
>  # data_replication_factor=1
> schema_region_group_extension_policy=CUSTOM
> schema_region_group_per_database=6
> data_region_group_extension_policy=CUSTOM
> data_region_group_per_database=8
> time_partition_interval=60480000000
> ConfigNode配置
> MAX_HEAP_SIZE="20G"
> MAX_DIRECT_MEMORY_SIZE="6G"
> cn_target_config_node_list=172.16.2.23:22277
> DataNode配置
> MAX_HEAP_SIZE="20G"
> MAX_DIRECT_MEMORY_SIZE="6G"
> dn_data_dirs=data/datanode/data,/data1/iotdb/datanode/data
> dn_target_config_node_list=172.16.2.23:22277,172.16.2.24:22277,172.16.2.25:22277
> Common 配置
>  # config_node_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
>  # schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
>  # data_region_consensus_protocol_class=org.apache.iotdb.consensus.iot.IoTConsensus
>  # schema_replication_factor=1
>  # data_replication_factor=1
> schema_region_group_extension_policy=CUSTOM
> schema_region_group_per_database=6
> data_region_group_extension_policy=CUSTOM
> data_region_group_per_database=8
> time_partition_interval=60480000000
> 2. BM配置
> DB_SWITCH=IoTDB-014-SESSION_BY_TABLET
> GROUP_NUMBER=1
> DEVICE_NUMBER=10000
> REAL_INSERT_RATE=1.0
> SENSOR_NUMBER=100
> IS_SENSOR_TS_ALIGNMENT=true
> IS_OUT_OF_ORDER=false
> OUT_OF_ORDER_RATIO=0.5
> OPERATION_PROPORTION=1:0:0:0:0:0:0:0:0:0:0
> CLIENT_NUMBER=15
> LOOP=1
> BATCH_SIZE_PER_WRITE=1
> START_TIME=2018-8-29T00:00:00+08:00
> POINT_STEP=100
> OP_MIN_INTERVAL=0
> OP_MIN_INTERVAL_RANDOM=false
> INSERT_DATATYPE_PROPORTION=1:1:1:1:1:1
> ENCODINGS=PLAIN/PLAIN/PLAIN/PLAIN/PLAIN/PLAIN
> COMPRESSOR=SNAPPY
> IS_DELETE_DATA=false
> CREATE_SCHEMA=true
> 3. 日志
> ConfigNode Leader
> 172.16.2.23
> /data/iotdb/rel_1202_fbbca3f/logs_confignode_thread_leak



--
This message was sent by Atlassian Jira
(v8.20.10#820010)