You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "Jinrui Zhang (Jira)" <ji...@apache.org> on 2022/11/18 02:50:00 UTC
[jira] [Commented] (IOTDB-4505) [SystemResourceIssue] Why is the 60 client test better than the 300 client test
[ https://issues.apache.org/jira/browse/IOTDB-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17635620#comment-17635620 ]
Jinrui Zhang commented on IOTDB-4505:
-------------------------------------
It should be related to the memory usage. That is, 300 clients will consume more memory so the available memory for MultiLeader is less than 60 clients. We have an optimization for memory control. See this PR https://github.com/apache/iotdb/pull/8025
> [SystemResourceIssue] Why is the 60 client test better than the 300 client test
> -------------------------------------------------------------------------------
>
> Key: IOTDB-4505
> URL: https://issues.apache.org/jira/browse/IOTDB-4505
> Project: Apache IoTDB
> Issue Type: Bug
> Components: Core/Cluster
> Affects Versions: 0.14.0-SNAPSHOT
> Reporter: FengQingxin
> Assignee: Jinrui Zhang
> Priority: Major
> Attachments: config.properties, confignode-env.sh, datanode-env.sh, image-2022-09-23-08-33-48-642.png, image-2022-09-26-08-10-41-274.png, iotdb-confignode.properties, iotdb-datanode.properties
>
>
> Reducing the number of clients reduces the number of threads and the number of open files, and there is no write failure. The data file size difference between the three nodes disappears
> Reproduce steps：
> # Setup a cluster with 3C3D({color:#de350b}MultiLeaderConsensus{color})
> # Using 3BMs to insert data(client=100*3)
> # Setup a cluster with 3C3D({color:#de350b}MultiLeaderConsensus{color})
> # Using 3BMs to insert data(client=20*3)
> BM ----- 》 IoTDB Node
> 172.20.70.7 ----- 》 172.20.70.22
> 172.20.70.8 ----- 》 172.20.70.23
> 172.20.70.9 ----- 》 172.20.70.24
>
> !image-2022-09-23-08-33-48-642.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)