You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2022/10/18 09:52:00 UTC
[jira] [Created] (IOTDB-4683) 100k sensors/dev ，write failed
刘珍 created IOTDB-4683:
-------------------------
Summary: 100k sensors/dev ，write failed
Key: IOTDB-4683
URL: https://issues.apache.org/jira/browse/IOTDB-4683
Project: Apache IoTDB
Issue Type: Bug
Components: mpp-cluster
Affects Versions: 0.14.0-SNAPSHOT
Reporter: 刘珍
Assignee: Haonan Hou
Attachments: iotdb_13.conf, mpp.conf, mpp_ip76_dn_stack.out
m_1017_f33130b
1副本，1C1D
DEVICE_NUMBER=300
*SENSOR_NUMBER=100000
CLIENT_NUMBER=1*
GROUP_NUMBER=3
BATCH_SIZE_PER_WRITE=1
写入超时时间设置为1小时，写入失败（{color:#DE350B}写入期间基本无CPU{color}）。
0.13 同样元数据配置，只是BATCH_SIZE_PER_WRITE=100
写入成功
测试环境
分布式1副本1C1D
1. 192.168.10.76 物理机 48CPU 384GB
ConfigNode
MAX_HEAP_SIZE="8G" schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus
connection_timeout_ms=120000
schema_region_ratis_request_timeout_ms = 1200000
data_region_ratis_request_timeout_ms = 1200000
schema_region_ratis_max_retry_attempts = 1
data_region_ratis_max_retry_attempts = 2
DataNode
MAX_HEAP_SIZE="256G"
MAX_DIRECT_MEMORY_SIZE="32G"
wal_buffer_size_in_byte=211424144
avg_series_point_number_threshold=100
max_waiting_time_when_insert_blocked=3600000
enable_seq_space_compaction=false
enable_unseq_space_compaction=false
enable_cross_space_compaction=false
query_timeout_threshold=36000000
0.13 测试环境 （ commitID ：fe7cc90）
192.168.10.64 物理机 72CPU 256GB
MAX_HEAP_SIZE="192G"
MAX_DIRECT_MEMORY_SIZE="32G"
wal_buffer_size=211424144
avg_series_point_number_threshold=100
max_waiting_time_when_insert_blocked=3600000
enable_seq_space_compaction=false
enable_unseq_space_compaction=false
enable_cross_space_compaction=false
query_timeout_threshold=36000000
bm配置文件见附件
--
This message was sent by Atlassian Jira
(v8.20.10#820010)