You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2022/12/22 02:25:00 UTC
[jira] [Created] (IOTDB-5265) [fast compaction] One tenth of the devices are "ALL_DELETED",fast compaction is slow
刘珍 created IOTDB-5265:
-------------------------
Summary: [fast compaction] One tenth of the devices are "ALL_DELETED",fast compaction is slow
Key: IOTDB-5265
URL: https://issues.apache.org/jira/browse/IOTDB-5265
Project: Apache IoTDB
Issue Type: Improvement
Components: mpp-cluster
Reporter: 刘珍
Assignee: 周沛辰
Attachments: image-2022-12-22-10-05-22-860.png
master 1219 4a59a2c
100 设备 * 6 序列共600序列,2亿点/序列,顺序和乱序各50%。
对比2个场景的合并性能:
delete 10个设备的数据
没有delete操作
有如下2个问题,
问题1:
cross_performer=fast配置:没有delete数据的场景,合并耗时最长,比默认都长。
问题2:
cross_performer=fast
inner_unseq_performer=fast
inner_seq_performer=fast
配置
没有delete数据的场景,反而合并的快。
!image-2022-12-22-10-05-22-860.png!
测试环境:
1. 192.168.10.72 48CPU384GB
关合并,
time_partition_interval=60480000000
生成测试数据。
配置文件见附件,1.conf运行完,cli flush,再运行2.conf,cli flush。
2.对比合并性能
compaction_write_throughput_mb_per_sec=1048576 (合并不限流)
time_partition_interval=60480000000
query_timeout_threshold=36000000
delete 10个设备的数据:
cli -e "delete from root.test.g_0.d_0.*;"
cli -e "delete from root.test.g_0.d_10.*;"
cli -e "delete from root.test.g_0.d_20.*;"
cli -e "delete from root.test.g_0.d_30.*;"
cli -e "delete from root.test.g_0.d_40.*;"
cli -e "delete from root.test.g_0.d_50.*;"
cli -e "delete from root.test.g_0.d_60.*;"
cli -e "delete from root.test.g_0.d_70.*;"
cli -e "delete from root.test.g_0.d_80.*;"
cli -e "delete from root.test.g_0.d_90.*;"
--
This message was sent by Atlassian Jira
(v8.20.10#820010)