You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2022/12/22 02:25:00 UTC

[jira] [Created] (IOTDB-5265) [fast compaction] One tenth of the devices are "ALL_DELETED",fast compaction is slow

刘珍 created IOTDB-5265:
-------------------------

             Summary: [fast compaction] One tenth of the devices are "ALL_DELETED",fast compaction is slow
                 Key: IOTDB-5265
                 URL: https://issues.apache.org/jira/browse/IOTDB-5265
             Project: Apache IoTDB
          Issue Type: Improvement
          Components: mpp-cluster
            Reporter: 刘珍
            Assignee: 周沛辰
         Attachments: image-2022-12-22-10-05-22-860.png

master 1219  4a59a2c
100 设备 * 6 序列共600序列,2亿点/序列,顺序和乱序各50%。
对比2个场景的合并性能:
delete 10个设备的数据
没有delete操作
有如下2个问题,
问题1:
cross_performer=fast配置:没有delete数据的场景,合并耗时最长,比默认都长。
问题2:
cross_performer=fast
inner_unseq_performer=fast
inner_seq_performer=fast
配置
没有delete数据的场景,反而合并的快。
 !image-2022-12-22-10-05-22-860.png! 
测试环境:
1. 192.168.10.72 48CPU384GB
关合并,
time_partition_interval=60480000000
生成测试数据。
配置文件见附件,1.conf运行完,cli flush,再运行2.conf,cli flush。
2.对比合并性能
compaction_write_throughput_mb_per_sec=1048576 (合并不限流)
time_partition_interval=60480000000
query_timeout_threshold=36000000

delete 10个设备的数据:
cli -e "delete from root.test.g_0.d_0.*;"
cli -e "delete from root.test.g_0.d_10.*;"
cli -e "delete from root.test.g_0.d_20.*;"
cli -e "delete from root.test.g_0.d_30.*;"
cli -e "delete from root.test.g_0.d_40.*;"
cli -e "delete from root.test.g_0.d_50.*;"
cli -e "delete from root.test.g_0.d_60.*;"
cli -e "delete from root.test.g_0.d_70.*;"
cli -e "delete from root.test.g_0.d_80.*;"
cli -e "delete from root.test.g_0.d_90.*;"




--
This message was sent by Atlassian Jira
(v8.20.10#820010)