You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "yanze chen (Jira)" <ji...@apache.org> on 2022/11/09 03:12:00 UTC

[jira] [Assigned] (IOTDB-4209) [ schema recovery ] Aligned timeseries recovery is slow

     [ https://issues.apache.org/jira/browse/IOTDB-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

yanze chen reassigned IOTDB-4209:
---------------------------------

    Assignee: yanze chen  (was: ZhaoXin)

> [ schema recovery ] Aligned timeseries recovery is slow
> -------------------------------------------------------
>
>                 Key: IOTDB-4209
>                 URL: https://issues.apache.org/jira/browse/IOTDB-4209
>             Project: Apache IoTDB
>          Issue Type: Improvement
>          Components: Core/Schema Manager
>    Affects Versions: 0.14.0-SNAPSHOT
>            Reporter: 刘珍
>            Assignee: yanze chen
>            Priority: Major
>
> 单机,sf_tree_seg,0819_207abf6 
> bm创建对齐序列耗时650.73 second
> 恢复这些序列耗时{color:#DE350B}*1716436ms*{color}, 需优化对齐序列的恢复性能。
> bm运行时间19分钟:
> 2022-08-22 09:56:01 到 2022-08-22 10:15:42
> {color:#00875A}*Create schema cost 650.73 second*{color}
> Test elapsed time (not include schema creation): 308.10 second
> iotdb重启恢复:
> 2022-08-22 13:19:19,195 [main] INFO o.a.i.db.service.IoTDB:140 - recover the schema...
> 2022-08-22 13:47:55,631 [main] INFO o.a.i.db.service.IoTDB:234 - spend {color:#DE350B}*1716436ms*{color} to recover schema.
> log_all.log 耗时38分钟
> 2022-08-22 13:19:18 到2022-08-22 13:57:52,856 [main] INFO o.a.i.db.service.IoTDB:198 - Congratulation, IoTDB is set up successfully. Now, enjoy yourself!
> 复现流程:
> 1. 192.168.10.64 72C256G
> MAX_HEAP_SIZE="192G"
> MAX_DIRECT_MEMORY_SIZE="32G"
> mlog_buffer_size=10485760
> schema_engine_mode=Schema_File
> 2. benchmark运行附件中的脚本
> benchmark在本机路径/data/liuzhen_test/weektest/benchmark_tool_v13 (0620的benchmark)
> 主要配置
> DEVICE_NUMBER=500
> SENSOR_NUMBER=200000
> CLIENT_NUMBER=20
> GROUP_NUMBER=100
> VECTOR=true
> LOOP=1
> BATCH_SIZE_PER_WRITE=1
> OPERATION_PROPORTION=1:0:0:0:0:0:0:0:0:0:0



--
This message was sent by Atlassian Jira
(v8.20.10#820010)