You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iotdb.apache.org by Lingzhe ZHANG <su...@foxmail.com> on 2020/10/19 02:28:27 UTC
[DISCUSS] Add hot compaction with the format of tsfile manager
Hi all，
In order to make hot compaction strategy more flexible, and split its code from flush part. I remove the vm-style compaction and add a hot compaction structure with the format of tsfile list manager.
Now we have two strategies, normal strategy and level strategy, the normal strategy disables hot compaction. The level strategy enables size-tiering compaction.
What do you think of the design above?
And the following pr[1] add max chunk point limitation in level strategy and merge read limit.
Can someone review and help merge it to master?
[1] https://github.com/apache/iotdb/pull/1758
LingZhe ZHANG
School of Software, Tsinghua University
Re: [DISCUSS] Add hot compaction with the format of tsfile manager
Posted by Jialin Qiao <qj...@mails.tsinghua.edu.cn>.
Hi,
You could put the detailed design doc on the confluence [1]. Let others easy to follow.
Besides, the naming of compaction is more standard than hot compaction..
[1] https://cwiki.apache.org/confluence/display/IOTDB/Home
Thanks,
--
Jialin Qiao
School of Software, Tsinghua University
乔嘉林
清华大学 软件学院
> -----原始邮件-----
> 发件人: "Lingzhe ZHANG" <su...@foxmail.com>
> 发送时间: 2020-10-19 10:28:27 (星期一)
> 收件人: dev <de...@iotdb.apache.org>
> 抄送:
> 主题: [DISCUSS] Add hot compaction with the format of tsfile manager
>
> Hi all，
> In order to make hot compaction strategy more flexible, and split its code from flush part. I remove the vm-style compaction and add a hot compaction structure with the format of tsfile list manager.
> Now we have two strategies, normal strategy and level strategy, the normal strategy disables hot compaction. The level strategy enables size-tiering compaction.
> What do you think of the design above?
> And the following pr[1] add max chunk point limitation in level strategy and merge read limit.
> Can someone review and help merge it to master?
>
>
> [1] https://github.com/apache/iotdb/pull/1758
>
>
> LingZhe ZHANG
> School of Software, Tsinghua University