You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iotdb.apache.org by Haiming Zhu <he...@gmail.com> on 2022/10/10 07:05:15 UTC
Change default time partition interval from 1 day to 1 week
Hi,
We want to change default time partition interval from 1 day to 1 week,
including
time_partition_interval_for_routing in the confignode and
time_partition_interval_for_storage in the datanode.
Best,
------------------------------------
Haiming Zhu
Re: Change default time partition interval from 1 day to 1 week
Posted by Haiming Zhu <he...@gmail.com>.
Dear Qingxin Feng,
The benefit is that time partition can help us isolate data by time. We
change it back to 7 days because we find some problems when using 1 day. To
conclude it, "too small is bad, how big depends on user needs".
Best,
------------------------------------
Haiming Zhu
冯 庆新 <qi...@hotmail.com> 于2022年10月10日周一 21:23写道：
> Dear Haiming Zhu,
>
> If only refer to the explanation below mailing list, "No time partition"
> seems better.
> So why is it 7 days?not 10 days. What experiments and analyses have you
> done to support this change.
>
> Best Regards.
> Qingxin Feng
>
> 发件人: Haiming Zhu<ma...@gmail.com>
> 发送时间: 2022年10月10日 20:03
> 收件人: dev@iotdb.apache.org<ma...@iotdb.apache.org>
> 主题: Re: Change default time partition interval from 1 day to 1 week
>
> Three reasons to do this:
>
> 1. 1 day is too small to enable time partition, there're too few tsfiles
> in one partition, which is bad for compaction.
> 2. Avoid wal accumulation caused by too many time partitions.
> 3. Avoid too many partition table entries and then trigger confignode
> snapshot frequently.
>
>
>
> Best,
> ------------------------------------
> Haiming Zhu
>
>
> 冯 庆新 <qi...@hotmail.com> 于2022年10月10日周一 17:46写道：
>
> > Hi,
> > But “enable_partition” is still “false”,right? According to this it
> > doesn't affect anyone who using default value in
> > ‘iotdb-datanode.properties’ to using standalone version apache-iotdb.
> > If someone uses the distributed version, it will affect newly compiled
> and
> > started instances,because it works by default in
> > “iotdb-confignode.properties”.
> > What is the expected impact? Degraded write performance?
> >
> > Best Regards.
> > Thanks!
> >
> > 发件人: Haiming Zhu<ma...@gmail.com>
> > 发送时间: 2022年10月10日 15:06
> > 收件人: iotdb<ma...@iotdb.apache.org>
> > 主题: Change default time partition interval from 1 day to 1 week
> >
> > Hi,
> >
> > We want to change default time partition interval from 1 day to 1 week,
> > including
> > time_partition_interval_for_routing in the confignode and
> > time_partition_interval_for_storage in the datanode.
> >
> > Best,
> > ------------------------------------
> > Haiming Zhu
> >
> >
>
>
回复: Change default time partition interval from 1 day to 1 week
Posted by 冯 庆新 <qi...@hotmail.com>.
Dear Haiming Zhu,
If only refer to the explanation below mailing list, "No time partition" seems better.
So why is it 7 days?not 10 days. What experiments and analyses have you done to support this change.
Best Regards.
Qingxin Feng
发件人: Haiming Zhu<ma...@gmail.com>
发送时间: 2022年10月10日 20:03
收件人: dev@iotdb.apache.org<ma...@iotdb.apache.org>
主题: Re: Change default time partition interval from 1 day to 1 week
Three reasons to do this:
1. 1 day is too small to enable time partition, there're too few tsfiles
in one partition, which is bad for compaction.
2. Avoid wal accumulation caused by too many time partitions.
3. Avoid too many partition table entries and then trigger confignode
snapshot frequently.
Best,
------------------------------------
Haiming Zhu
冯 庆新 <qi...@hotmail.com> 于2022年10月10日周一 17:46写道：
> Hi,
> But “enable_partition” is still “false”,right? According to this it
> doesn't affect anyone who using default value in
> ‘iotdb-datanode.properties’ to using standalone version apache-iotdb.
> If someone uses the distributed version, it will affect newly compiled and
> started instances,because it works by default in
> “iotdb-confignode.properties”.
> What is the expected impact? Degraded write performance?
>
> Best Regards.
> Thanks!
>
> 发件人: Haiming Zhu<ma...@gmail.com>
> 发送时间: 2022年10月10日 15:06
> 收件人: iotdb<ma...@iotdb.apache.org>
> 主题: Change default time partition interval from 1 day to 1 week
>
> Hi,
>
> We want to change default time partition interval from 1 day to 1 week,
> including
> time_partition_interval_for_routing in the confignode and
> time_partition_interval_for_storage in the datanode.
>
> Best,
> ------------------------------------
> Haiming Zhu
>
>
Re: Change default time partition interval from 1 day to 1 week
Posted by Haiming Zhu <he...@gmail.com>.
Three reasons to do this:
1. 1 day is too small to enable time partition, there're too few tsfiles
in one partition, which is bad for compaction.
2. Avoid wal accumulation caused by too many time partitions.
3. Avoid too many partition table entries and then trigger confignode
snapshot frequently.
Best,
------------------------------------
Haiming Zhu
冯 庆新 <qi...@hotmail.com> 于2022年10月10日周一 17:46写道：
> Hi,
> But “enable_partition” is still “false”,right? According to this it
> doesn't affect anyone who using default value in
> ‘iotdb-datanode.properties’ to using standalone version apache-iotdb.
> If someone uses the distributed version, it will affect newly compiled and
> started instances,because it works by default in
> “iotdb-confignode.properties”.
> What is the expected impact? Degraded write performance?
>
> Best Regards.
> Thanks!
>
> 发件人: Haiming Zhu<ma...@gmail.com>
> 发送时间: 2022年10月10日 15:06
> 收件人: iotdb<ma...@iotdb.apache.org>
> 主题: Change default time partition interval from 1 day to 1 week
>
> Hi,
>
> We want to change default time partition interval from 1 day to 1 week,
> including
> time_partition_interval_for_routing in the confignode and
> time_partition_interval_for_storage in the datanode.
>
> Best,
> ------------------------------------
> Haiming Zhu
>
>
回复: Change default time partition interval from 1 day to 1 week
Posted by 冯 庆新 <qi...@hotmail.com>.
Hi,
But “enable_partition” is still “false”,right? According to this it doesn't affect anyone who using default value in ‘iotdb-datanode.properties’ to using standalone version apache-iotdb.
If someone uses the distributed version, it will affect newly compiled and started instances,because it works by default in “iotdb-confignode.properties”.
What is the expected impact? Degraded write performance?
Best Regards.
Thanks!
发件人: Haiming Zhu<ma...@gmail.com>
发送时间: 2022年10月10日 15:06
收件人: iotdb<ma...@iotdb.apache.org>
主题: Change default time partition interval from 1 day to 1 week
Hi,
We want to change default time partition interval from 1 day to 1 week,
including
time_partition_interval_for_routing in the confignode and
time_partition_interval_for_storage in the datanode.
Best,
------------------------------------
Haiming Zhu
Re: Change default time partition interval from 1 day to 1 week
Posted by Haonan Hou <hh...@qq.com.INVALID>.
+1
Best,
Haonan
> On Oct 10, 2022, at 3:05 PM, Haiming Zhu <he...@gmail.com> wrote:
>
> Hi,
>
> We want to change default time partition interval from 1 day to 1 week,
> including
> time_partition_interval_for_routing in the confignode and
> time_partition_interval_for_storage in the datanode.
>
> Best,
> ------------------------------------
> Haiming Zhu