You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iotdb.apache.org by "Kaifeng Xue (Jira)" <ji...@apache.org> on 2019/12/03 01:52:00 UTC

[jira] [Created] (IOTDB-333) Storage group needs to divide by time range

Kaifeng Xue created IOTDB-333:
---------------------------------

             Summary: Storage group needs to divide by time range
                 Key: IOTDB-333
                 URL: https://issues.apache.org/jira/browse/IOTDB-333
             Project: Apache IoTDB
          Issue Type: New Feature
            Reporter: Kaifeng Xue


Our storage group needs to divide by time range, which can support distributed model better.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: [jira] [Created] (IOTDB-333) Storage group needs to divide by time range

Posted by Xiangdong Huang <sa...@gmail.com>.
Hi, how is it going with this PR?
-----------------------------------
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Xiangdong Huang <sa...@gmail.com> 于2019年12月25日周三 下午2:25写道：

> Hi,
>
> I am reading the PR, but I think some design ideas need to be introduced
> ...
>
> E.g., you change the data file structure from data/storage_group/*.files
> to data/storage_group/{time range}/*.files..
>
> Best,
> -----------------------------------
> Xiangdong Huang
> School of Software, Tsinghua University
>
>  黄向东
> 清华大学 软件学院
>
>
> 南京大学软件学院薛恺丰 <82...@qq.com> 于2019年12月3日周二 上午10:08写道：
>
>> Hi~
>> I'm working on this issue. In current storage group there is only one
>> working processor for sequence data and one working processor for
>> unsequence data. We will use a LRU map to hold working processor in
>> different time range (timeRange -&gt; processor). Data in different time
>> range will insert into different processor. Last frequent used processor
>> will flush and close. If you have some ideas, please feel free to discuss
>> with me.
>>
>>
>>
>>
>> ------------------&nbsp;原始邮件&nbsp;------------------
>> 发件人:&nbsp;"Yuan Tian (Jira)"<jira@apache.org&gt;;
>> 发送时间:&nbsp;2019年12月3日(星期二) 上午9:52
>> 收件人:&nbsp;"dev"<dev@iotdb.apache.org&gt;;
>>
>> 主题:&nbsp;[jira] [Created] (IOTDB-333) Storage group needs to divide by
>> time range
>>
>>
>>
>> Kaifeng Xue created IOTDB-333:
>> ---------------------------------
>>
>> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>> Summary: Storage group needs to divide by time range
>> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>> Key: IOTDB-333
>> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>> URL: https://issues.apache.org/jira/browse/IOTDB-333
>> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp
>> <https://issues.apache.org/jira/browse/IOTDB-333&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp>;
>> Project: Apache IoTDB
>> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Issue Type: New
>> Feature
>> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
>> Reporter: Kaifeng Xue
>>
>>
>> Our storage group needs to divide by time range, which can support
>> distributed model better.
>>
>>
>>
>> --
>> This message was sent by Atlassian Jira
>> (v8.3.4#803005)
>
>

Re: [jira] [Created] (IOTDB-333) Storage group needs to divide by time range

Posted by Xiangdong Huang <sa...@gmail.com>.
Hi,

I am reading the PR, but I think some design ideas need to be introduced ...

E.g., you change the data file structure from data/storage_group/*.files to
data/storage_group/{time range}/*.files..

Best,
-----------------------------------
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


南京大学软件学院薛恺丰 <82...@qq.com> 于2019年12月3日周二 上午10:08写道：

> Hi~
> I'm working on this issue. In current storage group there is only one
> working processor for sequence data and one working processor for
> unsequence data. We will use a LRU map to hold working processor in
> different time range (timeRange -&gt; processor). Data in different time
> range will insert into different processor. Last frequent used processor
> will flush and close. If you have some ideas, please feel free to discuss
> with me.
>
>
>
>
> ------------------&nbsp;原始邮件&nbsp;------------------
> 发件人:&nbsp;"Yuan Tian (Jira)"<jira@apache.org&gt;;
> 发送时间:&nbsp;2019年12月3日(星期二) 上午9:52
> 收件人:&nbsp;"dev"<dev@iotdb.apache.org&gt;;
>
> 主题:&nbsp;[jira] [Created] (IOTDB-333) Storage group needs to divide by
> time range
>
>
>
> Kaifeng Xue created IOTDB-333:
> ---------------------------------
>
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> Summary: Storage group needs to divide by time range
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> Key: IOTDB-333
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> URL: https://issues.apache.org/jira/browse/IOTDB-333
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp
> <https://issues.apache.org/jira/browse/IOTDB-333&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp>;
> Project: Apache IoTDB
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Issue Type: New
> Feature
> &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
> Reporter: Kaifeng Xue
>
>
> Our storage group needs to divide by time range, which can support
> distributed model better.
>
>
>
> --
> This message was sent by Atlassian Jira
> (v8.3.4#803005)

回复：[jira] [Created] (IOTDB-333) Storage group needs to divide by time range

Posted by 南京大学软件学院薛恺丰 <82...@qq.com>.
Hi~
I'm working on this issue. In current storage group there is only one working processor for sequence data and one working processor for unsequence data. We will use a LRU map to hold working processor in different time range (timeRange -&gt; processor). Data in different time range will insert into different processor. Last frequent used processor will flush and close. If you have some ideas, please feel free to discuss with me.




------------------&nbsp;原始邮件&nbsp;------------------
发件人:&nbsp;"Yuan Tian (Jira)"<jira@apache.org&gt;;
发送时间:&nbsp;2019年12月3日(星期二) 上午9:52
收件人:&nbsp;"dev"<dev@iotdb.apache.org&gt;;

主题:&nbsp;[jira] [Created] (IOTDB-333) Storage group needs to divide by time range



Kaifeng Xue created IOTDB-333:
---------------------------------

&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Summary: Storage group needs to divide by time range
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Key: IOTDB-333
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; URL: https://issues.apache.org/jira/browse/IOTDB-333
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Project: Apache IoTDB
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Issue Type: New Feature
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Reporter: Kaifeng Xue


Our storage group needs to divide by time range, which can support distributed model better.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)