You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iotdb.apache.org by 冯 庆新 <qi...@hotmail.com> on 2023/10/07 02:22:13 UTC

回复: [DISCUSS] Incubating TsFile as an independent Apache project?

Hi Steve Su

I think this is a great idea and I fully support it.
I believe Tsfile can generate greater influence and value.

Thanks
B.R.
Qingxin Feng


从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送

发件人: Steve Yurong Su<ma...@apache.org>
发送时间: 2023年10月7日 0:53
收件人: dev@iotdb.apache.org<ma...@iotdb.apache.org>
主题: [DISCUSS] Incubating TsFile as an independent Apache project?

Hi folks,

Recently, I've been thinking about something that has been on my mind:
I believe TsFile has the potential to develop as an independent Apache
project (note, not a subproject like apache-iotdb-tsfile), just like
ORC, Parquet, and Arrow. How about incubating TsFile as an independent
Apache project?

The main reason I came up with this idea is because I realized that
TsFile is not just the data file format of IoTDB, but it can also be a
standard format in the IoT field. It provides excellent support for
time series data, offering various encoding and compression methods.
It can be easily self-parsed and its statistical information enables
fast data querying by big data software. I believe that every IoT
software could benefit directly by supporting TsFile as a storage
format.

On the other hand, I hope to leverage the power of the community to
drive the development of the TsFile file format. Just imagine, TsFile
could have its own independent ecosystem: parsing tools in various
languages, connectors to various big data software, and so on. By
separating TsFile from IoTDB, we have the opportunity to attract more
community contributors and introduce more ideas, thus refining the
functionality and performance of TsFile.

What do you think about this idea?

In addition, how can TsFile, as a part of the current IoTDB project,
become an independent Apache project? Should it go through the Apache
Foundation incubation process again, or can it directly become a
top-level project? It may be too early to ask this question now, but I
would also like to hear your opinions.

Thanks,
Steve Su


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

Posted by Giorgio Zoppi <gi...@gmail.com>.
+1 i'd like to have the core tsfile library in Rust and extend in Python.I
am not sure if i have enough capacity to do that.

Il giorno sab 7 ott 2023 alle ore 15:35 Xiangdong Huang <sa...@gmail.com>
ha scritto:

> Hi,
> +1 for make TsFile independent and then it will be reasonable for having
> multiple TsFile language implementation.
>
> > If there are enough seasoned and experienced Apache forlks in the PMC,
> I’d even support. A direct to TLP route.
> +1, too. And, I think there are really enough forlks :D.
>
> Best,
> -----------------------------------
> Xiangdong Huang
>
>
>
> Christofer Dutz <ch...@c-ware.de> 于2023年10月7日周六 19:47写道:
>
> > Hi all,
> >
> > not even sure we’d need to go the route throught the incubator.
> > If there are enough seasoned and experienced Apache forlks in the PMC,
> I’d
> > even support. A direct to TLP route.
> >
> > Chris
> >
> > Von: Jialin Qiao <qi...@apache.org>
> > Datum: Samstag, 7. Oktober 2023 um 03:59
> > An: dev@iotdb.apache.org <de...@iotdb.apache.org>
> > Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache
> project?
> > Hi,
> >
> > +1 for Apache TsFile.
> >
> > 1. Industrial time series data management is becoming more and more
> > important, so a file format project for time series data is necessary.
> > 2. When TsFile becomes an independent project, it could be developed
> > and released without impact the upgrading of IoTDB.
> >
> > Thanks,
> > —————————————————
> > Jialin Qiao
> > Apache IoTDB PMC
> >
> > 冯 庆新 <qi...@hotmail.com> 于2023年10月7日周六 10:22写道:
> > >
> > > Hi Steve Su
> > >
> > > I think this is a great idea and I fully support it.
> > > I believe Tsfile can generate greater influence and value.
> > >
> > > Thanks
> > > B.R.
> > > Qingxin Feng
> > >
> > >
> > > 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送
> > >
> > > 发件人: Steve Yurong Su<ma...@apache.org>
> > > 发送时间: 2023年10月7日 0:53
> > > 收件人: dev@iotdb.apache.org<ma...@iotdb.apache.org>
> > > 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
> > >
> > > Hi folks,
> > >
> > > Recently, I've been thinking about something that has been on my mind:
> > > I believe TsFile has the potential to develop as an independent Apache
> > > project (note, not a subproject like apache-iotdb-tsfile), just like
> > > ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> > > Apache project?
> > >
> > > The main reason I came up with this idea is because I realized that
> > > TsFile is not just the data file format of IoTDB, but it can also be a
> > > standard format in the IoT field. It provides excellent support for
> > > time series data, offering various encoding and compression methods.
> > > It can be easily self-parsed and its statistical information enables
> > > fast data querying by big data software. I believe that every IoT
> > > software could benefit directly by supporting TsFile as a storage
> > > format.
> > >
> > > On the other hand, I hope to leverage the power of the community to
> > > drive the development of the TsFile file format. Just imagine, TsFile
> > > could have its own independent ecosystem: parsing tools in various
> > > languages, connectors to various big data software, and so on. By
> > > separating TsFile from IoTDB, we have the opportunity to attract more
> > > community contributors and introduce more ideas, thus refining the
> > > functionality and performance of TsFile.
> > >
> > > What do you think about this idea?
> > >
> > > In addition, how can TsFile, as a part of the current IoTDB project,
> > > become an independent Apache project? Should it go through the Apache
> > > Foundation incubation process again, or can it directly become a
> > > top-level project? It may be too early to ask this question now, but I
> > > would also like to hear your opinions.
> > >
> > > Thanks,
> > > Steve Su
> > >
> >
>


-- 
Life is a chess game - Anonymous.

Re: [DISCUSS] Incubating TsFile as an independent Apache project?

Posted by Xiangdong Huang <sa...@gmail.com>.
Hi,
+1 for make TsFile independent and then it will be reasonable for having
multiple TsFile language implementation.

> If there are enough seasoned and experienced Apache forlks in the PMC,
I’d even support. A direct to TLP route.
+1, too. And, I think there are really enough forlks :D.

Best,
-----------------------------------
Xiangdong Huang



Christofer Dutz <ch...@c-ware.de> 于2023年10月7日周六 19:47写道:

> Hi all,
>
> not even sure we’d need to go the route throught the incubator.
> If there are enough seasoned and experienced Apache forlks in the PMC, I’d
> even support. A direct to TLP route.
>
> Chris
>
> Von: Jialin Qiao <qi...@apache.org>
> Datum: Samstag, 7. Oktober 2023 um 03:59
> An: dev@iotdb.apache.org <de...@iotdb.apache.org>
> Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache project?
> Hi,
>
> +1 for Apache TsFile.
>
> 1. Industrial time series data management is becoming more and more
> important, so a file format project for time series data is necessary.
> 2. When TsFile becomes an independent project, it could be developed
> and released without impact the upgrading of IoTDB.
>
> Thanks,
> —————————————————
> Jialin Qiao
> Apache IoTDB PMC
>
> 冯 庆新 <qi...@hotmail.com> 于2023年10月7日周六 10:22写道:
> >
> > Hi Steve Su
> >
> > I think this is a great idea and I fully support it.
> > I believe Tsfile can generate greater influence and value.
> >
> > Thanks
> > B.R.
> > Qingxin Feng
> >
> >
> > 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送
> >
> > 发件人: Steve Yurong Su<ma...@apache.org>
> > 发送时间: 2023年10月7日 0:53
> > 收件人: dev@iotdb.apache.org<ma...@iotdb.apache.org>
> > 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
> >
> > Hi folks,
> >
> > Recently, I've been thinking about something that has been on my mind:
> > I believe TsFile has the potential to develop as an independent Apache
> > project (note, not a subproject like apache-iotdb-tsfile), just like
> > ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> > Apache project?
> >
> > The main reason I came up with this idea is because I realized that
> > TsFile is not just the data file format of IoTDB, but it can also be a
> > standard format in the IoT field. It provides excellent support for
> > time series data, offering various encoding and compression methods.
> > It can be easily self-parsed and its statistical information enables
> > fast data querying by big data software. I believe that every IoT
> > software could benefit directly by supporting TsFile as a storage
> > format.
> >
> > On the other hand, I hope to leverage the power of the community to
> > drive the development of the TsFile file format. Just imagine, TsFile
> > could have its own independent ecosystem: parsing tools in various
> > languages, connectors to various big data software, and so on. By
> > separating TsFile from IoTDB, we have the opportunity to attract more
> > community contributors and introduce more ideas, thus refining the
> > functionality and performance of TsFile.
> >
> > What do you think about this idea?
> >
> > In addition, how can TsFile, as a part of the current IoTDB project,
> > become an independent Apache project? Should it go through the Apache
> > Foundation incubation process again, or can it directly become a
> > top-level project? It may be too early to ask this question now, but I
> > would also like to hear your opinions.
> >
> > Thanks,
> > Steve Su
> >
>

AW: [DISCUSS] Incubating TsFile as an independent Apache project?

Posted by Christofer Dutz <ch...@c-ware.de>.
Hi all,

not even sure we’d need to go the route throught the incubator.
If there are enough seasoned and experienced Apache forlks in the PMC, I’d even support. A direct to TLP route.

Chris

Von: Jialin Qiao <qi...@apache.org>
Datum: Samstag, 7. Oktober 2023 um 03:59
An: dev@iotdb.apache.org <de...@iotdb.apache.org>
Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi,

+1 for Apache TsFile.

1. Industrial time series data management is becoming more and more
important, so a file format project for time series data is necessary.
2. When TsFile becomes an independent project, it could be developed
and released without impact the upgrading of IoTDB.

Thanks,
―――――――――――――――――
Jialin Qiao
Apache IoTDB PMC

冯 庆新 <qi...@hotmail.com> 于2023年10月7日周六 10:22写道:
>
> Hi Steve Su
>
> I think this is a great idea and I fully support it.
> I believe Tsfile can generate greater influence and value.
>
> Thanks
> B.R.
> Qingxin Feng
>
>
> 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送
>
> 发件人: Steve Yurong Su<ma...@apache.org>
> 发送时间: 2023年10月7日 0:53
> 收件人: dev@iotdb.apache.org<ma...@iotdb.apache.org>
> 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
>
> Hi folks,
>
> Recently, I've been thinking about something that has been on my mind:
> I believe TsFile has the potential to develop as an independent Apache
> project (note, not a subproject like apache-iotdb-tsfile), just like
> ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> Apache project?
>
> The main reason I came up with this idea is because I realized that
> TsFile is not just the data file format of IoTDB, but it can also be a
> standard format in the IoT field. It provides excellent support for
> time series data, offering various encoding and compression methods.
> It can be easily self-parsed and its statistical information enables
> fast data querying by big data software. I believe that every IoT
> software could benefit directly by supporting TsFile as a storage
> format.
>
> On the other hand, I hope to leverage the power of the community to
> drive the development of the TsFile file format. Just imagine, TsFile
> could have its own independent ecosystem: parsing tools in various
> languages, connectors to various big data software, and so on. By
> separating TsFile from IoTDB, we have the opportunity to attract more
> community contributors and introduce more ideas, thus refining the
> functionality and performance of TsFile.
>
> What do you think about this idea?
>
> In addition, how can TsFile, as a part of the current IoTDB project,
> become an independent Apache project? Should it go through the Apache
> Foundation incubation process again, or can it directly become a
> top-level project? It may be too early to ask this question now, but I
> would also like to hear your opinions.
>
> Thanks,
> Steve Su
>

Re: [DISCUSS] Incubating TsFile as an independent Apache project?

Posted by Jialin Qiao <qi...@apache.org>.
Hi,

+1 for Apache TsFile.

1. Industrial time series data management is becoming more and more
important, so a file format project for time series data is necessary.
2. When TsFile becomes an independent project, it could be developed
and released without impact the upgrading of IoTDB.

Thanks,
—————————————————
Jialin Qiao
Apache IoTDB PMC

冯 庆新 <qi...@hotmail.com> 于2023年10月7日周六 10:22写道:
>
> Hi Steve Su
>
> I think this is a great idea and I fully support it.
> I believe Tsfile can generate greater influence and value.
>
> Thanks
> B.R.
> Qingxin Feng
>
>
> 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送
>
> 发件人: Steve Yurong Su<ma...@apache.org>
> 发送时间: 2023年10月7日 0:53
> 收件人: dev@iotdb.apache.org<ma...@iotdb.apache.org>
> 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
>
> Hi folks,
>
> Recently, I've been thinking about something that has been on my mind:
> I believe TsFile has the potential to develop as an independent Apache
> project (note, not a subproject like apache-iotdb-tsfile), just like
> ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> Apache project?
>
> The main reason I came up with this idea is because I realized that
> TsFile is not just the data file format of IoTDB, but it can also be a
> standard format in the IoT field. It provides excellent support for
> time series data, offering various encoding and compression methods.
> It can be easily self-parsed and its statistical information enables
> fast data querying by big data software. I believe that every IoT
> software could benefit directly by supporting TsFile as a storage
> format.
>
> On the other hand, I hope to leverage the power of the community to
> drive the development of the TsFile file format. Just imagine, TsFile
> could have its own independent ecosystem: parsing tools in various
> languages, connectors to various big data software, and so on. By
> separating TsFile from IoTDB, we have the opportunity to attract more
> community contributors and introduce more ideas, thus refining the
> functionality and performance of TsFile.
>
> What do you think about this idea?
>
> In addition, how can TsFile, as a part of the current IoTDB project,
> become an independent Apache project? Should it go through the Apache
> Foundation incubation process again, or can it directly become a
> top-level project? It may be too early to ask this question now, but I
> would also like to hear your opinions.
>
> Thanks,
> Steve Su
>