You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iotdb.apache.org by Christofer Dutz <ch...@c-ware.de> on 2023/07/12 12:45:40 UTC
What are all the empty "ext" directories for?
Hi,
so playing around with IoTDB running in embedded mode, I noticed that it creates a directory “data” which totally makes sense to me, as it contains all the data.
However it also creates a whole tree under “ext” which just seems to contain loads of empty directories.
What’s the purpose of these and could we prevent them from being created, if they are not needed?
ext
/pipe
/install
/tmp
/trigger
/install
/tmp
/udf
/install
/tmp
Chris
Re: What are all the empty "ext" directories for?
Posted by Trevor Hart <tr...@ope.nz>.
Not sure what all of them are but UDF is where you put custom data functions (jar files).
Im guessing the same for triggers?
Thanks
Trevor Hart
Ope Limited
w: http://www.ope.nz/
m: +64212728039
---- On Thu, 13 Jul 2023 00:45:40 +1200 Christofer Dutz <ch...@c-ware.de> wrote ---
Hi,
so playing around with IoTDB running in embedded mode, I noticed that it creates a directory “data” which totally makes sense to me, as it contains all the data.
However it also creates a whole tree under “ext” which just seems to contain loads of empty directories.
What’s the purpose of these and could we prevent them from being created, if they are not needed?
ext
/pipe
/install
/tmp
/trigger
/install
/tmp
/udf
/install
/tmp
Chris
AW: What are all the empty "ext" directories for?
Posted by Christofer Dutz <ch...@c-ware.de>.
Ok … so having had a look, it seems as if this happens in the UDFExecutableManager
Class (And the matching other Manager components. The “SystemFileFactory
.makeDirIfNecessary” are the ones creating them.
Possibly worth investigating if they really need to exist, of if we could change the Managers to check if they exist.
Chris
Von: Xiangdong Huang <sa...@gmail.com>
Datum: Freitag, 14. Juli 2023 um 09:15
An: dev@iotdb.apache.org <de...@iotdb.apache.org>
Betreff: Re: What are all the empty "ext" directories for?
> I can imagine what it’s used for … I was more just asking, why it’s creating these directories locally instead of just looking if they exist. Always feels a bit odd, if loads of empty directories are in my filesystem.
agree with that feeling... this can be indeed an improvement if it
does not bring too much complexity.
Best,
-----------------------------------
Xiangdong Huang
Christofer Dutz <ch...@c-ware.de> 于2023年7月14日周五 14:30写道：
>
> Hi Xiangdong,
>
> I can imagine what it’s used for … I was more just asking, why it’s creating these directories locally instead of just looking if they exist. Always feels a bit odd, if loads of empty directories are in my filesystem.
>
> Chris
>
> Von: Xiangdong Huang <sa...@gmail.com>
> Datum: Freitag, 14. Juli 2023 um 07:51
> An: dev@iotdb.apache.org <de...@iotdb.apache.org>
> Betreff: Re: What are all the empty "ext" directories for?
> "ext" refers to "extension", and its subfolder:
> - trigger, similar with trigger in RDBMS.
> - udf, user define functions.
> - PIPE, a new function for ETL or data subscription.
>
> All the above need to users claiming their data processing logic using
> jar files.
> So as Trevor said, you can put your jar files there.
>
>
> Best,
> -----------------------------------
> Xiangdong Huang
>
> 18110526956@163.com <18...@163.com> 于2023年7月14日周五 08:55写道：
> >
> > We have written the relevant documentation, you can see https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> > > 2023年7月12日 20:45，Christofer Dutz <ch...@c-ware.de> 写道：
> > >
> > > Hi,
> > >
> > > so playing around with IoTDB running in embedded mode, I noticed that it creates a directory “data” which totally makes sense to me, as it contains all the data.
> > > However it also creates a whole tree under “ext” which just seems to contain loads of empty directories.
> > > What’s the purpose of these and could we prevent them from being created, if they are not needed?
> > >
> > > ext
> > > /pipe
> > > /install
> > > /tmp
> > > /trigger
> > > /install
> > > /tmp
> > > /udf
> > > /install
> > > /tmp
> > >
> > >
> > > Chris
> >
Re: What are all the empty "ext" directories for?
Posted by Xiangdong Huang <sa...@gmail.com>.
> I can imagine what it’s used for … I was more just asking, why it’s creating these directories locally instead of just looking if they exist. Always feels a bit odd, if loads of empty directories are in my filesystem.
agree with that feeling... this can be indeed an improvement if it
does not bring too much complexity.
Best,
-----------------------------------
Xiangdong Huang
Christofer Dutz <ch...@c-ware.de> 于2023年7月14日周五 14:30写道：
>
> Hi Xiangdong,
>
> I can imagine what it’s used for … I was more just asking, why it’s creating these directories locally instead of just looking if they exist. Always feels a bit odd, if loads of empty directories are in my filesystem.
>
> Chris
>
> Von: Xiangdong Huang <sa...@gmail.com>
> Datum: Freitag, 14. Juli 2023 um 07:51
> An: dev@iotdb.apache.org <de...@iotdb.apache.org>
> Betreff: Re: What are all the empty "ext" directories for?
> "ext" refers to "extension", and its subfolder:
> - trigger, similar with trigger in RDBMS.
> - udf, user define functions.
> - PIPE, a new function for ETL or data subscription.
>
> All the above need to users claiming their data processing logic using
> jar files.
> So as Trevor said, you can put your jar files there.
>
>
> Best,
> -----------------------------------
> Xiangdong Huang
>
> 18110526956@163.com <18...@163.com> 于2023年7月14日周五 08:55写道：
> >
> > We have written the relevant documentation, you can see https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> > > 2023年7月12日 20:45，Christofer Dutz <ch...@c-ware.de> 写道：
> > >
> > > Hi,
> > >
> > > so playing around with IoTDB running in embedded mode, I noticed that it creates a directory “data” which totally makes sense to me, as it contains all the data.
> > > However it also creates a whole tree under “ext” which just seems to contain loads of empty directories.
> > > What’s the purpose of these and could we prevent them from being created, if they are not needed?
> > >
> > > ext
> > > /pipe
> > > /install
> > > /tmp
> > > /trigger
> > > /install
> > > /tmp
> > > /udf
> > > /install
> > > /tmp
> > >
> > >
> > > Chris
> >
AW: What are all the empty "ext" directories for?
Posted by Christofer Dutz <ch...@c-ware.de>.
Hi Xiangdong,
I can imagine what it’s used for … I was more just asking, why it’s creating these directories locally instead of just looking if they exist. Always feels a bit odd, if loads of empty directories are in my filesystem.
Chris
Von: Xiangdong Huang <sa...@gmail.com>
Datum: Freitag, 14. Juli 2023 um 07:51
An: dev@iotdb.apache.org <de...@iotdb.apache.org>
Betreff: Re: What are all the empty "ext" directories for?
"ext" refers to "extension", and its subfolder:
- trigger, similar with trigger in RDBMS.
- udf, user define functions.
- PIPE, a new function for ETL or data subscription.
All the above need to users claiming their data processing logic using
jar files.
So as Trevor said, you can put your jar files there.
Best,
-----------------------------------
Xiangdong Huang
18110526956@163.com <18...@163.com> 于2023年7月14日周五 08:55写道：
>
> We have written the relevant documentation, you can see https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> > 2023年7月12日 20:45，Christofer Dutz <ch...@c-ware.de> 写道：
> >
> > Hi,
> >
> > so playing around with IoTDB running in embedded mode, I noticed that it creates a directory “data” which totally makes sense to me, as it contains all the data.
> > However it also creates a whole tree under “ext” which just seems to contain loads of empty directories.
> > What’s the purpose of these and could we prevent them from being created, if they are not needed?
> >
> > ext
> > /pipe
> > /install
> > /tmp
> > /trigger
> > /install
> > /tmp
> > /udf
> > /install
> > /tmp
> >
> >
> > Chris
>
Re: What are all the empty "ext" directories for?
Posted by Xiangdong Huang <sa...@gmail.com>.
"ext" refers to "extension", and its subfolder:
- trigger, similar with trigger in RDBMS.
- udf, user define functions.
- PIPE, a new function for ETL or data subscription.
All the above need to users claiming their data processing logic using
jar files.
So as Trevor said, you can put your jar files there.
Best,
-----------------------------------
Xiangdong Huang
18110526956@163.com <18...@163.com> 于2023年7月14日周五 08:55写道：
>
> We have written the relevant documentation, you can see https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> > 2023年7月12日 20:45，Christofer Dutz <ch...@c-ware.de> 写道：
> >
> > Hi,
> >
> > so playing around with IoTDB running in embedded mode, I noticed that it creates a directory “data” which totally makes sense to me, as it contains all the data.
> > However it also creates a whole tree under “ext” which just seems to contain loads of empty directories.
> > What’s the purpose of these and could we prevent them from being created, if they are not needed?
> >
> > ext
> > /pipe
> > /install
> > /tmp
> > /trigger
> > /install
> > /tmp
> > /udf
> > /install
> > /tmp
> >
> >
> > Chris
>
AW: What are all the empty "ext" directories for?
Posted by Christofer Dutz <ch...@c-ware.de>.
(With my Apache Member Hat on)
This relevant information should also be available to all without needing to request access.
Chris
Von: 18110526956@163.com <18...@163.com>
Datum: Freitag, 14. Juli 2023 um 02:55
An: dev@iotdb.apache.org <de...@iotdb.apache.org>
Betreff: Re: What are all the empty "ext" directories for?
We have written the relevant documentation, you can see https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> 2023年7月12日 20:45，Christofer Dutz <ch...@c-ware.de> 写道：
>
> Hi,
>
> so playing around with IoTDB running in embedded mode, I noticed that it creates a directory “data” which totally makes sense to me, as it contains all the data.
> However it also creates a whole tree under “ext” which just seems to contain loads of empty directories.
> What’s the purpose of these and could we prevent them from being created, if they are not needed?
>
> ext
> /pipe
> /install
> /tmp
> /trigger
> /install
> /tmp
> /udf
> /install
> /tmp
>
>
> Chris
Re: What are all the empty "ext" directories for?
Posted by "18110526956@163.com" <18...@163.com>.
We have written the relevant documentation, you can see https://apache-iotdb.feishu.cn/docx/SG1DdQklco67oaxSLbYcghWxnkc.
> 2023年7月12日 20:45，Christofer Dutz <ch...@c-ware.de> 写道：
>
> Hi,
>
> so playing around with IoTDB running in embedded mode, I noticed that it creates a directory “data” which totally makes sense to me, as it contains all the data.
> However it also creates a whole tree under “ext” which just seems to contain loads of empty directories.
> What’s the purpose of these and could we prevent them from being created, if they are not needed?
>
> ext
> /pipe
> /install
> /tmp
> /trigger
> /install
> /tmp
> /udf
> /install
> /tmp
>
>
> Chris