You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iotdb.apache.org by SpriCoder <sp...@qq.com.INVALID> on 2022/07/05 09:54:25 UTC
The structure of distribution
Hi all,
Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
I think there are two choices:
1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
What's your opinion? Looking forward to your reply.
Best,
---------------------------------------------------------------
Hongyin Zhang
Re:The structure of distribution
Posted by Yongzao Dan <53...@qq.com.INVALID>.
I think choices 2 might be better, because this helps distinguish ConfigNode from DataNode Best,
---------------------------------------------------------------
Yongzao Dan
------------------ Original ------------------
From: "SpriCoder"<spricoder@qq.com.INVALID>;
Date: 2022年7月5日(星期二) 下午5:54
To: "dev"<dev@iotdb.apache.org>;
Subject: The structure of distribution
Hi all,
Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
I think there are two choices:
1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
What's your opinion? Looking forward to your reply.
Best,
---------------------------------------------------------------
Hongyin Zhang
Re: The structure of distribution
Posted by Haonan Hou <hh...@qq.com.INVALID>.
Hi,
I have a question.
If users would like to extend a standalone IoTDB to cluster, is it a good idea that
separate standalone and datanode to different directories?
Best,
Haonan Hou
> On Jul 12, 2022, at 9:19 AM, SpriCoder <sp...@qq.com.INVALID> wrote:
>
> Finally, From my perspective, one possible structure like below:
>
>
> .
> ├── LICENSE
> ├── NOTICE
> ├── README.md
> ├── README_ZH.md
> ├── RELEASE_NOTES.md
> ├── sbin
> │ ├── start-cli.bat
> │ └── start-cli.sh
>
> ├── confignode
> │ ├── conf
> │ │ ├── confignode-env.bat
> │ │ ├── confignode-env.sh
> │ │ ├── iotdb-confignode.properties
> │ │ ├── iotdb-metric.yml
> │ │ ├── jmx.access
> │ │ ├── jmx.password
> │ │ ├── logback-tool.xml
> │ │ └── logback.xml
> │ └── sbin
> │ ├── remove-confignode.sh
> │ ├── start-confignode.bat
> │ ├── start-confignode.sh
> │ ├── stop-confignode.bat
> │ └── stop-confignode.sh
> ├── datanode
> │ ├── conf
> │ │ ├── datanode-env.bat
> │ │ ├── datanode-env.sh
> │ │ ├── iotdb-datanode.properties
> │ │ ├── iotdb-metric.yml
> │ │ ├── iotdb-rest.properties
> │ │ ├── jmx.access
> │ │ ├── jmx.password
> │ │ ├── logback-tool.xml
> │ │ └── logback.xml
> │ └── sbin
> │ ├── remove-datanode.bat
> │ ├── remove-datanode.sh
> │ ├── start-datanode.bat
> │ ├── start-datanode.sh
> │ ├── stop-datanode.bat
> │ └── stop-datanode.sh
> ├── standalone
> │ ├── conf
> │ │ ├── datanode-env.bat
> │ │ ├── datanode-env.sh
> │ │ ├── iotdb-datanode.properties
> │ │ ├── iotdb-metric.yml
> │ │ ├── iotdb-rest.properties
> │ │ ├── jmx.access
> │ │ ├── jmx.password
> │ │ ├── logback-tool.xml
> │ │ └── logback.xml
> │ └── sbin
> │ ├── start-new-server.bat
> │ ├── start-new-server.sh
> │ ├── start-server.bat
> │ ├── start-server.sh
> │ ├── stop-server.bat
> │ └── stop-server.sh
>
> ├── docs
> ├── grafana-metrics-example
> ├── lib
> ├── licenses
> └── tools
>
>
>
>
>
>
>
> ------------------ Original ------------------
> From: "SpriCoder" <spricoder@qq.com>;
> Date: Tue, Jul 5, 2022 05:54 PM
> To: "dev"<dev@iotdb.apache.org>;
>
> Subject: The structure of distribution
>
>
>
> Hi all,
>
> Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
>
> I think there are two choices:
>
> 1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
>
> 2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
>
>
>
>
> What's your opinion? Looking forward to your reply.
>
>
> Best,
>
> ---------------------------------------------------------------
>
> Hongyin Zhang
Re:The structure of distribution
Posted by SpriCoder <sp...@qq.com.INVALID>.
Finally, From my perspective, one possible structure like below:
.
├── LICENSE
├── NOTICE
├── README.md
├── README_ZH.md
├── RELEASE_NOTES.md
├── sbin
│ ├── start-cli.bat
│ └── start-cli.sh
├── confignode
│ ├── conf
│ │ ├── confignode-env.bat
│ │ ├── confignode-env.sh
│ │ ├── iotdb-confignode.properties
│ │ ├── iotdb-metric.yml
│ │ ├── jmx.access
│ │ ├── jmx.password
│ │ ├── logback-tool.xml
│ │ └── logback.xml
│ └── sbin
│ ├── remove-confignode.sh
│ ├── start-confignode.bat
│ ├── start-confignode.sh
│ ├── stop-confignode.bat
│ └── stop-confignode.sh
├── datanode
│ ├── conf
│ │ ├── datanode-env.bat
│ │ ├── datanode-env.sh
│ │ ├── iotdb-datanode.properties
│ │ ├── iotdb-metric.yml
│ │ ├── iotdb-rest.properties
│ │ ├── jmx.access
│ │ ├── jmx.password
│ │ ├── logback-tool.xml
│ │ └── logback.xml
│ └── sbin
│ ├── remove-datanode.bat
│ ├── remove-datanode.sh
│ ├── start-datanode.bat
│ ├── start-datanode.sh
│ ├── stop-datanode.bat
│ └── stop-datanode.sh
├── standalone
│ ├── conf
│ │ ├── datanode-env.bat
│ │ ├── datanode-env.sh
│ │ ├── iotdb-datanode.properties
│ │ ├── iotdb-metric.yml
│ │ ├── iotdb-rest.properties
│ │ ├── jmx.access
│ │ ├── jmx.password
│ │ ├── logback-tool.xml
│ │ └── logback.xml
│ └── sbin
│ ├── start-new-server.bat
│ ├── start-new-server.sh
│ ├── start-server.bat
│ ├── start-server.sh
│ ├── stop-server.bat
│ └── stop-server.sh
├── docs
├── grafana-metrics-example
├── lib
├── licenses
└── tools
------------------ Original ------------------
From: "SpriCoder" <spricoder@qq.com>;
Date: Tue, Jul 5, 2022 05:54 PM
To: "dev"<dev@iotdb.apache.org>;
Subject: The structure of distribution
Hi all,
Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
I think there are two choices:
1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
What's your opinion? Looking forward to your reply.
Best,
---------------------------------------------------------------
Hongyin Zhang
Re: The structure of distribution
Posted by Xiangdong Huang <sa...@gmail.com>.
Hi,
if we use the structure 2, the binary release name
"apache-iotdb-{version}-bin-all.zip" should be changed
(to "apache-iotdb-{version}-bin-cluster.zip". As the structure does
not fit the singleton release version.
The start-server.sh (or start-new-server.sh) script should also be
removed. It will be confused that
why I need to use "datanode" or "confignode" if I want to just use a
start-new-server
Best,
-----------------------------------
Xiangdong Huang
School of Software, Tsinghua University
黄向东
清华大学 软件学院
SpriCoder <sp...@qq.com.invalid> 于2022年7月6日周三 17:08写道：
>
> Get it!
>
>
>
>
> ------------------ Original ------------------
> From: "SpriCoder" <spricoder@qq.com>;
> Date: Tue, Jul 5, 2022 05:54 PM
> To: "dev"<dev@iotdb.apache.org>;
>
> Subject: The structure of distribution
>
>
>
> Hi all,
>
> Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
>
> I think there are two choices:
>
> 1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
>
> 2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
>
>
>
>
> What's your opinion? Looking forward to your reply.
>
>
> Best,
>
> ---------------------------------------------------------------
>
> Hongyin Zhang
Re:The structure of distribution
Posted by SpriCoder <sp...@qq.com.INVALID>.
Get it!
------------------ Original ------------------
From: "SpriCoder" <spricoder@qq.com>;
Date: Tue, Jul 5, 2022 05:54 PM
To: "dev"<dev@iotdb.apache.org>;
Subject: The structure of distribution
Hi all,
Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
I think there are two choices:
1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
What's your opinion? Looking forward to your reply.
Best,
---------------------------------------------------------------
Hongyin Zhang
Re: The structure of distribution
Posted by 周钰坤 <zy...@gmail.com>.
I think the choice 2 is better, since configNode and dataNode will be
deployed separately and multi-replica means the dir will be copied.
SpriCoder <sp...@qq.com.invalid> 于2022年7月6日周三 12:04写道：
>
> To more specific:
> In Choice 1, folders in apache-iotdb-0.14.0-SNAPSHOT-all-bin will like that:
> ├── sbin
> ├── conf
> ├── config
> ├── data
> ├── ext
> ├── logs
>
> ├── data
> ├── data
> ├── logs
>
>
>
> In Choice2, folder in apache-iotdb-0.14.0-SNAPSHOT-all-bin will like that:
> ├── confignode
> ├── conf
> ├── data
> ├── ext
> ├── logs
> └── sbin
> ├── datanode
> ├── conf
> ├── data
> ├── logs
> └── sbin
>
>
>
>
>
>
>
> ------------------ Original ------------------
> From: "SpriCoder" <spricoder@qq.com>;
> Date: Tue, Jul 5, 2022 05:54 PM
> To: "dev"<dev@iotdb.apache.org>;
>
> Subject: The structure of distribution
>
>
>
> Hi all,
>
> Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
>
> I think there are two choices:
>
> 1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
>
> 2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
>
>
>
>
> What's your opinion? Looking forward to your reply.
>
>
> Best,
>
> ---------------------------------------------------------------
>
> Hongyin Zhang
Re:The structure of distribution
Posted by SpriCoder <sp...@qq.com.INVALID>.
To more specific:
In Choice 1, folders in apache-iotdb-0.14.0-SNAPSHOT-all-bin will like that:
├── sbin
├── conf
├── config
├── data
├── ext
├── logs
├── data
├── data
├── logs
In Choice2, folder in apache-iotdb-0.14.0-SNAPSHOT-all-bin will like that:
├── confignode
├── conf
├── data
├── ext
├── logs
└── sbin
├── datanode
├── conf
├── data
├── logs
└── sbin
------------------ Original ------------------
From: "SpriCoder" <spricoder@qq.com>;
Date: Tue, Jul 5, 2022 05:54 PM
To: "dev"<dev@iotdb.apache.org>;
Subject: The structure of distribution
Hi all,
Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
I think there are two choices:
1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
What's your opinion? Looking forward to your reply.
Best,
---------------------------------------------------------------
Hongyin Zhang
Re: The structure of distribution
Posted by Jialin Qiao <qi...@apache.org>.
Hi,
Apart from the start-server.sh, The start-cli.sh is also weird in datanode folder.
Besides, we may have start-all.sh in the future. There may need a sbin in the parent folder.
Jialin Qiao
On 2022/07/05 09:54:25 SpriCoder wrote:
> Hi all,
>
> Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
>
> I think there are two choices:
>
> 1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
>
> 2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
>
>
>
>
> What's your opinion? Looking forward to your reply.
>
>
> Best,
>
> ---------------------------------------------------------------
>
> Hongyin Zhang
Re:The structure of distribution
Posted by SpriCoder <sp...@qq.com.INVALID>.
I think maybe the binary name can still called "apache-iotdb-{version}-bin-all.zip" if we add standalone folder to store our singleton version?
├── confignode
├── conf
├── data
├── ext
├── logs
└── sbin ├── datanode
├── conf
├── data
├── logs
└── sbin
├── standalone
├── conf
├── data
├── logs
└── sbin
├── lib
As for the second question, I think maybe we can add sbin folder in root folder to hold cluster-related scripts like:
├── sbin
├── confignode
├── conf
├── data
├── ext
├── logs
└── sbin ├── datanode
├── conf
├── data
├── logs
└── sbin
├── standalone
├── conf
├── data
├── logs
└── sbin
├── lib
What's your opinion? Looking forward to your suggestion!
Best,
---------------------------------------------------------------
Hongyin Zhang
------------------ Original ------------------
From: "SpriCoder" <spricoder@qq.com>;
Date: Tue, Jul 5, 2022 05:54 PM
To: "dev"<dev@iotdb.apache.org>;
Subject: The structure of distribution
Hi all,
Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
I think there are two choices:
1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
What's your opinion? Looking forward to your reply.
Best,
---------------------------------------------------------------
Hongyin Zhang
Re: Re: The structure of distribution
Posted by Guanfei Guo <gu...@qq.com.INVALID>.
+3 for Choice 2
Thanks.
Guanfei Guo
From: HW-Chao Wang
Date: 2022-07-06 15:57
To: dev
Subject: Re: The structure of distribution
choice 2
---Original---
From: "gaoyang"<453935989@qq.com.INVALID>
Date: Wed, Jul 6, 2022 15:53 PM
To: "dev"<dev@iotdb.apache.org>;
Subject: Re: The structure of distribution
+1 for Choice 2
> 2022年7月5日 下午5:54，SpriCoder <spricoder@qq.com.INVALID> 写道：
>
> Hi all,
>
> Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
>
> I think there are two choices:
>
> 1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
>
> 2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
>
>
>
>
> What's your opinion? Looking forward to your reply.
>
>
> Best,
>
> ---------------------------------------------------------------
>
> Hongyin Zhang
Re: The structure of distribution
Posted by HW-Chao Wang <57...@qq.com.INVALID>.
choice 2
---Original---
From: "gaoyang"<453935989@qq.com.INVALID>
Date: Wed, Jul 6, 2022 15:53 PM
To: "dev"<dev@iotdb.apache.org>;
Subject: Re: The structure of distribution
+1 for Choice 2
> 2022年7月5日 下午5:54，SpriCoder <spricoder@qq.com.INVALID> 写道：
>
> Hi all,
>
> Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
>
> I think there are two choices:
>
> 1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
>
> 2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
>
>
>
>
> What's your opinion? Looking forward to your reply.
>
>
> Best,
>
> ---------------------------------------------------------------
>
> Hongyin Zhang
Re: The structure of distribution
Posted by gaoyang <45...@qq.com.INVALID>.
+1 for Choice 2
> 2022年7月5日 下午5:54，SpriCoder <sp...@qq.com.INVALID> 写道：
>
> Hi all,
>
> Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
>
> I think there are two choices:
>
> 1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
>
> 2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
>
>
>
>
> What's your opinion? Looking forward to your reply.
>
>
> Best,
>
> ---------------------------------------------------------------
>
> Hongyin Zhang
Re:The structure of distribution
Posted by SpriCoder <sp...@qq.com.INVALID>.
lib folder is a single one under root folder like:
├── datanode
├── confignode
├── lib
------------------ Original ------------------
From: "SpriCoder" <spricoder@qq.com>;
Date: Tue, Jul 5, 2022 05:54 PM
To: "dev"<dev@iotdb.apache.org>;
Subject: The structure of distribution
Hi all,
Currently, we have confignode and datanode folder in the distribution. Which has conf, sbin, and will store the default folder of data and system. And there is a need to refactor distribution structure.
I think there are two choices:
1. remove the confignode and datanode folder, and combine their script and configuration files into the conf and sbin under the root. In this way all folder generated by confignode will be put into config folder, and all folder generated by confignode will be put into data folder.
2. use confignode and datanode folder to manage their script and configuration files, like: confignode/sbin, confignode/conf, datanode/sbin, datanode/conf, etc. In this way all folder generated by confignode will be put into confignode folder and all folder generated by datanode will be put into datanode folder.
What's your opinion? Looking forward to your reply.
Best,
---------------------------------------------------------------
Hongyin Zhang