[Discuss] Apache Doris Manager 2022 Roadmap

[41108453 <41...@qq.com.INVALID>]

Hi All，


Doris Manager version 1.0 will be released at the end of February. This version can realize one-click visualization and automatic installation and deployment, start and stop, configuration management, etc. of Doris clusters. In this way, Doris Manager basically realizes the visual installation, deployment, and management of clusters, which greatly reduces the difficulty of using Doris for new users. For the subsequent development, our overall plan is as follows, and we will send an email for discussion.


I need everyone to discuss together to decide the follow-up function development of Doris Manager, and collect everyone's opinions and suggestions


The overall plan is as follows：


Doris stock cluster takeover


Existing cluster takeover (implementing takeover of installed clusters, including cluster configuration modification, startup, monitoring, etc.)




Doris visual upgrade support



Cluster node list management


Cluster overview view: such as node book, FE, BE, etc., running time, resource usage, number of running Load jobs, etc.




The current cluster list UI is optimized, refer to Ambari, change it to the machine list, and display the roles by tab (FE, BE, Broker)



You can click on the node to view the information of this node, including the relevant information of the node machine, installed services, node configuration information (BE, FE), node monitoring information (memory, disk, CPU, network, load, etc.)



On a specific node, the services on this node can be started and stopped, etc.



Can visualize elastic scaling clusters



Doris plugin support



Automatic installation and deployment of the audit log plug-in, realize the automatic installation of the audit log plug-in, and modify the configuration information of the plug-in at the same time.



Create a plug-in database, create a data table, and present the installation information of the plug-in, mainly the database and table information where the plug-in collects audit logs.



Give the query and display page of the audit log



Gradually weaken the current Doris web UI


Management of Doris cluster users, roles and permissions can be achieved through Doris Manager




Provides a SQL development console with associative input



Provides a visual display of SQL Profile, similar to HUE, which helps users analyze SQL performance



The SQL console supports saving queries for subsequent reuse after use, saving query history, etc.



The above function is also applicable to the analysis of the sql list on the current Web UI



The following is the discussion address on github：

Apache Doris Manager 2022 Roadmap · Issue #7986 · apache/incubator-doris (github.com)

Re:[Discuss] Apache Doris Manager 2022 Roadmap

[陈明雨 <mo...@163.com>]

Nice job.
But before release, we may need to migrate the code from the doris manager to a new repo.




--

此致！Best Regards
陈明雨 Mingyu Chen

Email:
chenmingyu@apache.org





At 2022-02-08 20:17:31, "41108453" <41...@qq.com.INVALID> wrote:
>Hi All，
>
>
>Doris Manager version 1.0 will be released at the end of February. This version can realize one-click visualization and automatic installation and deployment, start and stop, configuration management, etc. of Doris clusters. In this way, Doris Manager basically realizes the visual installation, deployment, and management of clusters, which greatly reduces the difficulty of using Doris for new users. For the subsequent development, our overall plan is as follows, and we will send an email for discussion.
>
>
>I need everyone to discuss together to decide the follow-up function development of Doris Manager, and collect everyone's opinions and suggestions
>
>
>The overall plan is as follows：
>
>
>Doris stock cluster takeover
>
>
>Existing cluster takeover (implementing takeover of installed clusters, including cluster configuration modification, startup, monitoring, etc.)
>
>
>
>
>Doris visual upgrade support
>
>
>
>Cluster node list management
>
>
>Cluster overview view: such as node book, FE, BE, etc., running time, resource usage, number of running Load jobs, etc.
>
>
>
>
>The current cluster list UI is optimized, refer to Ambari, change it to the machine list, and display the roles by tab (FE, BE, Broker)
>
>
>
>You can click on the node to view the information of this node, including the relevant information of the node machine, installed services, node configuration information (BE, FE), node monitoring information (memory, disk, CPU, network, load, etc.)
>
>
>
>On a specific node, the services on this node can be started and stopped, etc.
>
>
>
>Can visualize elastic scaling clusters
>
>
>
>Doris plugin support
>
>
>
>Automatic installation and deployment of the audit log plug-in, realize the automatic installation of the audit log plug-in, and modify the configuration information of the plug-in at the same time.
>
>
>
>Create a plug-in database, create a data table, and present the installation information of the plug-in, mainly the database and table information where the plug-in collects audit logs.
>
>
>
>Give the query and display page of the audit log
>
>
>
>Gradually weaken the current Doris web UI
>
>
>Management of Doris cluster users, roles and permissions can be achieved through Doris Manager
>
>
>
>
>Provides a SQL development console with associative input
>
>
>
>Provides a visual display of SQL Profile, similar to HUE, which helps users analyze SQL performance
>
>
>
>The SQL console supports saving queries for subsequent reuse after use, saving query history, etc.
>
>
>
>The above function is also applicable to the analysis of the sql list on the current Web UI
>
>
>
>The following is the discussion address on github：
>
>Apache Doris Manager 2022 Roadmap · Issue #7986 · apache/incubator-doris (github.com)