You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@dolphinscheduler.apache.org by chendapao <fe...@163.com> on 2020/02/05 06:37:20 UTC
回复:Simplify Deployment of DolphinScheduler
hi all:
Happy New Year.
About Simplify Deployment of DolphinScheduler Mini web app, The URL of the latest: http://120.131.3.196:22245/start.html#g=1&p=start_1
Welcome to the discussion, make new idea.
If these is no problem, I will write the interface document in the these days.
WIth the `frontend` big brother, we can `ds-yibasuo`.
--
chendapao
feloxx@163.com
At 2020-01-19 15:30:08, "chendapao" <fe...@163.com> wrote:
>hi, all:
>
>
>I have an idea about simplifying deployment.
>
>
>The main idea is to implement a mini web app and call DevOps components.
>
>
>For example, call ansible, call SSH mutual trust program, And so on.
>
>
>Mini web app Implementation, I recommend using springboot + Front-end framework. Because I think there are more javaer in our community.
>
>
>In fact, I don't care about the back-end framework. I even want to do it in go language, Because no need to install jdk.
>
>
>Everyone can discuss, The purpose is to achieve mini web app.
>
>
>The data generated by all operations, I recommend to save it in local text, because the implementation cost is low. We can change it later to embed the database.
>
>
>The purpose is a mini web app, the data has local text, and you can start a fast DS trip. Can be on linux or windows.
>
>
>This is a prototype of the mini web app I designed, show yours the URL: http://152.136.97.112:8888/start.html#g=1&p=login
>
>
>
>
>
>
>
>
>--
>
>
>
>chendapao
>
>feloxx@163.com
>
>
>
>
>At 2020-01-10 12:01:13, "lidong dai" <da...@gmail.com> wrote:
>>hi
>>
>> Some users have feedback that the deployment is difficult. To this end, I
>>propose to optimize the deployment script to change the option that can be
>>changed into the option, and the next step can be performed automatically.
>>You can refer to the deployment method of ambari. Our goal is to complete
>>the cluster deployment in 30 minutes.
>>
>>
>> if you're interesting in do this Big Feature, please leave message.
>>
>>
>>
>>Best Regards
>>---------------
>>DolphinScheduler(Incubator) PPMC
>>Lidong Dai 代立冬
>>dailidong66@gmail.com
>>---------------
回复： Simplify Deployment of DolphinScheduler
Posted by Jave-Chen <ke...@foxmail.com>.
Good job .
------------------ 原始邮件 ------------------
发件人: "chendapao"<feloxx@163.com>;
发送时间: 2020年2月6日(星期四) 凌晨0:45
收件人: "dev@dolphinscheduler.apache.org"<dev@dolphinscheduler.apache.org>;
主题: 回复： Simplify Deployment of DolphinScheduler
1. Use "host" or "node" is better than "device".
reply: good idea.
2. Add some essential OS test for a new host/node , such like: JAVA_HOME , dscheduler install path etc. Test will be easyier for user to find problems.
reply: In devops, There are a lot of checks, The failure of the check will tell the user exactly what the error is.
for example 1: [check config] https://github.com/feloxx/ds-yibasuo/blob/master/roles/check_config_static/tasks/main.yml
for example 2: [check system] https://github.com/feloxx/ds-yibasuo/blob/master/roles/check_system_static/tasks/main.yml
--
chendapao
feloxx@163.com
在 2020-02-05 23:05:11，"Jave-Chen" <kejia.chen@foxmail.com> 写道：
>I have some suggestion:
>1. Use "host" or "node" is better than "device".
>2. Add some essential OS test for a new host/node , such like: JAVA_HOME , dscheduler install path etc. Test will be easyier for user to find problems.
>
>
>
>
>------------------&nbsp;原始邮件&nbsp;------------------
>发件人:&nbsp;"lidong dai"<dailidong66@gmail.com&gt;;
>发送时间:&nbsp;2020年2月5日(星期三) 晚上10:52
>收件人:&nbsp;"dev"<dev@dolphinscheduler.apache.org&gt;;
>
>主题:&nbsp;Re: Simplify Deployment of DolphinScheduler
>
>
>
>very good.
>
>anybody who have some ideas?
>
>
>
>Best Regards
>---------------
>DolphinScheduler(Incubator) PPMC
>Lidong Dai 代立冬
>dailidong66@gmail.com
>---------------
>
>
>chendapao <feloxx@163.com&gt; 于2020年2月5日周三 下午2:37写道：
>
>&gt; hi all:
>&gt;
>&gt;
>&gt; Happy New Year.
>&gt; About Simplify Deployment of DolphinScheduler Mini web app, The URL of the
>&gt; latest: http://120.131.3.196:22245/start.html#g=1&amp;p=start_1
>&gt; Welcome to the discussion, make new idea.
>&gt;
>&gt;
>&gt; If these is no problem, I will write the interface document in the these
>&gt; days.
>&gt;
>&gt; WIth the `frontend` big brother, we can `ds-yibasuo`.
>&gt;
>&gt;
>&gt;
>&gt;
>&gt;
>&gt;
>&gt; --
>&gt;
>&gt;
>&gt;
>&gt; chendapao
>&gt;
>&gt; feloxx@163.com
>&gt;
>&gt;
>&gt;
>&gt;
>&gt; At 2020-01-19 15:30:08, "chendapao" <feloxx@163.com&gt; wrote:
>&gt; &gt;hi, all:
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;I have an idea about simplifying deployment.
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;The main idea is to implement a mini web app and call DevOps components.
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;For example, call ansible, call SSH mutual trust program, And so on.
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;Mini web app Implementation, I recommend using springboot + Front-end
>&gt; framework. Because I think there are more javaer in our community.
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;In fact, I don't care about the back-end framework. I even want to do it
>&gt; in go language, Because no need to install jdk.
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;Everyone can discuss, The purpose is to achieve mini web app.
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;The data generated by all operations, I recommend to save it in local
>&gt; text, because the implementation cost is low. We can change it later to
>&gt; embed the database.
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;The purpose is a mini web app, the data has local text, and you can start
>&gt; a fast DS trip. Can be on linux or windows.
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;This is a prototype of the mini web app I designed, show yours the URL:
>&gt; http://152.136.97.112:8888/start.html#g=1&amp;p=login
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;--
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;chendapao
>&gt; &gt;
>&gt; &gt;feloxx@163.com
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;
>&gt; &gt;At 2020-01-10 12:01:13, "lidong dai" <dailidong66@gmail.com&gt; wrote:
>&gt; &gt;&gt;hi
>&gt; &gt;&gt;
>&gt; &gt;&gt;&nbsp; Some users have feedback that the deployment is difficult. To this
>&gt; end, I
>&gt; &gt;&gt;propose to optimize the deployment script to change the option that can
>&gt; be
>&gt; &gt;&gt;changed into the option, and the next step can be performed
>&gt; automatically.
>&gt; &gt;&gt;You can refer to the deployment method of ambari.&nbsp; Our goal is to
>&gt; complete
>&gt; &gt;&gt;the cluster deployment in 30 minutes.
>&gt; &gt;&gt;
>&gt; &gt;&gt;
>&gt; &gt;&gt; if you're interesting in do this Big Feature, please leave message.
>&gt; &gt;&gt;
>&gt; &gt;&gt;
>&gt; &gt;&gt;
>&gt; &gt;&gt;Best Regards
>&gt; &gt;&gt;---------------
>&gt; &gt;&gt;DolphinScheduler(Incubator) PPMC
>&gt; &gt;&gt;Lidong Dai 代立冬
>&gt; &gt;&gt;dailidong66@gmail.com
>&gt; &gt;&gt;---------------
>&gt;
回复： Simplify Deployment of DolphinScheduler
Posted by chendapao <fe...@163.com>.
1. Use "host" or "node" is better than "device".
reply: good idea.
2. Add some essential OS test for a new host/node , such like: JAVA_HOME , dscheduler install path etc. Test will be easyier for user to find problems.
reply: In devops, There are a lot of checks, The failure of the check will tell the user exactly what the error is.
for example 1: [check config] https://github.com/feloxx/ds-yibasuo/blob/master/roles/check_config_static/tasks/main.yml
for example 2: [check system] https://github.com/feloxx/ds-yibasuo/blob/master/roles/check_system_static/tasks/main.yml
--
chendapao
feloxx@163.com
在 2020-02-05 23:05:11，"Jave-Chen" <ke...@foxmail.com> 写道：
>I have some suggestion:
>1. Use "host" or "node" is better than "device".
>2. Add some essential OS test for a new host/node , such like: JAVA_HOME , dscheduler install path etc. Test will be easyier for user to find problems.
>
>
>
>
>------------------ 原始邮件 ------------------
>发件人: "lidong dai"<dailidong66@gmail.com>;
>发送时间: 2020年2月5日(星期三) 晚上10:52
>收件人: "dev"<dev@dolphinscheduler.apache.org>;
>
>主题: Re: Simplify Deployment of DolphinScheduler
>
>
>
>very good.
>
>anybody who have some ideas?
>
>
>
>Best Regards
>---------------
>DolphinScheduler(Incubator) PPMC
>Lidong Dai 代立冬
>dailidong66@gmail.com
>---------------
>
>
>chendapao <feloxx@163.com> 于2020年2月5日周三 下午2:37写道：
>
>> hi all:
>>
>>
>> Happy New Year.
>> About Simplify Deployment of DolphinScheduler Mini web app, The URL of the
>> latest: http://120.131.3.196:22245/start.html#g=1&p=start_1
>> Welcome to the discussion, make new idea.
>>
>>
>> If these is no problem, I will write the interface document in the these
>> days.
>>
>> WIth the `frontend` big brother, we can `ds-yibasuo`.
>>
>>
>>
>>
>>
>>
>> --
>>
>>
>>
>> chendapao
>>
>> feloxx@163.com
>>
>>
>>
>>
>> At 2020-01-19 15:30:08, "chendapao" <feloxx@163.com> wrote:
>> >hi, all:
>> >
>> >
>> >I have an idea about simplifying deployment.
>> >
>> >
>> >The main idea is to implement a mini web app and call DevOps components.
>> >
>> >
>> >For example, call ansible, call SSH mutual trust program, And so on.
>> >
>> >
>> >Mini web app Implementation, I recommend using springboot + Front-end
>> framework. Because I think there are more javaer in our community.
>> >
>> >
>> >In fact, I don't care about the back-end framework. I even want to do it
>> in go language, Because no need to install jdk.
>> >
>> >
>> >Everyone can discuss, The purpose is to achieve mini web app.
>> >
>> >
>> >The data generated by all operations, I recommend to save it in local
>> text, because the implementation cost is low. We can change it later to
>> embed the database.
>> >
>> >
>> >The purpose is a mini web app, the data has local text, and you can start
>> a fast DS trip. Can be on linux or windows.
>> >
>> >
>> >This is a prototype of the mini web app I designed, show yours the URL:
>> http://152.136.97.112:8888/start.html#g=1&p=login
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >--
>> >
>> >
>> >
>> >chendapao
>> >
>> >feloxx@163.com
>> >
>> >
>> >
>> >
>> >At 2020-01-10 12:01:13, "lidong dai" <dailidong66@gmail.com> wrote:
>> >>hi
>> >>
>> >> Some users have feedback that the deployment is difficult. To this
>> end, I
>> >>propose to optimize the deployment script to change the option that can
>> be
>> >>changed into the option, and the next step can be performed
>> automatically.
>> >>You can refer to the deployment method of ambari. Our goal is to
>> complete
>> >>the cluster deployment in 30 minutes.
>> >>
>> >>
>> >> if you're interesting in do this Big Feature, please leave message.
>> >>
>> >>
>> >>
>> >>Best Regards
>> >>---------------
>> >>DolphinScheduler(Incubator) PPMC
>> >>Lidong Dai 代立冬
>> >>dailidong66@gmail.com
>> >>---------------
>>
回复： Simplify Deployment of DolphinScheduler
Posted by Jave-Chen <ke...@foxmail.com>.
I have some suggestion:
1. Use "host" or "node" is better than "device".
2. Add some essential OS test for a new host/node , such like: JAVA_HOME , dscheduler install path etc. Test will be easyier for user to find problems.
------------------ 原始邮件 ------------------
发件人: "lidong dai"<dailidong66@gmail.com>;
发送时间: 2020年2月5日(星期三) 晚上10:52
收件人: "dev"<dev@dolphinscheduler.apache.org>;
主题: Re: Simplify Deployment of DolphinScheduler
very good.
anybody who have some ideas?
Best Regards
---------------
DolphinScheduler(Incubator) PPMC
Lidong Dai 代立冬
dailidong66@gmail.com
---------------
chendapao <feloxx@163.com> 于2020年2月5日周三 下午2:37写道：
> hi all:
>
>
> Happy New Year.
> About Simplify Deployment of DolphinScheduler Mini web app, The URL of the
> latest: http://120.131.3.196:22245/start.html#g=1&p=start_1
> Welcome to the discussion, make new idea.
>
>
> If these is no problem, I will write the interface document in the these
> days.
>
> WIth the `frontend` big brother, we can `ds-yibasuo`.
>
>
>
>
>
>
> --
>
>
>
> chendapao
>
> feloxx@163.com
>
>
>
>
> At 2020-01-19 15:30:08, "chendapao" <feloxx@163.com> wrote:
> >hi, all:
> >
> >
> >I have an idea about simplifying deployment.
> >
> >
> >The main idea is to implement a mini web app and call DevOps components.
> >
> >
> >For example, call ansible, call SSH mutual trust program, And so on.
> >
> >
> >Mini web app Implementation, I recommend using springboot + Front-end
> framework. Because I think there are more javaer in our community.
> >
> >
> >In fact, I don't care about the back-end framework. I even want to do it
> in go language, Because no need to install jdk.
> >
> >
> >Everyone can discuss, The purpose is to achieve mini web app.
> >
> >
> >The data generated by all operations, I recommend to save it in local
> text, because the implementation cost is low. We can change it later to
> embed the database.
> >
> >
> >The purpose is a mini web app, the data has local text, and you can start
> a fast DS trip. Can be on linux or windows.
> >
> >
> >This is a prototype of the mini web app I designed, show yours the URL:
> http://152.136.97.112:8888/start.html#g=1&p=login
> >
> >
> >
> >
> >
> >
> >
> >
> >--
> >
> >
> >
> >chendapao
> >
> >feloxx@163.com
> >
> >
> >
> >
> >At 2020-01-10 12:01:13, "lidong dai" <dailidong66@gmail.com> wrote:
> >>hi
> >>
> >> Some users have feedback that the deployment is difficult. To this
> end, I
> >>propose to optimize the deployment script to change the option that can
> be
> >>changed into the option, and the next step can be performed
> automatically.
> >>You can refer to the deployment method of ambari. Our goal is to
> complete
> >>the cluster deployment in 30 minutes.
> >>
> >>
> >> if you're interesting in do this Big Feature, please leave message.
> >>
> >>
> >>
> >>Best Regards
> >>---------------
> >>DolphinScheduler(Incubator) PPMC
> >>Lidong Dai 代立冬
> >>dailidong66@gmail.com
> >>---------------
>
Re: Simplify Deployment of DolphinScheduler
Posted by lidong dai <da...@gmail.com>.
very good.
anybody who have some ideas?
Best Regards
---------------
DolphinScheduler(Incubator) PPMC
Lidong Dai 代立冬
dailidong66@gmail.com
---------------
chendapao <fe...@163.com> 于2020年2月5日周三 下午2:37写道：
> hi all:
>
>
> Happy New Year.
> About Simplify Deployment of DolphinScheduler Mini web app, The URL of the
> latest: http://120.131.3.196:22245/start.html#g=1&p=start_1
> Welcome to the discussion, make new idea.
>
>
> If these is no problem, I will write the interface document in the these
> days.
>
> WIth the `frontend` big brother, we can `ds-yibasuo`.
>
>
>
>
>
>
> --
>
>
>
> chendapao
>
> feloxx@163.com
>
>
>
>
> At 2020-01-19 15:30:08, "chendapao" <fe...@163.com> wrote:
> >hi, all:
> >
> >
> >I have an idea about simplifying deployment.
> >
> >
> >The main idea is to implement a mini web app and call DevOps components.
> >
> >
> >For example, call ansible, call SSH mutual trust program, And so on.
> >
> >
> >Mini web app Implementation, I recommend using springboot + Front-end
> framework. Because I think there are more javaer in our community.
> >
> >
> >In fact, I don't care about the back-end framework. I even want to do it
> in go language, Because no need to install jdk.
> >
> >
> >Everyone can discuss, The purpose is to achieve mini web app.
> >
> >
> >The data generated by all operations, I recommend to save it in local
> text, because the implementation cost is low. We can change it later to
> embed the database.
> >
> >
> >The purpose is a mini web app, the data has local text, and you can start
> a fast DS trip. Can be on linux or windows.
> >
> >
> >This is a prototype of the mini web app I designed, show yours the URL:
> http://152.136.97.112:8888/start.html#g=1&p=login
> >
> >
> >
> >
> >
> >
> >
> >
> >--
> >
> >
> >
> >chendapao
> >
> >feloxx@163.com
> >
> >
> >
> >
> >At 2020-01-10 12:01:13, "lidong dai" <da...@gmail.com> wrote:
> >>hi
> >>
> >> Some users have feedback that the deployment is difficult. To this
> end, I
> >>propose to optimize the deployment script to change the option that can
> be
> >>changed into the option, and the next step can be performed
> automatically.
> >>You can refer to the deployment method of ambari. Our goal is to
> complete
> >>the cluster deployment in 30 minutes.
> >>
> >>
> >> if you're interesting in do this Big Feature, please leave message.
> >>
> >>
> >>
> >>Best Regards
> >>---------------
> >>DolphinScheduler(Incubator) PPMC
> >>Lidong Dai 代立冬
> >>dailidong66@gmail.com
> >>---------------
>