You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@dolphinscheduler.apache.org by Jiajie Zhong <zh...@gmail.com> on 2022/07/26 02:29:35 UTC
[DISCUSS] DolphinScheduler 3.0.0 release in early August
Hey guys,
We plan to release DolphinScheduler 3.0.0 in early August. Version
3.0.0 tries to fix some bugs and correct some docs based on
3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
already create new branch named `3.0.0-prepare` in repository
apache/dolphinscheduler. We invite our community to test this prepare
branch.
Currently, we have some known issues in the link[1], some of them
still not assigned to someone and it is encouraged to reply and take
them directly in the issue if you are interested in them.
If you have other issues you want to fix in version 3.0.0. please let
us know in this mail thread
[1]: https://github.com/apache/dolphinscheduler/milestone/32
--
Best Wish
— Jiajie
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by Jiajie Zhong <zh...@gmail.com>.
Thank chufeng,
yeah, it seem will raise error when log file in a long path, we should
change `log_path` type from `varchar(200)` to text to ensure it will
not raise error, I will add a independent patch to branch
3.0.0-prepare, and then add another patch to dev branch after [1]
merged
[1]: https://github.com/apache/dolphinscheduler/pull/11258
On Sat, Jul 30, 2022 at 11:06 PM Chufeng Gao <ch...@gmail.com> wrote:
>
> Hi Jiajie,
>
> I've tested the zeppelin task plugin of branch 3.0.0-prepare and it works
> as expected.
>
> However, during the test, I encountered something I had never run into
> before and it doesn't happen on current dev branch either.
> That is, if the length of the path of the log folder is too long, the
> worker server seems not to start. We could reproduce this issue by putting
> the root directory under some directory with long path name. In the log,
> you will see some errors like `Error updating database. Cause:
> org.h2.jdbc.JdbcSQLDataException: Value too long for column "log_path
> VARCHAR(200)":
> "'/Users/ericgao888/workplace/external/dolphin-scheduler/dolphinscheduler/dolphinscheduler-dist/target/apache-dolphinscheduler-3.0.0...
> (203)"; SQL statement:`.
>
> What about increase the threshold a little bit?
>
> *Best Regards,*
>
> *Chufeng (Eric) Gao*
>
>
>
> Jiajie Zhong <zh...@gmail.com> 于2022年7月29日周五 11:34写道：
>
> > BTW, for some who want to test task type extend `AbstractYarnTask`, we
> > have a `need to verify` issue[1] for yarn base task, please test those
> > task behavior, if it is pass please let us know in this mail thread
> > and related issue[1], thanks
> >
> > cc: ZiHao
> >
> > [1]: https://github.com/apache/dolphinscheduler/issues/10809
> >
> > On Fri, Jul 29, 2022 at 11:27 AM Jiajie Zhong <zh...@gmail.com>
> > wrote:
> > >
> > > The good news is I add new commit to branch `3.0.0-prepare` and add CI
> > > pass expect `cluster-test` so you guys can fetch the latest branch and
> > > build it locally
> > >
> > > On Fri, Jul 29, 2022 at 11:19 AM Jiajie Zhong <zh...@gmail.com>
> > wrote:
> > > >
> > > > Thank you for your help. You guys can send your test results to this
> > > > mail thread after you finish your test,
> > > >
> > > > BTW, some bad cherry pick by myself cause branch 3.0.0-prepare can
> > > > not pass the build process, And I add a new pull requests to correct
> > > > it[1], will merge it ASAP
> > > >
> > > > [1] https://github.com/apache/dolphinscheduler/pull/11194
> > > >
> > > > On Thu, Jul 28, 2022 at 5:00 PM <59...@qq.com.invalid> wrote:
> > > > >
> > > > > Hi Jiajie:
> > > > >
> > > > >
> > > > > I could help test the Telegram alert plugin
> > > > >
> > > > > Best Wish
> > > > > Xuetong Zhu
> > > > >
> > > > > > 在 2022年7月28日，16:52，Draven Li (qingwli) <qi...@cisco.com.invalid>
> > 写道：
> > > > > >
> > > > > > Hi Jiajie:
> > > > > >
> > > > > >
> > > > > > I could help test the Webex Teams alert plugin
> > > > > >
> > > > > >
> > > > > > Thanks
> > > > > >
> > > > > >
> > > > > > From: Jiajie Zhong <zh...@gmail.com>
> > > > > > Date: Thursday, July 28, 2022 at 16:27
> > > > > > To: dev@dolphinscheduler.apache.org <
> > dev@dolphinscheduler.apache.org>
> > > > > > Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early
> > August
> > > > > > Hey guys,
> > > > > >
> > > > > > It is close to the day we plan to release version 3.0.0. Some of
> > our
> > > > > > community are testing the branch 3.0.0-prepare[1]. But we do not
> > have
> > > > > > all of the environment to the whole task/datasource/alert type. So
> > I
> > > > > > am here to see whether some of you guys have the environment can
> > give
> > > > > > me a hand to test whether the plugin work or not:
> > > > > >
> > > > > > * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
> > > > > > * Datasource: SQL Server, Presto, ClickHouse, DB2
> > > > > > * Alert: Enterprise WeChat, Webex Teams, Telegram
> > > > > >
> > > > > > If you are interested in testing some of the plugins, please let me
> > > > > > know in this mail thread.
> > > > > >
> > > > > > After you finish your test, you can send another append mail and to
> > > > > > tell us the result of your test, and create an issue if it have
> > some
> > > > > > error
> > > > > >
> > > > > > [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
> > > > > >
> > > > > >> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <
> > zhongjiajie955@gmail.com> wrote:
> > > > > >>
> > > > > >> Hey guys,
> > > > > >>
> > > > > >> We plan to release DolphinScheduler 3.0.0 in early August. Version
> > > > > >> 3.0.0 tries to fix some bugs and correct some docs based on
> > > > > >> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
> > > > > >> already create new branch named `3.0.0-prepare` in repository
> > > > > >> apache/dolphinscheduler. We invite our community to test this
> > prepare
> > > > > >> branch.
> > > > > >>
> > > > > >> Currently, we have some known issues in the link[1], some of them
> > > > > >> still not assigned to someone and it is encouraged to reply and
> > take
> > > > > >> them directly in the issue if you are interested in them.
> > > > > >>
> > > > > >> If you have other issues you want to fix in version 3.0.0. please
> > let
> > > > > >> us know in this mail thread
> > > > > >>
> > > > > >> [1]: https://github.com/apache/dolphinscheduler/milestone/32
> > > > > >>
> > > > > >> --
> > > > > >> Best Wish
> > > > > >> — Jiajie
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Best Wish
> > > > > > — Jiajie
> > > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Best Wish
> > > > — Jiajie
> > >
> > >
> > >
> > > --
> > > Best Wish
> > > — Jiajie
> >
> >
> >
> > --
> > Best Wish
> > — Jiajie
> >
--
Best Wish
— Jiajie
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by SbloodyS <zi...@apache.org>.
Hi JiaJie,
The test environment I use is AWS EMR 6.6.0 distribution. Which is Hive 3.1.2/Spark 3.2.0/Flink 1.14.2/PrestoSQL 0.267 and additional installed Flink 1.12.1.
I’ve test the Spark/Flink task plugin and the Presto datasource plugin and the Enterprise WeChat alert plugin and it works as expected.
--
Best Wishes
ZiHao
> 2022年7月30日 23:04，Chufeng Gao <ch...@gmail.com> 写道：
>
> Hi Jiajie,
>
> I've tested the zeppelin task plugin of branch 3.0.0-prepare and it works
> as expected.
>
> However, during the test, I encountered something I had never run into
> before and it doesn't happen on current dev branch either.
> That is, if the length of the path of the log folder is too long, the
> worker server seems not to start. We could reproduce this issue by putting
> the root directory under some directory with long path name. In the log,
> you will see some errors like `Error updating database. Cause:
> org.h2.jdbc.JdbcSQLDataException: Value too long for column "log_path
> VARCHAR(200)":
> "'/Users/ericgao888/workplace/external/dolphin-scheduler/dolphinscheduler/dolphinscheduler-dist/target/apache-dolphinscheduler-3.0.0...
> (203)"; SQL statement:`.
>
> What about increase the threshold a little bit?
>
> *Best Regards,*
>
> *Chufeng (Eric) Gao*
>
>
>
> Jiajie Zhong <zh...@gmail.com> 于2022年7月29日周五 11:34写道：
>
>> BTW, for some who want to test task type extend `AbstractYarnTask`, we
>> have a `need to verify` issue[1] for yarn base task, please test those
>> task behavior, if it is pass please let us know in this mail thread
>> and related issue[1], thanks
>>
>> cc: ZiHao
>>
>> [1]: https://github.com/apache/dolphinscheduler/issues/10809
>>
>> On Fri, Jul 29, 2022 at 11:27 AM Jiajie Zhong <zh...@gmail.com>
>> wrote:
>>>
>>> The good news is I add new commit to branch `3.0.0-prepare` and add CI
>>> pass expect `cluster-test` so you guys can fetch the latest branch and
>>> build it locally
>>>
>>> On Fri, Jul 29, 2022 at 11:19 AM Jiajie Zhong <zh...@gmail.com>
>> wrote:
>>>>
>>>> Thank you for your help. You guys can send your test results to this
>>>> mail thread after you finish your test,
>>>>
>>>> BTW, some bad cherry pick by myself cause branch 3.0.0-prepare can
>>>> not pass the build process, And I add a new pull requests to correct
>>>> it[1], will merge it ASAP
>>>>
>>>> [1] https://github.com/apache/dolphinscheduler/pull/11194
>>>>
>>>> On Thu, Jul 28, 2022 at 5:00 PM <59...@qq.com.invalid> wrote:
>>>>>
>>>>> Hi Jiajie:
>>>>>
>>>>>
>>>>> I could help test the Telegram alert plugin
>>>>>
>>>>> Best Wish
>>>>> Xuetong Zhu
>>>>>
>>>>>> 在 2022年7月28日，16:52，Draven Li (qingwli) <qi...@cisco.com.invalid>
>> 写道：
>>>>>>
>>>>>> Hi Jiajie:
>>>>>>
>>>>>>
>>>>>> I could help test the Webex Teams alert plugin
>>>>>>
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>>
>>>>>> From: Jiajie Zhong <zh...@gmail.com>
>>>>>> Date: Thursday, July 28, 2022 at 16:27
>>>>>> To: dev@dolphinscheduler.apache.org <
>> dev@dolphinscheduler.apache.org>
>>>>>> Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early
>> August
>>>>>> Hey guys,
>>>>>>
>>>>>> It is close to the day we plan to release version 3.0.0. Some of
>> our
>>>>>> community are testing the branch 3.0.0-prepare[1]. But we do not
>> have
>>>>>> all of the environment to the whole task/datasource/alert type. So
>> I
>>>>>> am here to see whether some of you guys have the environment can
>> give
>>>>>> me a hand to test whether the plugin work or not:
>>>>>>
>>>>>> * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
>>>>>> * Datasource: SQL Server, Presto, ClickHouse, DB2
>>>>>> * Alert: Enterprise WeChat, Webex Teams, Telegram
>>>>>>
>>>>>> If you are interested in testing some of the plugins, please let me
>>>>>> know in this mail thread.
>>>>>>
>>>>>> After you finish your test, you can send another append mail and to
>>>>>> tell us the result of your test, and create an issue if it have
>> some
>>>>>> error
>>>>>>
>>>>>> [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
>>>>>>
>>>>>>> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <
>> zhongjiajie955@gmail.com> wrote:
>>>>>>>
>>>>>>> Hey guys,
>>>>>>>
>>>>>>> We plan to release DolphinScheduler 3.0.0 in early August. Version
>>>>>>> 3.0.0 tries to fix some bugs and correct some docs based on
>>>>>>> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
>>>>>>> already create new branch named `3.0.0-prepare` in repository
>>>>>>> apache/dolphinscheduler. We invite our community to test this
>> prepare
>>>>>>> branch.
>>>>>>>
>>>>>>> Currently, we have some known issues in the link[1], some of them
>>>>>>> still not assigned to someone and it is encouraged to reply and
>> take
>>>>>>> them directly in the issue if you are interested in them.
>>>>>>>
>>>>>>> If you have other issues you want to fix in version 3.0.0. please
>> let
>>>>>>> us know in this mail thread
>>>>>>>
>>>>>>> [1]: https://github.com/apache/dolphinscheduler/milestone/32
>>>>>>>
>>>>>>> --
>>>>>>> Best Wish
>>>>>>> — Jiajie
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Best Wish
>>>>>> — Jiajie
>>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Best Wish
>>>> — Jiajie
>>>
>>>
>>>
>>> --
>>> Best Wish
>>> — Jiajie
>>
>>
>>
>> --
>> Best Wish
>> — Jiajie
>>
>
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by Chufeng Gao <ch...@gmail.com>.
Hi Jiajie,
I've tested the zeppelin task plugin of branch 3.0.0-prepare and it works
as expected.
However, during the test, I encountered something I had never run into
before and it doesn't happen on current dev branch either.
That is, if the length of the path of the log folder is too long, the
worker server seems not to start. We could reproduce this issue by putting
the root directory under some directory with long path name. In the log,
you will see some errors like `Error updating database. Cause:
org.h2.jdbc.JdbcSQLDataException: Value too long for column "log_path
VARCHAR(200)":
"'/Users/ericgao888/workplace/external/dolphin-scheduler/dolphinscheduler/dolphinscheduler-dist/target/apache-dolphinscheduler-3.0.0...
(203)"; SQL statement:`.
What about increase the threshold a little bit?
*Best Regards,*
*Chufeng (Eric) Gao*
Jiajie Zhong <zh...@gmail.com> 于2022年7月29日周五 11:34写道：
> BTW, for some who want to test task type extend `AbstractYarnTask`, we
> have a `need to verify` issue[1] for yarn base task, please test those
> task behavior, if it is pass please let us know in this mail thread
> and related issue[1], thanks
>
> cc: ZiHao
>
> [1]: https://github.com/apache/dolphinscheduler/issues/10809
>
> On Fri, Jul 29, 2022 at 11:27 AM Jiajie Zhong <zh...@gmail.com>
> wrote:
> >
> > The good news is I add new commit to branch `3.0.0-prepare` and add CI
> > pass expect `cluster-test` so you guys can fetch the latest branch and
> > build it locally
> >
> > On Fri, Jul 29, 2022 at 11:19 AM Jiajie Zhong <zh...@gmail.com>
> wrote:
> > >
> > > Thank you for your help. You guys can send your test results to this
> > > mail thread after you finish your test,
> > >
> > > BTW, some bad cherry pick by myself cause branch 3.0.0-prepare can
> > > not pass the build process, And I add a new pull requests to correct
> > > it[1], will merge it ASAP
> > >
> > > [1] https://github.com/apache/dolphinscheduler/pull/11194
> > >
> > > On Thu, Jul 28, 2022 at 5:00 PM <59...@qq.com.invalid> wrote:
> > > >
> > > > Hi Jiajie:
> > > >
> > > >
> > > > I could help test the Telegram alert plugin
> > > >
> > > > Best Wish
> > > > Xuetong Zhu
> > > >
> > > > > 在 2022年7月28日，16:52，Draven Li (qingwli) <qi...@cisco.com.invalid>
> 写道：
> > > > >
> > > > > Hi Jiajie:
> > > > >
> > > > >
> > > > > I could help test the Webex Teams alert plugin
> > > > >
> > > > >
> > > > > Thanks
> > > > >
> > > > >
> > > > > From: Jiajie Zhong <zh...@gmail.com>
> > > > > Date: Thursday, July 28, 2022 at 16:27
> > > > > To: dev@dolphinscheduler.apache.org <
> dev@dolphinscheduler.apache.org>
> > > > > Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early
> August
> > > > > Hey guys,
> > > > >
> > > > > It is close to the day we plan to release version 3.0.0. Some of
> our
> > > > > community are testing the branch 3.0.0-prepare[1]. But we do not
> have
> > > > > all of the environment to the whole task/datasource/alert type. So
> I
> > > > > am here to see whether some of you guys have the environment can
> give
> > > > > me a hand to test whether the plugin work or not:
> > > > >
> > > > > * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
> > > > > * Datasource: SQL Server, Presto, ClickHouse, DB2
> > > > > * Alert: Enterprise WeChat, Webex Teams, Telegram
> > > > >
> > > > > If you are interested in testing some of the plugins, please let me
> > > > > know in this mail thread.
> > > > >
> > > > > After you finish your test, you can send another append mail and to
> > > > > tell us the result of your test, and create an issue if it have
> some
> > > > > error
> > > > >
> > > > > [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
> > > > >
> > > > >> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <
> zhongjiajie955@gmail.com> wrote:
> > > > >>
> > > > >> Hey guys,
> > > > >>
> > > > >> We plan to release DolphinScheduler 3.0.0 in early August. Version
> > > > >> 3.0.0 tries to fix some bugs and correct some docs based on
> > > > >> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
> > > > >> already create new branch named `3.0.0-prepare` in repository
> > > > >> apache/dolphinscheduler. We invite our community to test this
> prepare
> > > > >> branch.
> > > > >>
> > > > >> Currently, we have some known issues in the link[1], some of them
> > > > >> still not assigned to someone and it is encouraged to reply and
> take
> > > > >> them directly in the issue if you are interested in them.
> > > > >>
> > > > >> If you have other issues you want to fix in version 3.0.0. please
> let
> > > > >> us know in this mail thread
> > > > >>
> > > > >> [1]: https://github.com/apache/dolphinscheduler/milestone/32
> > > > >>
> > > > >> --
> > > > >> Best Wish
> > > > >> — Jiajie
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Best Wish
> > > > > — Jiajie
> > > > >
> > > >
> > >
> > >
> > > --
> > > Best Wish
> > > — Jiajie
> >
> >
> >
> > --
> > Best Wish
> > — Jiajie
>
>
>
> --
> Best Wish
> — Jiajie
>
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by Jiajie Zhong <zh...@gmail.com>.
BTW, for some who want to test task type extend `AbstractYarnTask`, we
have a `need to verify` issue[1] for yarn base task, please test those
task behavior, if it is pass please let us know in this mail thread
and related issue[1], thanks
cc: ZiHao
[1]: https://github.com/apache/dolphinscheduler/issues/10809
On Fri, Jul 29, 2022 at 11:27 AM Jiajie Zhong <zh...@gmail.com> wrote:
>
> The good news is I add new commit to branch `3.0.0-prepare` and add CI
> pass expect `cluster-test` so you guys can fetch the latest branch and
> build it locally
>
> On Fri, Jul 29, 2022 at 11:19 AM Jiajie Zhong <zh...@gmail.com> wrote:
> >
> > Thank you for your help. You guys can send your test results to this
> > mail thread after you finish your test,
> >
> > BTW, some bad cherry pick by myself cause branch 3.0.0-prepare can
> > not pass the build process, And I add a new pull requests to correct
> > it[1], will merge it ASAP
> >
> > [1] https://github.com/apache/dolphinscheduler/pull/11194
> >
> > On Thu, Jul 28, 2022 at 5:00 PM <59...@qq.com.invalid> wrote:
> > >
> > > Hi Jiajie:
> > >
> > >
> > > I could help test the Telegram alert plugin
> > >
> > > Best Wish
> > > Xuetong Zhu
> > >
> > > > 在 2022年7月28日，16:52，Draven Li (qingwli) <qi...@cisco.com.invalid> 写道：
> > > >
> > > > Hi Jiajie:
> > > >
> > > >
> > > > I could help test the Webex Teams alert plugin
> > > >
> > > >
> > > > Thanks
> > > >
> > > >
> > > > From: Jiajie Zhong <zh...@gmail.com>
> > > > Date: Thursday, July 28, 2022 at 16:27
> > > > To: dev@dolphinscheduler.apache.org <de...@dolphinscheduler.apache.org>
> > > > Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
> > > > Hey guys,
> > > >
> > > > It is close to the day we plan to release version 3.0.0. Some of our
> > > > community are testing the branch 3.0.0-prepare[1]. But we do not have
> > > > all of the environment to the whole task/datasource/alert type. So I
> > > > am here to see whether some of you guys have the environment can give
> > > > me a hand to test whether the plugin work or not:
> > > >
> > > > * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
> > > > * Datasource: SQL Server, Presto, ClickHouse, DB2
> > > > * Alert: Enterprise WeChat, Webex Teams, Telegram
> > > >
> > > > If you are interested in testing some of the plugins, please let me
> > > > know in this mail thread.
> > > >
> > > > After you finish your test, you can send another append mail and to
> > > > tell us the result of your test, and create an issue if it have some
> > > > error
> > > >
> > > > [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
> > > >
> > > >> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <zh...@gmail.com> wrote:
> > > >>
> > > >> Hey guys,
> > > >>
> > > >> We plan to release DolphinScheduler 3.0.0 in early August. Version
> > > >> 3.0.0 tries to fix some bugs and correct some docs based on
> > > >> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
> > > >> already create new branch named `3.0.0-prepare` in repository
> > > >> apache/dolphinscheduler. We invite our community to test this prepare
> > > >> branch.
> > > >>
> > > >> Currently, we have some known issues in the link[1], some of them
> > > >> still not assigned to someone and it is encouraged to reply and take
> > > >> them directly in the issue if you are interested in them.
> > > >>
> > > >> If you have other issues you want to fix in version 3.0.0. please let
> > > >> us know in this mail thread
> > > >>
> > > >> [1]: https://github.com/apache/dolphinscheduler/milestone/32
> > > >>
> > > >> --
> > > >> Best Wish
> > > >> — Jiajie
> > > >
> > > >
> > > >
> > > > --
> > > > Best Wish
> > > > — Jiajie
> > > >
> > >
> >
> >
> > --
> > Best Wish
> > — Jiajie
>
>
>
> --
> Best Wish
> — Jiajie
--
Best Wish
— Jiajie
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by Jiajie Zhong <zh...@gmail.com>.
The good news is I add new commit to branch `3.0.0-prepare` and add CI
pass expect `cluster-test` so you guys can fetch the latest branch and
build it locally
On Fri, Jul 29, 2022 at 11:19 AM Jiajie Zhong <zh...@gmail.com> wrote:
>
> Thank you for your help. You guys can send your test results to this
> mail thread after you finish your test,
>
> BTW, some bad cherry pick by myself cause branch 3.0.0-prepare can
> not pass the build process, And I add a new pull requests to correct
> it[1], will merge it ASAP
>
> [1] https://github.com/apache/dolphinscheduler/pull/11194
>
> On Thu, Jul 28, 2022 at 5:00 PM <59...@qq.com.invalid> wrote:
> >
> > Hi Jiajie:
> >
> >
> > I could help test the Telegram alert plugin
> >
> > Best Wish
> > Xuetong Zhu
> >
> > > 在 2022年7月28日，16:52，Draven Li (qingwli) <qi...@cisco.com.invalid> 写道：
> > >
> > > Hi Jiajie:
> > >
> > >
> > > I could help test the Webex Teams alert plugin
> > >
> > >
> > > Thanks
> > >
> > >
> > > From: Jiajie Zhong <zh...@gmail.com>
> > > Date: Thursday, July 28, 2022 at 16:27
> > > To: dev@dolphinscheduler.apache.org <de...@dolphinscheduler.apache.org>
> > > Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
> > > Hey guys,
> > >
> > > It is close to the day we plan to release version 3.0.0. Some of our
> > > community are testing the branch 3.0.0-prepare[1]. But we do not have
> > > all of the environment to the whole task/datasource/alert type. So I
> > > am here to see whether some of you guys have the environment can give
> > > me a hand to test whether the plugin work or not:
> > >
> > > * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
> > > * Datasource: SQL Server, Presto, ClickHouse, DB2
> > > * Alert: Enterprise WeChat, Webex Teams, Telegram
> > >
> > > If you are interested in testing some of the plugins, please let me
> > > know in this mail thread.
> > >
> > > After you finish your test, you can send another append mail and to
> > > tell us the result of your test, and create an issue if it have some
> > > error
> > >
> > > [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
> > >
> > >> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <zh...@gmail.com> wrote:
> > >>
> > >> Hey guys,
> > >>
> > >> We plan to release DolphinScheduler 3.0.0 in early August. Version
> > >> 3.0.0 tries to fix some bugs and correct some docs based on
> > >> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
> > >> already create new branch named `3.0.0-prepare` in repository
> > >> apache/dolphinscheduler. We invite our community to test this prepare
> > >> branch.
> > >>
> > >> Currently, we have some known issues in the link[1], some of them
> > >> still not assigned to someone and it is encouraged to reply and take
> > >> them directly in the issue if you are interested in them.
> > >>
> > >> If you have other issues you want to fix in version 3.0.0. please let
> > >> us know in this mail thread
> > >>
> > >> [1]: https://github.com/apache/dolphinscheduler/milestone/32
> > >>
> > >> --
> > >> Best Wish
> > >> — Jiajie
> > >
> > >
> > >
> > > --
> > > Best Wish
> > > — Jiajie
> > >
> >
>
>
> --
> Best Wish
> — Jiajie
--
Best Wish
— Jiajie
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by Jiajie Zhong <zh...@gmail.com>.
Thank you for your help. You guys can send your test results to this
mail thread after you finish your test,
BTW, some bad cherry pick by myself cause branch 3.0.0-prepare can
not pass the build process, And I add a new pull requests to correct
it[1], will merge it ASAP
[1] https://github.com/apache/dolphinscheduler/pull/11194
On Thu, Jul 28, 2022 at 5:00 PM <59...@qq.com.invalid> wrote:
>
> Hi Jiajie:
>
>
> I could help test the Telegram alert plugin
>
> Best Wish
> Xuetong Zhu
>
> > 在 2022年7月28日，16:52，Draven Li (qingwli) <qi...@cisco.com.invalid> 写道：
> >
> > Hi Jiajie:
> >
> >
> > I could help test the Webex Teams alert plugin
> >
> >
> > Thanks
> >
> >
> > From: Jiajie Zhong <zh...@gmail.com>
> > Date: Thursday, July 28, 2022 at 16:27
> > To: dev@dolphinscheduler.apache.org <de...@dolphinscheduler.apache.org>
> > Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
> > Hey guys,
> >
> > It is close to the day we plan to release version 3.0.0. Some of our
> > community are testing the branch 3.0.0-prepare[1]. But we do not have
> > all of the environment to the whole task/datasource/alert type. So I
> > am here to see whether some of you guys have the environment can give
> > me a hand to test whether the plugin work or not:
> >
> > * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
> > * Datasource: SQL Server, Presto, ClickHouse, DB2
> > * Alert: Enterprise WeChat, Webex Teams, Telegram
> >
> > If you are interested in testing some of the plugins, please let me
> > know in this mail thread.
> >
> > After you finish your test, you can send another append mail and to
> > tell us the result of your test, and create an issue if it have some
> > error
> >
> > [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
> >
> >> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <zh...@gmail.com> wrote:
> >>
> >> Hey guys,
> >>
> >> We plan to release DolphinScheduler 3.0.0 in early August. Version
> >> 3.0.0 tries to fix some bugs and correct some docs based on
> >> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
> >> already create new branch named `3.0.0-prepare` in repository
> >> apache/dolphinscheduler. We invite our community to test this prepare
> >> branch.
> >>
> >> Currently, we have some known issues in the link[1], some of them
> >> still not assigned to someone and it is encouraged to reply and take
> >> them directly in the issue if you are interested in them.
> >>
> >> If you have other issues you want to fix in version 3.0.0. please let
> >> us know in this mail thread
> >>
> >> [1]: https://github.com/apache/dolphinscheduler/milestone/32
> >>
> >> --
> >> Best Wish
> >> — Jiajie
> >
> >
> >
> > --
> > Best Wish
> > — Jiajie
> >
>
--
Best Wish
— Jiajie
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by 59...@qq.com.INVALID.
Hi Jiajie:
I could help test the Telegram alert plugin
Best Wish
Xuetong Zhu
> 在 2022年7月28日，16:52，Draven Li (qingwli) <qi...@cisco.com.invalid> 写道：
>
> Hi Jiajie:
>
>
> I could help test the Webex Teams alert plugin
>
>
> Thanks
>
>
> From: Jiajie Zhong <zh...@gmail.com>
> Date: Thursday, July 28, 2022 at 16:27
> To: dev@dolphinscheduler.apache.org <de...@dolphinscheduler.apache.org>
> Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
> Hey guys,
>
> It is close to the day we plan to release version 3.0.0. Some of our
> community are testing the branch 3.0.0-prepare[1]. But we do not have
> all of the environment to the whole task/datasource/alert type. So I
> am here to see whether some of you guys have the environment can give
> me a hand to test whether the plugin work or not:
>
> * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
> * Datasource: SQL Server, Presto, ClickHouse, DB2
> * Alert: Enterprise WeChat, Webex Teams, Telegram
>
> If you are interested in testing some of the plugins, please let me
> know in this mail thread.
>
> After you finish your test, you can send another append mail and to
> tell us the result of your test, and create an issue if it have some
> error
>
> [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
>
>> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <zh...@gmail.com> wrote:
>>
>> Hey guys,
>>
>> We plan to release DolphinScheduler 3.0.0 in early August. Version
>> 3.0.0 tries to fix some bugs and correct some docs based on
>> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
>> already create new branch named `3.0.0-prepare` in repository
>> apache/dolphinscheduler. We invite our community to test this prepare
>> branch.
>>
>> Currently, we have some known issues in the link[1], some of them
>> still not assigned to someone and it is encouraged to reply and take
>> them directly in the issue if you are interested in them.
>>
>> If you have other issues you want to fix in version 3.0.0. please let
>> us know in this mail thread
>>
>> [1]: https://github.com/apache/dolphinscheduler/milestone/32
>>
>> --
>> Best Wish
>> — Jiajie
>
>
>
> --
> Best Wish
> — Jiajie
>
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by Jiajie Zhong <zh...@gmail.com>.
Thanks qingwli for the help
On Sat, Aug 6, 2022 at 9:24 AM Draven Li (qingwli)
<qi...@cisco.com.invalid> wrote:
>
> Hi Jiajie,
>
> I've tested the Webex Teams alert plugin of branch 3.0.0-prepare && 3.0.0-release and it works as expected.
>
>
> Thanks
>
>
> From: Draven Li (qingwli) <qi...@cisco.com.INVALID>
> Date: Thursday, July 28, 2022 at 16:51
> To: dev@dolphinscheduler.apache.org <de...@dolphinscheduler.apache.org>
> Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
> Hi Jiajie:
>
>
> I could help test the Webex Teams alert plugin
>
>
> Thanks
>
>
> From: Jiajie Zhong <zh...@gmail.com>
> Date: Thursday, July 28, 2022 at 16:27
> To: dev@dolphinscheduler.apache.org <de...@dolphinscheduler.apache.org>
> Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
> Hey guys,
>
> It is close to the day we plan to release version 3.0.0. Some of our
> community are testing the branch 3.0.0-prepare[1]. But we do not have
> all of the environment to the whole task/datasource/alert type. So I
> am here to see whether some of you guys have the environment can give
> me a hand to test whether the plugin work or not:
>
> * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
> * Datasource: SQL Server, Presto, ClickHouse, DB2
> * Alert: Enterprise WeChat, Webex Teams, Telegram
>
> If you are interested in testing some of the plugins, please let me
> know in this mail thread.
>
> After you finish your test, you can send another append mail and to
> tell us the result of your test, and create an issue if it have some
> error
>
> [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
>
> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <zh...@gmail.com> wrote:
> >
> > Hey guys,
> >
> > We plan to release DolphinScheduler 3.0.0 in early August. Version
> > 3.0.0 tries to fix some bugs and correct some docs based on
> > 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
> > already create new branch named `3.0.0-prepare` in repository
> > apache/dolphinscheduler. We invite our community to test this prepare
> > branch.
> >
> > Currently, we have some known issues in the link[1], some of them
> > still not assigned to someone and it is encouraged to reply and take
> > them directly in the issue if you are interested in them.
> >
> > If you have other issues you want to fix in version 3.0.0. please let
> > us know in this mail thread
> >
> > [1]: https://github.com/apache/dolphinscheduler/milestone/32
> >
> > --
> > Best Wish
> > — Jiajie
>
>
>
> --
> Best Wish
> — Jiajie
--
Best Wish
— Jiajie
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by "Draven Li (qingwli)" <qi...@cisco.com.INVALID>.
Hi Jiajie,
I've tested the Webex Teams alert plugin of branch 3.0.0-prepare && 3.0.0-release and it works as expected.
Thanks
From: Draven Li (qingwli) <qi...@cisco.com.INVALID>
Date: Thursday, July 28, 2022 at 16:51
To: dev@dolphinscheduler.apache.org <de...@dolphinscheduler.apache.org>
Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Hi Jiajie:
I could help test the Webex Teams alert plugin
Thanks
From: Jiajie Zhong <zh...@gmail.com>
Date: Thursday, July 28, 2022 at 16:27
To: dev@dolphinscheduler.apache.org <de...@dolphinscheduler.apache.org>
Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Hey guys,
It is close to the day we plan to release version 3.0.0. Some of our
community are testing the branch 3.0.0-prepare[1]. But we do not have
all of the environment to the whole task/datasource/alert type. So I
am here to see whether some of you guys have the environment can give
me a hand to test whether the plugin work or not:
* Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
* Datasource: SQL Server, Presto, ClickHouse, DB2
* Alert: Enterprise WeChat, Webex Teams, Telegram
If you are interested in testing some of the plugins, please let me
know in this mail thread.
After you finish your test, you can send another append mail and to
tell us the result of your test, and create an issue if it have some
error
[1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <zh...@gmail.com> wrote:
>
> Hey guys,
>
> We plan to release DolphinScheduler 3.0.0 in early August. Version
> 3.0.0 tries to fix some bugs and correct some docs based on
> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
> already create new branch named `3.0.0-prepare` in repository
> apache/dolphinscheduler. We invite our community to test this prepare
> branch.
>
> Currently, we have some known issues in the link[1], some of them
> still not assigned to someone and it is encouraged to reply and take
> them directly in the issue if you are interested in them.
>
> If you have other issues you want to fix in version 3.0.0. please let
> us know in this mail thread
>
> [1]: https://github.com/apache/dolphinscheduler/milestone/32
>
> --
> Best Wish
> — Jiajie
--
Best Wish
— Jiajie
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by "Draven Li (qingwli)" <qi...@cisco.com.INVALID>.
Hi Jiajie:
I could help test the Webex Teams alert plugin
Thanks
From: Jiajie Zhong <zh...@gmail.com>
Date: Thursday, July 28, 2022 at 16:27
To: dev@dolphinscheduler.apache.org <de...@dolphinscheduler.apache.org>
Subject: Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Hey guys,
It is close to the day we plan to release version 3.0.0. Some of our
community are testing the branch 3.0.0-prepare[1]. But we do not have
all of the environment to the whole task/datasource/alert type. So I
am here to see whether some of you guys have the environment can give
me a hand to test whether the plugin work or not:
* Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
* Datasource: SQL Server, Presto, ClickHouse, DB2
* Alert: Enterprise WeChat, Webex Teams, Telegram
If you are interested in testing some of the plugins, please let me
know in this mail thread.
After you finish your test, you can send another append mail and to
tell us the result of your test, and create an issue if it have some
error
[1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <zh...@gmail.com> wrote:
>
> Hey guys,
>
> We plan to release DolphinScheduler 3.0.0 in early August. Version
> 3.0.0 tries to fix some bugs and correct some docs based on
> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
> already create new branch named `3.0.0-prepare` in repository
> apache/dolphinscheduler. We invite our community to test this prepare
> branch.
>
> Currently, we have some known issues in the link[1], some of them
> still not assigned to someone and it is encouraged to reply and take
> them directly in the issue if you are interested in them.
>
> If you have other issues you want to fix in version 3.0.0. please let
> us know in this mail thread
>
> [1]: https://github.com/apache/dolphinscheduler/milestone/32
>
> --
> Best Wish
> — Jiajie
--
Best Wish
— Jiajie
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by Chufeng Gao <ch...@gmail.com>.
Hi Jiajie,
I could help test the Zeppelin task plugin.
BTW, I'm looking forward to the release of 3.0.0 and good luck with the
release : )
Thanks.
*Best Regards,*
*Chufeng (Eric) Gao*
Jiajie Zhong <zh...@gmail.com> 于2022年7月28日周四 16:27写道：
> Hey guys,
>
> It is close to the day we plan to release version 3.0.0. Some of our
> community are testing the branch 3.0.0-prepare[1]. But we do not have
> all of the environment to the whole task/datasource/alert type. So I
> am here to see whether some of you guys have the environment can give
> me a hand to test whether the plugin work or not:
>
> * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
> * Datasource: SQL Server, Presto, ClickHouse, DB2
> * Alert: Enterprise WeChat, Webex Teams, Telegram
>
> If you are interested in testing some of the plugins, please let me
> know in this mail thread.
>
> After you finish your test, you can send another append mail and to
> tell us the result of your test, and create an issue if it have some
> error
>
> [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
>
> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <zh...@gmail.com>
> wrote:
> >
> > Hey guys,
> >
> > We plan to release DolphinScheduler 3.0.0 in early August. Version
> > 3.0.0 tries to fix some bugs and correct some docs based on
> > 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
> > already create new branch named `3.0.0-prepare` in repository
> > apache/dolphinscheduler. We invite our community to test this prepare
> > branch.
> >
> > Currently, we have some known issues in the link[1], some of them
> > still not assigned to someone and it is encouraged to reply and take
> > them directly in the issue if you are interested in them.
> >
> > If you have other issues you want to fix in version 3.0.0. please let
> > us know in this mail thread
> >
> > [1]: https://github.com/apache/dolphinscheduler/milestone/32
> >
> > --
> > Best Wish
> > — Jiajie
>
>
>
> --
> Best Wish
> — Jiajie
>
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by SbloodyS <zi...@apache.org>.
Hi Jiajie:
I could help test the Spark/Flink task plugin and the Presto datasource plugin and the Enterprise WeChat alert plugin.
Good luck with the release : )
--
Best Wishes
ZiHao
> 2022年7月28日 16:27，Jiajie Zhong <zh...@gmail.com> 写道：
>
> Hey guys,
>
> It is close to the day we plan to release version 3.0.0. Some of our
> community are testing the branch 3.0.0-prepare[1]. But we do not have
> all of the environment to the whole task/datasource/alert type. So I
> am here to see whether some of you guys have the environment can give
> me a hand to test whether the plugin work or not:
>
> * Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
> * Datasource: SQL Server, Presto, ClickHouse, DB2
> * Alert: Enterprise WeChat, Webex Teams, Telegram
>
> If you are interested in testing some of the plugins, please let me
> know in this mail thread.
>
> After you finish your test, you can send another append mail and to
> tell us the result of your test, and create an issue if it have some
> error
>
> [1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
>
> On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <zh...@gmail.com> wrote:
>>
>> Hey guys,
>>
>> We plan to release DolphinScheduler 3.0.0 in early August. Version
>> 3.0.0 tries to fix some bugs and correct some docs based on
>> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
>> already create new branch named `3.0.0-prepare` in repository
>> apache/dolphinscheduler. We invite our community to test this prepare
>> branch.
>>
>> Currently, we have some known issues in the link[1], some of them
>> still not assigned to someone and it is encouraged to reply and take
>> them directly in the issue if you are interested in them.
>>
>> If you have other issues you want to fix in version 3.0.0. please let
>> us know in this mail thread
>>
>> [1]: https://github.com/apache/dolphinscheduler/milestone/32
>>
>> --
>> Best Wish
>> — Jiajie
>
>
>
> --
> Best Wish
> — Jiajie
Re: [DISCUSS] DolphinScheduler 3.0.0 release in early August
Posted by Jiajie Zhong <zh...@gmail.com>.
Hey guys,
It is close to the day we plan to release version 3.0.0. Some of our
community are testing the branch 3.0.0-prepare[1]. But we do not have
all of the environment to the whole task/datasource/alert type. So I
am here to see whether some of you guys have the environment can give
me a hand to test whether the plugin work or not:
* Task Type: Spark, MapReduce, Flink, EMR, Zeppelin
* Datasource: SQL Server, Presto, ClickHouse, DB2
* Alert: Enterprise WeChat, Webex Teams, Telegram
If you are interested in testing some of the plugins, please let me
know in this mail thread.
After you finish your test, you can send another append mail and to
tell us the result of your test, and create an issue if it have some
error
[1]: https://github.com/apache/dolphinscheduler/tree/3.0.0-prepare
On Tue, Jul 26, 2022 at 10:29 AM Jiajie Zhong <zh...@gmail.com> wrote:
>
> Hey guys,
>
> We plan to release DolphinScheduler 3.0.0 in early August. Version
> 3.0.0 tries to fix some bugs and correct some docs based on
> 3.0.0-beta-2. And it is the first stable version of 3.0.0. And we
> already create new branch named `3.0.0-prepare` in repository
> apache/dolphinscheduler. We invite our community to test this prepare
> branch.
>
> Currently, we have some known issues in the link[1], some of them
> still not assigned to someone and it is encouraged to reply and take
> them directly in the issue if you are interested in them.
>
> If you have other issues you want to fix in version 3.0.0. please let
> us know in this mail thread
>
> [1]: https://github.com/apache/dolphinscheduler/milestone/32
>
> --
> Best Wish
> — Jiajie
--
Best Wish
— Jiajie