You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@dolphinscheduler.apache.org by ShunFeng Cai <ca...@apache.org> on 2022/09/14 08:06:46 UTC
[ANNOUNCE] Apache DolphinScheduler 3.1.0 will be released on September 25th
Hi all,
Currently, our community is preparing to release version 3.0.1, which will
only do bugfix without new features.
Considering the experience and publicity of new features, include ML, k8s,
yaml workflow as code, stream task and so on, we are glad to announce that
Apache DolphinScheduler
version 3.1.0 will be released on September 25th. We already create new
branch named `3.1.0-prepare` in repository
apache/dolphinscheduler and invite our community to test it if you are
interested in them.
If you have any questions, please refer to DolphinScheduler Resources:
- Official website: https://dolphinscheduler.apache.org/
- GitHub: https://github.com/apache/dolphinscheduler
- Issue: https://github.com/apache/dolphinscheduler/issues/
- Mailing list: [dev@dolphinscheduler.apache.org](mailto:
dev@dolphinscheduler.apache.org)
- Documents:
https://dolphinscheduler.apache.org/en-us/docs/latest/user_doc/guide/start/quick-start.html
*About DolphinScheduler:*
Apache DolphinScheduler provides a distributed and easy to expand visual
workflow task scheduling open-source platform. It is suitable for
enterprise-level scenarios. It provides a solution to visualize operation
tasks, workflows, and the entire data processing procedures.
Apache DolphinScheduler aims to solve complex big data task dependencies
and to trigger relationships in data OPS orchestration for various big data
applications. Solves the intricate dependencies of data R&D ETL and the
inability to monitor the health status of tasks. DolphinScheduler assembles
tasks in the Directed Acyclic Graph (DAG) streaming mode, which can monitor
the execution status of tasks in time, and supports operations like retry,
recovery failure from specified nodes, pause, resume, and kill tasks, etc.
--
Best Wish
— Shunfeng
Re: [ANNOUNCE] Apache DolphinScheduler 3.1.0 will be released on September 25th
Posted by ShunFeng Cai <ca...@gmail.com>.
Hi community,
The 3.1.0-release is coming soon, and we need some help for testing the
branch 3.1.0-prepare[1], including:
-
workflow
-
task-plugins
-
data-source-plugins
-
alert-plugins
-
registry-plugins
-
deploy
-
......
So if you are interested in testing some of them, please let me know in
this mail thread.
After you finish your test, you can reply mail to tell us the result of
your test, and create an issue if it have some error.
There are the new features and main improvements list:
New features list, including:
-
Task-plugins: Jupyter, Hive CLI, Kubernetes, MLflow, Openmldb, DVC,
Dinky, SageMaker, ChunJun, Pytorch;
-
Data-source: Amazon Athena;
-
Registry-plugin: Etcd, Mysql;
-
Stream-Task;
-
Yaml Workflow AS Code;
Main improvements list, including:
-
Task-plugins: SeaTunnel;
-
PyDolphinScheduler;
-
Resource Center: S3;
[1]https://github.com/apache/dolphinscheduler/tree/3.1.0-prepare
--
Best Wish
— Shunfeng
Chufeng Gao <ch...@gmail.com> 于2022年9月14日周三 16:38写道：
> Fantastic! Those new features you mentioned above sound pretty cool to me.
> Looking forward to the 3.1.0 release.
>
> Thanks!
>
> *Best Regards,*
>
> *Chufeng (Eric) Gao*
>
>
>
> On Wed, Sep 14, 2022 at 4:08 PM ShunFeng Cai <ca...@apache.org>
> wrote:
>
> > Hi all,
> >
> > Currently, our community is preparing to release version 3.0.1, which
> will
> > only do bugfix without new features.
> >
> > Considering the experience and publicity of new features, include ML,
> k8s,
> > yaml workflow as code, stream task and so on, we are glad to announce
> that
> > Apache DolphinScheduler
> > version 3.1.0 will be released on September 25th. We already create new
> > branch named `3.1.0-prepare` in repository
> > apache/dolphinscheduler and invite our community to test it if you are
> > interested in them.
> >
> > If you have any questions, please refer to DolphinScheduler Resources:
> >
> > - Official website: https://dolphinscheduler.apache.org/
> > - GitHub: https://github.com/apache/dolphinscheduler
> > - Issue: https://github.com/apache/dolphinscheduler/issues/
> > - Mailing list: [dev@dolphinscheduler.apache.org](mailto:
> > dev@dolphinscheduler.apache.org)
> > - Documents:
> >
> >
> https://dolphinscheduler.apache.org/en-us/docs/latest/user_doc/guide/start/quick-start.html
> >
> > *About DolphinScheduler:*
> >
> > Apache DolphinScheduler provides a distributed and easy to expand visual
> > workflow task scheduling open-source platform. It is suitable for
> > enterprise-level scenarios. It provides a solution to visualize operation
> > tasks, workflows, and the entire data processing procedures.
> >
> > Apache DolphinScheduler aims to solve complex big data task dependencies
> > and to trigger relationships in data OPS orchestration for various big
> data
> > applications. Solves the intricate dependencies of data R&D ETL and the
> > inability to monitor the health status of tasks. DolphinScheduler
> assembles
> > tasks in the Directed Acyclic Graph (DAG) streaming mode, which can
> monitor
> > the execution status of tasks in time, and supports operations like
> retry,
> > recovery failure from specified nodes, pause, resume, and kill tasks,
> etc.
> >
> > --
> > Best Wish
> > — Shunfeng
> >
>
Re: [ANNOUNCE] Apache DolphinScheduler 3.1.0 will be released on September 25th
Posted by Chufeng Gao <ch...@gmail.com>.
Fantastic! Those new features you mentioned above sound pretty cool to me.
Looking forward to the 3.1.0 release.
Thanks!
*Best Regards,*
*Chufeng (Eric) Gao*
On Wed, Sep 14, 2022 at 4:08 PM ShunFeng Cai <ca...@apache.org> wrote:
> Hi all,
>
> Currently, our community is preparing to release version 3.0.1, which will
> only do bugfix without new features.
>
> Considering the experience and publicity of new features, include ML, k8s,
> yaml workflow as code, stream task and so on, we are glad to announce that
> Apache DolphinScheduler
> version 3.1.0 will be released on September 25th. We already create new
> branch named `3.1.0-prepare` in repository
> apache/dolphinscheduler and invite our community to test it if you are
> interested in them.
>
> If you have any questions, please refer to DolphinScheduler Resources:
>
> - Official website: https://dolphinscheduler.apache.org/
> - GitHub: https://github.com/apache/dolphinscheduler
> - Issue: https://github.com/apache/dolphinscheduler/issues/
> - Mailing list: [dev@dolphinscheduler.apache.org](mailto:
> dev@dolphinscheduler.apache.org)
> - Documents:
>
> https://dolphinscheduler.apache.org/en-us/docs/latest/user_doc/guide/start/quick-start.html
>
> *About DolphinScheduler:*
>
> Apache DolphinScheduler provides a distributed and easy to expand visual
> workflow task scheduling open-source platform. It is suitable for
> enterprise-level scenarios. It provides a solution to visualize operation
> tasks, workflows, and the entire data processing procedures.
>
> Apache DolphinScheduler aims to solve complex big data task dependencies
> and to trigger relationships in data OPS orchestration for various big data
> applications. Solves the intricate dependencies of data R&D ETL and the
> inability to monitor the health status of tasks. DolphinScheduler assembles
> tasks in the Directed Acyclic Graph (DAG) streaming mode, which can monitor
> the execution status of tasks in time, and supports operations like retry,
> recovery failure from specified nodes, pause, resume, and kill tasks, etc.
>
> --
> Best Wish
> — Shunfeng
>