You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by ki...@apache.org on 2022/01/13 03:52:49 UTC
[dolphinscheduler-website] branch master updated: add news 2.0.2 (#635)
This is an automated email from the ASF dual-hosted git repository.
kirs pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/dolphinscheduler-website.git
The following commit(s) were added to refs/heads/master by this push:
new 4270d3b add news 2.0.2 (#635)
4270d3b is described below
commit 4270d3be01ecf1bb7a44764987274a5244d0cb76
Author: lifeng <53...@users.noreply.github.com>
AuthorDate: Thu Jan 13 11:16:14 2022 +0800
add news 2.0.2 (#635)
* add news 2.0.2
add news 2.0.2
* updata link
* updata link
---
blog/en-us/Apache_dolphinScheduler_2.0.2.md | 123 ++++++++++++++++++++++++++
blog/zh-cn/Apache_dolphinScheduler_2.0.2.md | 131 ++++++++++++++++++++++++++++
img/2022-1-13/1_3XcwBeN5HkBzZ76zXDcigw.jpeg | Bin 0 -> 96842 bytes
img/2022-1-13/1_IFBxUh2I0LFWF3Jkwz1e5g.png | Bin 0 -> 27817 bytes
site_config/blog.js | 14 +++
site_config/home.jsx | 28 +++---
6 files changed, 282 insertions(+), 14 deletions(-)
diff --git a/blog/en-us/Apache_dolphinScheduler_2.0.2.md b/blog/en-us/Apache_dolphinScheduler_2.0.2.md
new file mode 100644
index 0000000..2a93fc1
--- /dev/null
+++ b/blog/en-us/Apache_dolphinScheduler_2.0.2.md
@@ -0,0 +1,123 @@
+---
+title: Apache DolphinScheduler 2.0.2 Release Announcement:WorkflowAsCode is Launched!
+keywords: Apache,DolphinScheduler,scheduler,big data,ETL,airflow,hadoop,orchestration,dataops,2.0.2
+description:In the long-awaited, WorkflowAsCode function is finally launched in version 2.0.2 as promised, bringing good news to users who need to dynamically create and update workflows in batches.
+
+---
+# Apache DolphinScheduler 2.0.2 Release Announcement:WorkflowAsCode is Launched!
+
+<div align=center>
+<img src="/img/2022-1-13/1_3XcwBeN5HkBzZ76zXDcigw.jpeg"/>
+</div>
+
+In the long-awaited, WorkflowAsCode function is finally launched in version 2.0.2 as promised, bringing good news to users who need to dynamically create and update workflows in batches.
+
+In addition, the new version also adds the WeCom alarm group chat message push, simplifies the metadata initialization process, and fixes issues that existed in the former version, such as failure of service restart after forced termination, and the failure to add a Hive data source.
+
+## New Function
+
+### WorkflowAsCode
+
+First of all, in terms of new functions, version 2.0.2 released PythonGatewayServer, which is a Workflow-as-code server started in the same way as apiServer and other services.
+
+When PythonGatewayServer is enabled, all Python API requests are sent to PythonGatewayServer. Workflow-as-code lets users create workflows through the Python API, which is great news for users who need to create and update workflows dynamically and in batches. Workflows created with Workflow-as-code can be viewed in the web UI just like other workflows.
+
+The following is a Workflow-as-code test case:
+
+```py
+# Define workflow properties, including name, scheduling period, start time, tenant, etc.
+
+with ProcessDefinition(
+ name="tutorial",
+ schedule="0 0 0 * * ? *",
+ start_time="2021-01-01",
+ tenant="tenant_exists",
+) as pd:
+ # Define 4 tasks, which are all shell tasks, the required parameters of shell tasks are task name, command information, here are all the shell commands of echo
+
+ task_parent = Shell(name="task_parent", command="echo hello pydolphinscheduler")
+ task_child_one = Shell(name="task_child_one", command="echo 'child one'")
+ task_child_two = Shell(name="task_child_two", command="echo 'child two'")
+ task_union = Shell(name="task_union", command="echo union")
+
+ # Define dependencies between tasks
+ # Here, task_child_one and task_child_two are first declared as a task group through python's list
+ task_group = [task_child_one, task_child_two]
+ # Use the set_downstream method to declare the task group task_group as the downstream of task_parent, and declare the upstream through set_upstream
+ task_parent.set_downstream(task_group)
+
+ # Use the bit operator << to declare the task_union as the downstream of the task_group, and support declaration through the bit operator >>
+ task_union << task_group
+
+```
+When the above code runs, you can see workflow in the web UI as follows:
+
+``` --> task_child_one
+ / \
+task_parent --> --> task_union
+ \ /
+ --> task_child_two
+```
+
+
+### 2 Wecom alarm mode supports group chat message push
+
+In the previous version, the WeChat alarm only supported the message notification; in version 2.0.2, when the user uses the Wecom alarm, it supports pushing the group chat message in the app to the user.
+
+## 02 Optimization
+
+### 1 Simplified metadata initialization process
+
+When Apache DolphinScheduler is first installed, running create-dolphinscheduler.sh requires a step by step upgrade from the oldest version to the current version. In order to initialize the metadata process more conveniently and quickly, version 2.0.2 allows users to directly install the current version of the database script, which improves the installation speed.
+
+### 2 Remove "+1" (days) in complement dates
+
+Removed the "+1" day in the complement date to avoid user confusion when the UI date always displays +1 when the complement is added.
+
+## 03 Bug Fixes
+
+[#7661] fix logger memory leak in worker
+[#7750] Compatible with historical version data source connection information
+[#7705] Memory constraints cause errors when upgrading from 1.3.5 to 2.0.2
+[#7786] Service restart fails after a forced termination
+[#7660] Process definition version create time is wrong
+[#7607] Failed to execute PROCEDURE node
+[#7639] Add default configuration of quartz and zookeeper in common configuration items
+[#7654] In the dependency node, an error is reported when there is an option that does not belong to the current project
+[#7658] Workflow replication error
+[#7609] Workflow is always running when worker sendResult succeeds but the master does not receive error report
+[#7554] H2 in Standalone Server will automatically restart after a few minutes, resulting in abnormal data loss
+[#7434] Error reported when executing MySQL table creation statement
+[#7537] Dependent node retry delay does not work
+[#7392] Failed to add a Hive data source
+
+Download: https://dolphinscheduler.apache.org/zh-cn/download/download.html
+Release Note: https://github.com/apache/dolphinscheduler/releases/tag/2.0.2
+
+
+## 04 Thanks
+
+
+As always, we would like to thank all the contributors (in no particular order) who have worked to polish Apache DolphinScheduler 2.0.2 as a better platform. It is your wisdom and efforts to make it more in line with the needs of users.
+
+<div align=center>
+<img src="/img/2022-1-13/1_IFBxUh2I0LFWF3Jkwz1e5g.png"/>
+</div>
+
+## The Way to Join US
+
+There are many ways to participate and contribute to the DolphinScheduler community, including:
+Documents, translation, Q&A, tests, codes, articles, keynote speeches, etc.
+
+We assume the first PR (document, code) to contribute to be simple and should be used to familiarize yourself with the submission process and community collaboration style.
+
+So the community has compiled the following list of issues suitable for novices: https://github.com/apache/dolphinscheduler/issues/5689
+List of non-newbie issues: https://github.com/apache/dolphinscheduler/issues?q=is%3Aopen+is%3Aissue+label%3A%22volunteer+wanted%22
+How to participate in the contribution: https://dolphinscheduler.apache.org/en-us/community/development/contribute.html
+
+Community Official Website：
+https://dolphinscheduler.apache.org/
+GitHub Code repository:
+https://github.com/apache/dolphinscheduler
+Your Star for the project is important, don’t hesitate to lighten a Star for Apache DolphinScheduler ❤️
+
diff --git a/blog/zh-cn/Apache_dolphinScheduler_2.0.2.md b/blog/zh-cn/Apache_dolphinScheduler_2.0.2.md
new file mode 100644
index 0000000..66b4019
--- /dev/null
+++ b/blog/zh-cn/Apache_dolphinScheduler_2.0.2.md
@@ -0,0 +1,131 @@
+# WorkflowAsCode 来了，Apache DolphinScheduler 2.0.2 惊喜发布！
+
+<div align=center>
+<img src="/img/2022-1-13/1_3XcwBeN5HkBzZ76zXDcigw.jpeg"/>
+</div>
+
+千呼万唤中，WorkflowAsCode 功能终于在 2.0.2 版本中如约上线，为有动态、批量创建和更新工作流需求的用户带来福音。
+
+此外，新版本还新增企业微信告警群聊会话消息推送，简化了元数据初始化流程，并修复了旧版本中强制终止后服务重启失败，添加 Hive 数据源失败等问题。</font>
+
+## 01 新功能
+
+### 1 WorkflowAsCode
+
+
+首先在新功能上，2.0.2 版本重磅发布了 PythonGatewayServer， 这是一个 Workflow-as-code 的服务端，与 apiServer 等服务的启动方式相同。
+
+启用 PythonGatewayServer 后，所有 Python API 的请求都会发送到 PythonGatewayServer。Workflow-as-code 让用户可以通过 Python API 创建工作流，对于有动态、批量地创建和更新工作流的用户来说是一个好消息。通过 Workflow-as-code 创建的工作流与其他工作流一样，都可以在 web UI 查看。
+
+以下为一个 Workflow-as-code 测试用例：
+
+```py
+
+# 定义工作流属性，包括名称、调度周期、开始时间、使用租户等信息
+with ProcessDefinition(
+ name="tutorial",
+ schedule="0 0 0 * * ? *",
+ start_time="2021-01-01",
+ tenant="tenant_exists",
+) as pd:
+ # 定义4个任务，4个都是 shell 任务，shell 任务的必填参数为任务名、命令信息，这里都是 echo 的 shell 命令
+ task_parent = Shell(name="task_parent", command="echo hello pydolphinscheduler")
+ task_child_one = Shell(name="task_child_one", command="echo 'child one'")
+ task_child_two = Shell(name="task_child_two", command="echo 'child two'")
+ task_union = Shell(name="task_union", command="echo union")
+
+ # 定义任务间依赖关系
+ # 这里将 task_child_one，task_child_two 先声明成一个任务组，通过 python 的 list 声明
+ task_group = [task_child_one, task_child_two]
+ # 使用 set_downstream 方法将任务组 task_group 声明成 task_parent 的下游，如果想要声明上游则使用 set_upstream
+ task_parent.set_downstream(task_group)
+
+ # 使用位操作符 << 将任务 task_union 声明成 task_group 的下游，同时支持通过位操作符 >> 声明
+ task_union << task_group
+
+```
+
+上面的代码运行后，可以在 web UI 看到的工作流如下：
+
+``` --> task_child_one
+ / \
+task_parent --> --> task_union
+ \ /
+ --> task_child_two
+```
+### 2 企业微信告警方式支持群聊消息推送
+
+在此前版本中，微信告警方式仅支持消息通知方式；在 2.0.2 版本中，用户在使用企业微信的告警时，支持进行应用内以群聊会话消息推送的方式推送给用户。
+
+## 02 优化
+
+### 1 简化元数据初始化流程
+
+首次安装 Apache DolphinScheduler 时，运行 create-dolphinscheduler.sh 需要从最早的版本逐步升级到当前版本。为了更方便快捷地初始化元数据流程，2.0.2 版本让用户可以直接安装当前版本的数据库脚本，提升安装速度。
+
+### 2 删除补数日期中的“+1”（天）
+
+删除了补数日期中的“+1”天，以避免补数时 UI 日期总显示 +1 给用户造成的困惑。
+## 03 Bug 修复
+
+[#7661] 修复 logger 在 worker 中的内存泄漏
+[#7750] 兼容历史版本数据源连接信息
+[#7705] 内存限制导致从 1.3.5 升级到 2.0.2 出现错误
+[#7786] 强制终止后服务重启失败
+[#7660] 流程定义版本创建时间错误
+[#7607] 执行 PROCEDURE 节点失败
+[#7639] 在通用配置项中添加 quartz 和 zookeeper 默认配置
+[#7654] 在依赖节点中，出现不属于当前项目的选项时报错
+[#7658] 工作流复制错误
+[#7609] worker sendResult 成功但 master 未收到错误时，工作流始终在运行
+[#7554] Standalone Server 中的 H2 会在数分钟后自动重启，导致数据异常丢失
+[#7434] 执行 MySQL 建表语句报错
+[#7537] 依赖节点重试延迟不起作用
+[#7392] 添加 Hive 数据源失败
+
+下载：https://dolphinscheduler.apache.org/zh-cn/download/download.html
+Release Note：https://github.com/apache/dolphinscheduler/releases/tag/2.0.2
+
+## 04 致谢
+
+一如既往地，感谢所有为 2.0.2版本建言献策并付诸行动的 Contributor（排名不分先后），是你们的智慧和付出让 Apache DolphinScheduler 更加符合用户的使用需求。
+
+<div align=center>
+<img src="/img/2022-1-13/1_IFBxUh2I0LFWF3Jkwz1e5g.png"/>
+</div>
+
+
+## 05 参与贡献
+
+
+随着国内开源的迅猛崛起，Apache DolphinScheduler 社区迎来蓬勃发展，为了做更好用、易用的调度，真诚欢迎热爱开源的伙伴加入到开源社区中来，为中国开源崛起献上一份自己的力量，让本土开源走向全球。
+
+参与 DolphinScheduler 社区有非常多的参与贡献的方式，包括：
+
+贡献第一个PR(文档、代码) 我们也希望是简单的，第一个PR用于熟悉提交的流程和社区协作以及感受社区的友好度。
+
+社区汇总了以下适合新手的问题列表：https://github.com/apache/dolphinscheduler/issues/5689
+
+非新手问题列表：https://github.com/apache/dolphinscheduler/issues?q=is%3Aopen+is%3Aissue+label%3A%22volunteer+wanted%22
+
+如何参与贡献链接：https://dolphinscheduler.apache.org/zh-cn/community/development/contribute.html
+
+来吧，DolphinScheduler开源社区需要您的参与，为中国开源崛起添砖加瓦吧，哪怕只是小小的一块瓦，汇聚起来的力量也是巨大的。
+
+
+社区官网
+https://dolphinscheduler.apache.org/
+
+代码仓地址
+https://github.com/apache/dolphinscheduler
+
+您的 Star，是 Apache DolphinScheduler 为爱发电的动力❤️ ～
+
+
+
+
+
+
+
+
+
diff --git a/img/2022-1-13/1_3XcwBeN5HkBzZ76zXDcigw.jpeg b/img/2022-1-13/1_3XcwBeN5HkBzZ76zXDcigw.jpeg
new file mode 100644
index 0000000..ee2d72c
Binary files /dev/null and b/img/2022-1-13/1_3XcwBeN5HkBzZ76zXDcigw.jpeg differ
diff --git a/img/2022-1-13/1_IFBxUh2I0LFWF3Jkwz1e5g.png b/img/2022-1-13/1_IFBxUh2I0LFWF3Jkwz1e5g.png
new file mode 100644
index 0000000..432ed4e
Binary files /dev/null and b/img/2022-1-13/1_IFBxUh2I0LFWF3Jkwz1e5g.png differ
diff --git a/site_config/blog.js b/site_config/blog.js
index 33e37e4..946c93f 100644
--- a/site_config/blog.js
+++ b/site_config/blog.js
@@ -4,6 +4,13 @@ export default {
postsTitle: 'All posts',
list: [
{
+ title: 'Apache DolphinScheduler 2.0.2 Release Announcement:WorkflowAsCode is Launched!',
+ author: 'Debra Chen',
+ dateStr: '2022-1-13',
+ desc: ' TWOS',
+ link: '/en-us/blog/Apache_dolphinScheduler_2.0.2.html',
+ },
+ {
title: 'Congratulations! Apache DolphinScheduler Has Been Approved As A TWOS Candidate Member',
author: 'Debra Chen',
dateStr: '2022-1-11',
@@ -104,6 +111,13 @@ export default {
postsTitle: '所有文章',
list: [
{
+ title: 'WorkflowAsCode 来了，Apache DolphinScheduler 2.0.2 惊喜发布！',
+ author: 'Debra Chen',
+ dateStr: '2022-1-13',
+ desc: 'Apache DolphinScheduler 2.0.2',
+ link: '/zh-cn/blog/Apache_dolphinScheduler_2.0.2.html',
+ },
+ {
title: '恭喜 Apache DolphinScheduler 入选可信开源社区共同体（TWOS）预备成员！',
author: 'Debra Chen',
dateStr: '2022-1-11',
diff --git a/site_config/home.jsx b/site_config/home.jsx
index 8d28540..f7b124c 100644
--- a/site_config/home.jsx
+++ b/site_config/home.jsx
@@ -55,6 +55,13 @@ export default {
title: '事件 & 新闻',
list: [
{
+ img: 'https://miro.medium.com/max/1260/1*3XcwBeN5HkBzZ76zXDcigw.jpeg',
+ title: 'WorkflowAsCode 来了，Apache DolphinScheduler 2.0.2 惊喜发布',
+ content: '千呼万唤中，WorkflowAsCode 功能终于在 2.0.2 版本中如约上线...',
+ dateStr: '2022-1-13',
+ link: '/zh-cn/blog/Apache_dolphinScheduler_2.0.2.html',
+ },
+ {
img: 'https://imgpp.com/images/2022/01/10/164179986575876800e959cabce5b.md.png',
title: '恭喜 Apache DolphinScheduler 入选可信开源社区共同体（TWOS）预备成员！',
content: '近日，可信开源社区共同体正式宣布批准 6 位正式成员和 3 位预备成员加入。其中...',
@@ -68,13 +75,6 @@ export default {
dateStr: '2022-1-7',
link: '/zh-cn/blog/Awarded_most_popular_project_in_2021.html',
},
- {
- img: 'https://imgpp.com/images/2021/12/29/1640759432737.md.png',
- title: '亿云基于 DolphinScheduler 构建资产数据管理平台服务，助力政务信息化生态建设',
- content: '基于 Apache Dolphinscheduler 调度平台，云计算和大数据提供商亿云...',
- dateStr: '2021-12-30',
- link: '/zh-cn/blog/Eavy_Info.html',
- },
],
},
ourusers: {
@@ -541,6 +541,13 @@ export default {
title: 'Events & News',
list: [
{
+ img: 'https://miro.medium.com/max/1260/1*3XcwBeN5HkBzZ76zXDcigw.jpeg',
+ title: '# Apache DolphinScheduler 2.0.2 Release Announcement:WorkflowAsCode is Launched! ',
+ content: 'In the long-awaited, WorkflowAsCode function is finally launched in version 2.0.2 as promised...',
+ dateStr: '2022-1-13',
+ link: '/en-us/blog/Apache_dolphinScheduler_2.0.2.html',
+ },
+ {
img: 'https://imgpp.com/images/2022/01/10/1641804549068.md.png',
title: 'Congratulations! Apache DolphinScheduler Has Been Approved As A TWOS Candidate Member',
content: 'ecently, TWOS officially announced the approval of 6 full members and 3 candidate...',
@@ -555,13 +562,6 @@ export default {
dateStr: '2022-1-7',
link: '/en-us/blog/Awarded_most_popular_project_in_2021.html',
},
- {
- img: 'https://imgpp.com/images/2021/12/29/1640759432737.md.png',
- title: '# Eavy Info Builds Data Asset Management Platform Services Based on Apache DolphinScheduler to Construct Government Information Ecology',
- content: 'Based on the Apache DolphinScheduler, the cloud computing and big data provider Eavy Info...',
- dateStr: '2021-11-24',
- link: '/en-us/blog/Eavy_Info.html',
- },
],
},
userreview: {