You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by gi...@apache.org on 2020/06/30 07:35:49 UTC
[incubator-dolphinscheduler-website] branch asf-site updated:
Automated deployment: Tue Jun 30 07:35:41 UTC 2020
58104114f5297606c5dae9688437f72004d6ec29
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-dolphinscheduler-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new ed9dac7 Automated deployment: Tue Jun 30 07:35:41 UTC 2020 58104114f5297606c5dae9688437f72004d6ec29
ed9dac7 is described below
commit ed9dac7874ed8abe0f3fd5cd1a016322d350e3b2
Author: dailidong <da...@users.noreply.github.com>
AuthorDate: Tue Jun 30 07:35:41 2020 +0000
Automated deployment: Tue Jun 30 07:35:41 UTC 2020 58104114f5297606c5dae9688437f72004d6ec29
---
zh-cn/docs/1.3.0/user_doc/task-structure.html | 3282 +++++++++++++++++++++++++
zh-cn/docs/1.3.0/user_doc/task-structure.json | 6 +
2 files changed, 3288 insertions(+)
diff --git a/zh-cn/docs/1.3.0/user_doc/task-structure.html b/zh-cn/docs/1.3.0/user_doc/task-structure.html
new file mode 100644
index 0000000..d1189ae
--- /dev/null
+++ b/zh-cn/docs/1.3.0/user_doc/task-structure.html
@@ -0,0 +1,3282 @@
+<!DOCTYPE html>
+<html lang="en">
+
+<head>
+ <meta charset="UTF-8">
+ <meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no">
+ <meta name="keywords" content="task-structure" />
+ <meta name="description" content="task-structure" />
+ <!-- 网页标签标题 -->
+ <title>task-structure</title>
+ <link rel="shortcut icon" href="/img/docsite.ico"/>
+ <link rel="stylesheet" href="/build/documentation.css" />
+</head>
+<body>
+ <div id="root"><div class="documentation-page" data-reactroot=""><header class="header-container header-container-normal"><div class="header-body"><a href="/zh-cn/index.html"><img class="logo" src="/img/hlogo_colorful.svg"/></a><div class="search search-normal"><span class="icon-search"></span></div><span class="language-switch language-switch-normal">En</span><div class="header-menu"><img class="header-menu-toggle" src="/img/system/menu_gray.png"/><div><ul class="ant-menu blackClass an [...]
+<p>在dolphinscheduler中创建的所有任务都保存在t_ds_process_definition 表中.</p>
+<p>该数据库表结构如下表所示:</p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>字段</th>
+<th>类型</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td>int(11)</td>
+<td>主键</td>
+</tr>
+<tr>
+<td>2</td>
+<td>name</td>
+<td>varchar(255)</td>
+<td>流程定义名称</td>
+</tr>
+<tr>
+<td>3</td>
+<td>version</td>
+<td>int(11)</td>
+<td>流程定义版本</td>
+</tr>
+<tr>
+<td>4</td>
+<td>release_state</td>
+<td>tinyint(4)</td>
+<td>流程定义的发布状态：0 未上线 , 1已上线</td>
+</tr>
+<tr>
+<td>5</td>
+<td>project_id</td>
+<td>int(11)</td>
+<td>项目id</td>
+</tr>
+<tr>
+<td>6</td>
+<td>user_id</td>
+<td>int(11)</td>
+<td>流程定义所属用户id</td>
+</tr>
+<tr>
+<td>7</td>
+<td>process_definition_json</td>
+<td>longtext</td>
+<td>流程定义JSON</td>
+</tr>
+<tr>
+<td>8</td>
+<td>description</td>
+<td>text</td>
+<td>流程定义描述</td>
+</tr>
+<tr>
+<td>9</td>
+<td>global_params</td>
+<td>text</td>
+<td>全局参数</td>
+</tr>
+<tr>
+<td>10</td>
+<td>flag</td>
+<td>tinyint(4)</td>
+<td>流程是否可用：0 不可用，1 可用</td>
+</tr>
+<tr>
+<td>11</td>
+<td>locations</td>
+<td>text</td>
+<td>节点坐标信息</td>
+</tr>
+<tr>
+<td>12</td>
+<td>connects</td>
+<td>text</td>
+<td>节点连线信息</td>
+</tr>
+<tr>
+<td>13</td>
+<td>receivers</td>
+<td>text</td>
+<td>收件人</td>
+</tr>
+<tr>
+<td>14</td>
+<td>receivers_cc</td>
+<td>text</td>
+<td>抄送人</td>
+</tr>
+<tr>
+<td>15</td>
+<td>create_time</td>
+<td>datetime</td>
+<td>创建时间</td>
+</tr>
+<tr>
+<td>16</td>
+<td>timeout</td>
+<td>int(11)</td>
+<td>超时时间</td>
+</tr>
+<tr>
+<td>17</td>
+<td>tenant_id</td>
+<td>int(11)</td>
+<td>租户id</td>
+</tr>
+<tr>
+<td>18</td>
+<td>update_time</td>
+<td>datetime</td>
+<td>更新时间</td>
+</tr>
+<tr>
+<td>19</td>
+<td>modify_by</td>
+<td>varchar(36)</td>
+<td>修改用户</td>
+</tr>
+<tr>
+<td>20</td>
+<td>resource_ids</td>
+<td>varchar(255)</td>
+<td>资源ids</td>
+</tr>
+</tbody>
+</table>
+<p>其中process_definition_json 字段为核心字段, 定义了 DAG 图中的任务信息.该数据以JSON 的方式进行存储.</p>
+<p>公共的数据结构如下表.</p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>字段</th>
+<th>类型</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>globalParams</td>
+<td>Array</td>
+<td>全局参数</td>
+</tr>
+<tr>
+<td>2</td>
+<td>tasks</td>
+<td>Array</td>
+<td>流程中的任务集合 [ 各个类型的结构请参考如下章节]</td>
+</tr>
+<tr>
+<td>3</td>
+<td>tenantId</td>
+<td>int</td>
+<td>租户id</td>
+</tr>
+<tr>
+<td>4</td>
+<td>timeout</td>
+<td>int</td>
+<td>超时时间</td>
+</tr>
+</tbody>
+</table>
+<p>数据示例:</p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"globalParams"</span>:[
+ {
+ <span class="hljs-string">"prop"</span>:<span class="hljs-string">"golbal_bizdate"</span>,
+ <span class="hljs-string">"direct"</span>:<span class="hljs-string">"IN"</span>,
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"VARCHAR"</span>,
+ <span class="hljs-string">"value"</span>:<span class="hljs-string">"<span class="hljs-variable">${system.biz.date}</span>"</span>
+ }
+ ],
+ <span class="hljs-string">"tasks"</span>:Array[1],
+ <span class="hljs-string">"tenantId"</span>:0,
+ <span class="hljs-string">"timeout"</span>:0
+}
+</code></pre>
+<h1>各任务类型存储结构详解</h1>
+<h2>Shell节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>SHELL</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>Json 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>rawScript</td>
+<td>String</td>
+<td>Shell脚本</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td></td>
+<td>localParams</td>
+<td>Array</td>
+<td>自定义参数</td>
+<td></td>
+</tr>
+<tr>
+<td>7</td>
+<td></td>
+<td>resourceList</td>
+<td>Array</td>
+<td>资源文件</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>9</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>10</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>11</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>14</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>15</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>17</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>18</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>19</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"SHELL"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-80760"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"Shell Task"</span>,
+ <span class="hljs-string">"params"</span>:{
+ <span class="hljs-string">"resourceList"</span>:[
+ {
+ <span class="hljs-string">"id"</span>:3,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"run.sh"</span>,
+ <span class="hljs-string">"res"</span>:<span class="hljs-string">"run.sh"</span>
+ }
+ ],
+ <span class="hljs-string">"localParams"</span>:[
+
+ ],
+ <span class="hljs-string">"rawScript"</span>:<span class="hljs-string">"echo "</span>This is a shell script<span class="hljs-string">""</span>
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+}
+
+</code></pre>
+<h2>SQL节点</h2>
+<p>通过 SQL对指定的数据源进行数据查询、更新操作.</p>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>SQL</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>Json 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>type</td>
+<td>String</td>
+<td>数据库类型</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td></td>
+<td>datasource</td>
+<td>Int</td>
+<td>数据源id</td>
+<td></td>
+</tr>
+<tr>
+<td>7</td>
+<td></td>
+<td>sql</td>
+<td>String</td>
+<td>查询SQL语句</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td></td>
+<td>udfs</td>
+<td>String</td>
+<td>udf函数</td>
+<td>UDF函数id,以逗号分隔.</td>
+</tr>
+<tr>
+<td>9</td>
+<td></td>
+<td>sqlType</td>
+<td>String</td>
+<td>SQL节点类型</td>
+<td>0 查询 , 1 非查询</td>
+</tr>
+<tr>
+<td>10</td>
+<td></td>
+<td>title</td>
+<td>String</td>
+<td>邮件标题</td>
+<td></td>
+</tr>
+<tr>
+<td>11</td>
+<td></td>
+<td>receivers</td>
+<td>String</td>
+<td>收件人</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td></td>
+<td>receiversCc</td>
+<td>String</td>
+<td>抄送人</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td></td>
+<td>showType</td>
+<td>String</td>
+<td>邮件显示类型</td>
+<td>TABLE 表格 , ATTACHMENT附件</td>
+</tr>
+<tr>
+<td>14</td>
+<td></td>
+<td>connParams</td>
+<td>String</td>
+<td>连接参数</td>
+<td></td>
+</tr>
+<tr>
+<td>15</td>
+<td></td>
+<td>preStatements</td>
+<td>Array</td>
+<td>前置SQL</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td></td>
+<td>postStatements</td>
+<td>Array</td>
+<td>后置SQL</td>
+<td></td>
+</tr>
+<tr>
+<td>17</td>
+<td></td>
+<td>localParams</td>
+<td>Array</td>
+<td>自定义参数</td>
+<td></td>
+</tr>
+<tr>
+<td>18</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>19</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>20</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>21</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>22</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>23</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>24</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>25</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>26</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>27</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>28</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>29</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"SQL"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-95648"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"SqlTask-Query"</span>,
+ <span class="hljs-string">"params"</span>:{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"MYSQL"</span>,
+ <span class="hljs-string">"datasource"</span>:1,
+ <span class="hljs-string">"sql"</span>:<span class="hljs-string">"select id , namge , age from emp where id = <span class="hljs-variable">${id}</span>"</span>,
+ <span class="hljs-string">"udfs"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"sqlType"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"title"</span>:<span class="hljs-string">"xxxx@xxx.com"</span>,
+ <span class="hljs-string">"receivers"</span>:<span class="hljs-string">"xxxx@xxx.com"</span>,
+ <span class="hljs-string">"receiversCc"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"showType"</span>:<span class="hljs-string">"TABLE"</span>,
+ <span class="hljs-string">"localParams"</span>:[
+ {
+ <span class="hljs-string">"prop"</span>:<span class="hljs-string">"id"</span>,
+ <span class="hljs-string">"direct"</span>:<span class="hljs-string">"IN"</span>,
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"INTEGER"</span>,
+ <span class="hljs-string">"value"</span>:<span class="hljs-string">"1"</span>
+ }
+ ],
+ <span class="hljs-string">"connParams"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"preStatements"</span>:[
+ <span class="hljs-string">"insert into emp ( id,name ) value (1,'Li' )"</span>
+ ],
+ <span class="hljs-string">"postStatements"</span>:[
+
+ ]
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+}
+</code></pre>
+<h2>PROCEDURE[存储过程]节点</h2>
+<p><strong>节点数据结构如下:</strong>
+<strong>节点数据样例:</strong></p>
+<h2>SPARK节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>SPARK</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>Json 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>mainClass</td>
+<td>String</td>
+<td>运行主类</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td></td>
+<td>mainArgs</td>
+<td>String</td>
+<td>运行参数</td>
+<td></td>
+</tr>
+<tr>
+<td>7</td>
+<td></td>
+<td>others</td>
+<td>String</td>
+<td>其他参数</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td></td>
+<td>mainJar</td>
+<td>Object</td>
+<td>程序 jar 包</td>
+<td></td>
+</tr>
+<tr>
+<td>9</td>
+<td></td>
+<td>deployMode</td>
+<td>String</td>
+<td>部署模式</td>
+<td>local,client,cluster</td>
+</tr>
+<tr>
+<td>10</td>
+<td></td>
+<td>driverCores</td>
+<td>String</td>
+<td>driver核数</td>
+<td></td>
+</tr>
+<tr>
+<td>11</td>
+<td></td>
+<td>driverMemory</td>
+<td>String</td>
+<td>driver 内存数</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td></td>
+<td>numExecutors</td>
+<td>String</td>
+<td>executor数量</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td></td>
+<td>executorMemory</td>
+<td>String</td>
+<td>executor内存</td>
+<td></td>
+</tr>
+<tr>
+<td>14</td>
+<td></td>
+<td>executorCores</td>
+<td>String</td>
+<td>executor核数</td>
+<td></td>
+</tr>
+<tr>
+<td>15</td>
+<td></td>
+<td>programType</td>
+<td>String</td>
+<td>程序类型</td>
+<td>JAVA,SCALA,PYTHON</td>
+</tr>
+<tr>
+<td>16</td>
+<td></td>
+<td>sparkVersion</td>
+<td>String</td>
+<td>Spark 版本</td>
+<td>SPARK1 , SPARK2</td>
+</tr>
+<tr>
+<td>17</td>
+<td></td>
+<td>localParams</td>
+<td>Array</td>
+<td>自定义参数</td>
+<td></td>
+</tr>
+<tr>
+<td>18</td>
+<td></td>
+<td>resourceList</td>
+<td>Array</td>
+<td>资源文件</td>
+<td></td>
+</tr>
+<tr>
+<td>19</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>20</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>21</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>22</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>23</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>24</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>25</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>26</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>27</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>28</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>29</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>30</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"SPARK"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-87430"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"SparkTask"</span>,
+ <span class="hljs-string">"params"</span>:{
+ <span class="hljs-string">"mainClass"</span>:<span class="hljs-string">"org.apache.spark.examples.SparkPi"</span>,
+ <span class="hljs-string">"mainJar"</span>:{
+ <span class="hljs-string">"id"</span>:4
+ },
+ <span class="hljs-string">"deployMode"</span>:<span class="hljs-string">"cluster"</span>,
+ <span class="hljs-string">"resourceList"</span>:[
+ {
+ <span class="hljs-string">"id"</span>:3,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"run.sh"</span>,
+ <span class="hljs-string">"res"</span>:<span class="hljs-string">"run.sh"</span>
+ }
+ ],
+ <span class="hljs-string">"localParams"</span>:[
+
+ ],
+ <span class="hljs-string">"driverCores"</span>:1,
+ <span class="hljs-string">"driverMemory"</span>:<span class="hljs-string">"512M"</span>,
+ <span class="hljs-string">"numExecutors"</span>:2,
+ <span class="hljs-string">"executorMemory"</span>:<span class="hljs-string">"2G"</span>,
+ <span class="hljs-string">"executorCores"</span>:2,
+ <span class="hljs-string">"mainArgs"</span>:<span class="hljs-string">"10"</span>,
+ <span class="hljs-string">"others"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"programType"</span>:<span class="hljs-string">"SCALA"</span>,
+ <span class="hljs-string">"sparkVersion"</span>:<span class="hljs-string">"SPARK2"</span>
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+}
+</code></pre>
+<h2>MapReduce(MR)节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>MR</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>Json 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>mainClass</td>
+<td>String</td>
+<td>运行主类</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td></td>
+<td>mainArgs</td>
+<td>String</td>
+<td>运行参数</td>
+<td></td>
+</tr>
+<tr>
+<td>7</td>
+<td></td>
+<td>others</td>
+<td>String</td>
+<td>其他参数</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td></td>
+<td>mainJar</td>
+<td>Object</td>
+<td>程序 jar 包</td>
+<td></td>
+</tr>
+<tr>
+<td>9</td>
+<td></td>
+<td>programType</td>
+<td>String</td>
+<td>程序类型</td>
+<td>JAVA,PYTHON</td>
+</tr>
+<tr>
+<td>10</td>
+<td></td>
+<td>localParams</td>
+<td>Array</td>
+<td>自定义参数</td>
+<td></td>
+</tr>
+<tr>
+<td>11</td>
+<td></td>
+<td>resourceList</td>
+<td>Array</td>
+<td>资源文件</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>14</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>15</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>17</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>18</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>19</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>20</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>21</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>22</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>23</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"MR"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-28997"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"MRTask"</span>,
+ <span class="hljs-string">"params"</span>:{
+ <span class="hljs-string">"mainClass"</span>:<span class="hljs-string">"wordcount"</span>,
+ <span class="hljs-string">"mainJar"</span>:{
+ <span class="hljs-string">"id"</span>:5
+ },
+ <span class="hljs-string">"resourceList"</span>:[
+ {
+ <span class="hljs-string">"id"</span>:3,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"run.sh"</span>,
+ <span class="hljs-string">"res"</span>:<span class="hljs-string">"run.sh"</span>
+ }
+ ],
+ <span class="hljs-string">"localParams"</span>:[
+
+ ],
+ <span class="hljs-string">"mainArgs"</span>:<span class="hljs-string">"/tmp/wordcount/input /tmp/wordcount/output/"</span>,
+ <span class="hljs-string">"others"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"programType"</span>:<span class="hljs-string">"JAVA"</span>
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+}
+</code></pre>
+<h2>Python节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>PYTHON</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>Json 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>rawScript</td>
+<td>String</td>
+<td>Python脚本</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td></td>
+<td>localParams</td>
+<td>Array</td>
+<td>自定义参数</td>
+<td></td>
+</tr>
+<tr>
+<td>7</td>
+<td></td>
+<td>resourceList</td>
+<td>Array</td>
+<td>资源文件</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>9</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>10</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>11</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>14</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>15</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>17</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>18</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>19</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"PYTHON"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-5463"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"Python Task"</span>,
+ <span class="hljs-string">"params"</span>:{
+ <span class="hljs-string">"resourceList"</span>:[
+ {
+ <span class="hljs-string">"id"</span>:3,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"run.sh"</span>,
+ <span class="hljs-string">"res"</span>:<span class="hljs-string">"run.sh"</span>
+ }
+ ],
+ <span class="hljs-string">"localParams"</span>:[
+
+ ],
+ <span class="hljs-string">"rawScript"</span>:<span class="hljs-string">"print("</span>This is a python script<span class="hljs-string">")"</span>
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+}
+</code></pre>
+<h2>Flink节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>FLINK</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>Json 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>mainClass</td>
+<td>String</td>
+<td>运行主类</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td></td>
+<td>mainArgs</td>
+<td>String</td>
+<td>运行参数</td>
+<td></td>
+</tr>
+<tr>
+<td>7</td>
+<td></td>
+<td>others</td>
+<td>String</td>
+<td>其他参数</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td></td>
+<td>mainJar</td>
+<td>Object</td>
+<td>程序 jar 包</td>
+<td></td>
+</tr>
+<tr>
+<td>9</td>
+<td></td>
+<td>deployMode</td>
+<td>String</td>
+<td>部署模式</td>
+<td>local,client,cluster</td>
+</tr>
+<tr>
+<td>10</td>
+<td></td>
+<td>slot</td>
+<td>String</td>
+<td>slot数量</td>
+<td></td>
+</tr>
+<tr>
+<td>11</td>
+<td></td>
+<td>taskManager</td>
+<td>String</td>
+<td>taskManage数量</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td></td>
+<td>taskManagerMemory</td>
+<td>String</td>
+<td>taskManager内存数</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td></td>
+<td>jobManagerMemory</td>
+<td>String</td>
+<td>jobManager内存数</td>
+<td></td>
+</tr>
+<tr>
+<td>14</td>
+<td></td>
+<td>programType</td>
+<td>String</td>
+<td>程序类型</td>
+<td>JAVA,SCALA,PYTHON</td>
+</tr>
+<tr>
+<td>15</td>
+<td></td>
+<td>localParams</td>
+<td>Array</td>
+<td>自定义参数</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td></td>
+<td>resourceList</td>
+<td>Array</td>
+<td>资源文件</td>
+<td></td>
+</tr>
+<tr>
+<td>17</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>18</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>19</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>20</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>21</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>22</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>23</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>24</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>25</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>26</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>27</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>38</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"FLINK"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-17135"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"FlinkTask"</span>,
+ <span class="hljs-string">"params"</span>:{
+ <span class="hljs-string">"mainClass"</span>:<span class="hljs-string">"com.flink.demo"</span>,
+ <span class="hljs-string">"mainJar"</span>:{
+ <span class="hljs-string">"id"</span>:6
+ },
+ <span class="hljs-string">"deployMode"</span>:<span class="hljs-string">"cluster"</span>,
+ <span class="hljs-string">"resourceList"</span>:[
+ {
+ <span class="hljs-string">"id"</span>:3,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"run.sh"</span>,
+ <span class="hljs-string">"res"</span>:<span class="hljs-string">"run.sh"</span>
+ }
+ ],
+ <span class="hljs-string">"localParams"</span>:[
+
+ ],
+ <span class="hljs-string">"slot"</span>:1,
+ <span class="hljs-string">"taskManager"</span>:<span class="hljs-string">"2"</span>,
+ <span class="hljs-string">"jobManagerMemory"</span>:<span class="hljs-string">"1G"</span>,
+ <span class="hljs-string">"taskManagerMemory"</span>:<span class="hljs-string">"2G"</span>,
+ <span class="hljs-string">"executorCores"</span>:2,
+ <span class="hljs-string">"mainArgs"</span>:<span class="hljs-string">"100"</span>,
+ <span class="hljs-string">"others"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"programType"</span>:<span class="hljs-string">"SCALA"</span>
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+}
+</code></pre>
+<h2>HTTP节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>HTTP</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>Json 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>url</td>
+<td>String</td>
+<td>请求地址</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td></td>
+<td>httpMethod</td>
+<td>String</td>
+<td>请求方式</td>
+<td>GET,POST,HEAD,PUT,DELETE</td>
+</tr>
+<tr>
+<td>7</td>
+<td></td>
+<td>httpParams</td>
+<td>Array</td>
+<td>请求参数</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td></td>
+<td>httpCheckCondition</td>
+<td>String</td>
+<td>校验条件</td>
+<td>默认响应码200</td>
+</tr>
+<tr>
+<td>9</td>
+<td></td>
+<td>condition</td>
+<td>String</td>
+<td>校验内容</td>
+<td></td>
+</tr>
+<tr>
+<td>10</td>
+<td></td>
+<td>localParams</td>
+<td>Array</td>
+<td>自定义参数</td>
+<td></td>
+</tr>
+<tr>
+<td>11</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>14</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>15</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>17</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>18</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>19</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>20</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>21</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>22</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"HTTP"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-60499"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"HttpTask"</span>,
+ <span class="hljs-string">"params"</span>:{
+ <span class="hljs-string">"localParams"</span>:[
+
+ ],
+ <span class="hljs-string">"httpParams"</span>:[
+ {
+ <span class="hljs-string">"prop"</span>:<span class="hljs-string">"id"</span>,
+ <span class="hljs-string">"httpParametersType"</span>:<span class="hljs-string">"PARAMETER"</span>,
+ <span class="hljs-string">"value"</span>:<span class="hljs-string">"1"</span>
+ },
+ {
+ <span class="hljs-string">"prop"</span>:<span class="hljs-string">"name"</span>,
+ <span class="hljs-string">"httpParametersType"</span>:<span class="hljs-string">"PARAMETER"</span>,
+ <span class="hljs-string">"value"</span>:<span class="hljs-string">"Bo"</span>
+ }
+ ],
+ <span class="hljs-string">"url"</span>:<span class="hljs-string">"https://www.xxxxx.com:9012"</span>,
+ <span class="hljs-string">"httpMethod"</span>:<span class="hljs-string">"POST"</span>,
+ <span class="hljs-string">"httpCheckCondition"</span>:<span class="hljs-string">"STATUS_CODE_DEFAULT"</span>,
+ <span class="hljs-string">"condition"</span>:<span class="hljs-string">""</span>
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+}
+</code></pre>
+<h2>DataX节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>DATAX</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>Json 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>customConfig</td>
+<td>Int</td>
+<td>自定义类型</td>
+<td>0定制 , 1自定义</td>
+</tr>
+<tr>
+<td>6</td>
+<td></td>
+<td>dsType</td>
+<td>String</td>
+<td>源数据库类型</td>
+<td></td>
+</tr>
+<tr>
+<td>7</td>
+<td></td>
+<td>dataSource</td>
+<td>Int</td>
+<td>源数据库ID</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td></td>
+<td>dtType</td>
+<td>String</td>
+<td>目标数据库类型</td>
+<td></td>
+</tr>
+<tr>
+<td>9</td>
+<td></td>
+<td>dataTarget</td>
+<td>Int</td>
+<td>目标数据库ID</td>
+<td></td>
+</tr>
+<tr>
+<td>10</td>
+<td></td>
+<td>sql</td>
+<td>String</td>
+<td>SQL语句</td>
+<td></td>
+</tr>
+<tr>
+<td>11</td>
+<td></td>
+<td>targetTable</td>
+<td>String</td>
+<td>目标表</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td></td>
+<td>jobSpeedByte</td>
+<td>Int</td>
+<td>限流(字节数)</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td></td>
+<td>jobSpeedRecord</td>
+<td>Int</td>
+<td>限流(记录数)</td>
+<td></td>
+</tr>
+<tr>
+<td>14</td>
+<td></td>
+<td>preStatements</td>
+<td>Array</td>
+<td>前置SQL</td>
+<td></td>
+</tr>
+<tr>
+<td>15</td>
+<td></td>
+<td>postStatements</td>
+<td>Array</td>
+<td>后置SQL</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td></td>
+<td>json</td>
+<td>String</td>
+<td>自定义配置</td>
+<td>customConfig=1时生效</td>
+</tr>
+<tr>
+<td>17</td>
+<td></td>
+<td>localParams</td>
+<td>Array</td>
+<td>自定义参数</td>
+<td>customConfig=1时生效</td>
+</tr>
+<tr>
+<td>18</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>19</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>20</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>21</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>22</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>23</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>24</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>25</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>26</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>27</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>28</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>29</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"DATAX"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-91196"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"DataxTask-DB"</span>,
+ <span class="hljs-string">"params"</span>:{
+ <span class="hljs-string">"customConfig"</span>:0,
+ <span class="hljs-string">"dsType"</span>:<span class="hljs-string">"MYSQL"</span>,
+ <span class="hljs-string">"dataSource"</span>:1,
+ <span class="hljs-string">"dtType"</span>:<span class="hljs-string">"MYSQL"</span>,
+ <span class="hljs-string">"dataTarget"</span>:1,
+ <span class="hljs-string">"sql"</span>:<span class="hljs-string">"select id, name ,age from user "</span>,
+ <span class="hljs-string">"targetTable"</span>:<span class="hljs-string">"emp"</span>,
+ <span class="hljs-string">"jobSpeedByte"</span>:524288,
+ <span class="hljs-string">"jobSpeedRecord"</span>:500,
+ <span class="hljs-string">"preStatements"</span>:[
+ <span class="hljs-string">"truncate table emp "</span>
+ ],
+ <span class="hljs-string">"postStatements"</span>:[
+ <span class="hljs-string">"truncate table user"</span>
+ ]
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+}
+</code></pre>
+<h2>Sqoop节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>SQOOP</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>JSON 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>concurrency</td>
+<td>Int</td>
+<td>并发度</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td></td>
+<td>modelType</td>
+<td>String</td>
+<td>流向</td>
+<td>import,export</td>
+</tr>
+<tr>
+<td>7</td>
+<td></td>
+<td>sourceType</td>
+<td>String</td>
+<td>数据源类型</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td></td>
+<td>sourceParams</td>
+<td>String</td>
+<td>数据源参数</td>
+<td>JSON格式</td>
+</tr>
+<tr>
+<td>9</td>
+<td></td>
+<td>targetType</td>
+<td>String</td>
+<td>目标数据类型</td>
+<td></td>
+</tr>
+<tr>
+<td>10</td>
+<td></td>
+<td>targetParams</td>
+<td>String</td>
+<td>目标数据参数</td>
+<td>JSON格式</td>
+</tr>
+<tr>
+<td>11</td>
+<td></td>
+<td>localParams</td>
+<td>Array</td>
+<td>自定义参数</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>14</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>15</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>17</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>18</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>19</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>20</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>21</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>22</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>23</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"SQOOP"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-82041"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"Sqoop Task"</span>,
+ <span class="hljs-string">"params"</span>:{
+ <span class="hljs-string">"concurrency"</span>:1,
+ <span class="hljs-string">"modelType"</span>:<span class="hljs-string">"import"</span>,
+ <span class="hljs-string">"sourceType"</span>:<span class="hljs-string">"MYSQL"</span>,
+ <span class="hljs-string">"targetType"</span>:<span class="hljs-string">"HDFS"</span>,
+ <span class="hljs-string">"sourceParams"</span>:<span class="hljs-string">"{"</span>srcType<span class="hljs-string">":"</span>MYSQL<span class="hljs-string">","</span>srcDatasource<span class="hljs-string">":1,"</span>srcTable<span class="hljs-string">":"</span><span class="hljs-string">","</span>srcQueryType<span class="hljs-string">":"</span>1<span class="hljs-string">","</span>srcQuerySql<span class="hljs-string">":"</span>selec id , name from user<span class="hljs-st [...]
+ <span class="hljs-string">"targetParams"</span>:<span class="hljs-string">"{"</span>targetPath<span class="hljs-string">":"</span>/user/hive/warehouse/ods.db/user<span class="hljs-string">","</span>deleteTargetDir<span class="hljs-string">":false,"</span>fileType<span class="hljs-string">":"</span>--as-avrodatafile<span class="hljs-string">","</span>compressionCodec<span class="hljs-string">":"</span>snappy<span class="hljs-string">","</span>fieldsTerminated<span class="h [...]
+ <span class="hljs-string">"localParams"</span>:[
+
+ ]
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+ }
+</code></pre>
+<h2>条件分支节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>SHELL</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>null</td>
+</tr>
+<tr>
+<td>5</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>7</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>9</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>10</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>11</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>14</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>15</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"CONDITIONS"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-96189"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"条件"</span>,
+ <span class="hljs-string">"params"</span>:{
+
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">"test04"</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">"test05"</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+ <span class="hljs-string">"relation"</span>:<span class="hljs-string">"AND"</span>,
+ <span class="hljs-string">"dependTaskList"</span>:[
+
+ ]
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+ <span class="hljs-string">"test01"</span>,
+ <span class="hljs-string">"test02"</span>
+ ]
+}
+</code></pre>
+<h2>子流程节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>SHELL</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>Json 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>processDefinitionId</td>
+<td>Int</td>
+<td>流程定义id</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>7</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>9</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>10</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>11</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>12</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>14</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>15</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>17</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"SUB_PROCESS"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-14806"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"SubProcessTask"</span>,
+ <span class="hljs-string">"params"</span>:{
+ <span class="hljs-string">"processDefinitionId"</span>:2
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+
+ },
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+ }
+</code></pre>
+<h2>依赖(DEPENDENT)节点</h2>
+<p><strong>节点数据结构如下:</strong></p>
+<p><strong>节点数据结构如下:</strong></p>
+<table>
+<thead>
+<tr>
+<th>序号</th>
+<th>参数名</th>
+<th></th>
+<th>类型</th>
+<th>描述</th>
+<th>描述</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td>1</td>
+<td>id</td>
+<td></td>
+<td>String</td>
+<td>任务编码</td>
+<td></td>
+</tr>
+<tr>
+<td>2</td>
+<td>type</td>
+<td></td>
+<td>String</td>
+<td>类型</td>
+<td>DEPENDENT</td>
+</tr>
+<tr>
+<td>3</td>
+<td>name</td>
+<td></td>
+<td>String</td>
+<td>名称</td>
+<td></td>
+</tr>
+<tr>
+<td>4</td>
+<td>params</td>
+<td></td>
+<td>Object</td>
+<td>自定义参数</td>
+<td>Json 格式</td>
+</tr>
+<tr>
+<td>5</td>
+<td></td>
+<td>rawScript</td>
+<td>String</td>
+<td>Shell脚本</td>
+<td></td>
+</tr>
+<tr>
+<td>6</td>
+<td></td>
+<td>localParams</td>
+<td>Array</td>
+<td>自定义参数</td>
+<td></td>
+</tr>
+<tr>
+<td>7</td>
+<td></td>
+<td>resourceList</td>
+<td>Array</td>
+<td>资源文件</td>
+<td></td>
+</tr>
+<tr>
+<td>8</td>
+<td>description</td>
+<td></td>
+<td>String</td>
+<td>描述</td>
+<td></td>
+</tr>
+<tr>
+<td>9</td>
+<td>runFlag</td>
+<td></td>
+<td>String</td>
+<td>运行标识</td>
+<td></td>
+</tr>
+<tr>
+<td>10</td>
+<td>conditionResult</td>
+<td></td>
+<td>Object</td>
+<td>条件分支</td>
+<td></td>
+</tr>
+<tr>
+<td>11</td>
+<td></td>
+<td>successNode</td>
+<td>Array</td>
+<td>成功跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>12</td>
+<td></td>
+<td>failedNode</td>
+<td>Array</td>
+<td>失败跳转节点</td>
+<td></td>
+</tr>
+<tr>
+<td>13</td>
+<td>dependence</td>
+<td></td>
+<td>Object</td>
+<td>任务依赖</td>
+<td>与params互斥</td>
+</tr>
+<tr>
+<td>14</td>
+<td></td>
+<td>relation</td>
+<td>String</td>
+<td>关系</td>
+<td>AND,OR</td>
+</tr>
+<tr>
+<td>15</td>
+<td></td>
+<td>dependTaskList</td>
+<td>Array</td>
+<td>依赖任务清单</td>
+<td></td>
+</tr>
+<tr>
+<td>16</td>
+<td>maxRetryTimes</td>
+<td></td>
+<td>String</td>
+<td>最大重试次数</td>
+<td></td>
+</tr>
+<tr>
+<td>17</td>
+<td>retryInterval</td>
+<td></td>
+<td>String</td>
+<td>重试间隔</td>
+<td></td>
+</tr>
+<tr>
+<td>18</td>
+<td>timeout</td>
+<td></td>
+<td>Object</td>
+<td>超时控制</td>
+<td></td>
+</tr>
+<tr>
+<td>19</td>
+<td>taskInstancePriority</td>
+<td></td>
+<td>String</td>
+<td>任务优先级</td>
+<td></td>
+</tr>
+<tr>
+<td>20</td>
+<td>workerGroup</td>
+<td></td>
+<td>String</td>
+<td>Worker 分组</td>
+<td></td>
+</tr>
+<tr>
+<td>21</td>
+<td>preTasks</td>
+<td></td>
+<td>Array</td>
+<td>前置任务</td>
+<td></td>
+</tr>
+</tbody>
+</table>
+<p><strong>节点数据样例:</strong></p>
+<pre><code class="language-bash">{
+ <span class="hljs-string">"type"</span>:<span class="hljs-string">"DEPENDENT"</span>,
+ <span class="hljs-string">"id"</span>:<span class="hljs-string">"tasks-57057"</span>,
+ <span class="hljs-string">"name"</span>:<span class="hljs-string">"DenpendentTask"</span>,
+ <span class="hljs-string">"params"</span>:{
+
+ },
+ <span class="hljs-string">"description"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"runFlag"</span>:<span class="hljs-string">"NORMAL"</span>,
+ <span class="hljs-string">"conditionResult"</span>:{
+ <span class="hljs-string">"successNode"</span>:[
+ <span class="hljs-string">""</span>
+ ],
+ <span class="hljs-string">"failedNode"</span>:[
+ <span class="hljs-string">""</span>
+ ]
+ },
+ <span class="hljs-string">"dependence"</span>:{
+ <span class="hljs-string">"relation"</span>:<span class="hljs-string">"AND"</span>,
+ <span class="hljs-string">"dependTaskList"</span>:[
+ {
+ <span class="hljs-string">"relation"</span>:<span class="hljs-string">"AND"</span>,
+ <span class="hljs-string">"dependItemList"</span>:[
+ {
+ <span class="hljs-string">"projectId"</span>:1,
+ <span class="hljs-string">"definitionId"</span>:7,
+ <span class="hljs-string">"definitionList"</span>:[
+ {
+ <span class="hljs-string">"value"</span>:8,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"MRTask"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:7,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"FlinkTask"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:6,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"SparkTask"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:5,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"SqlTask-Update"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:4,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"SqlTask-Query"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:3,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"SubProcessTask"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:2,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"Python Task"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:1,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"Shell Task"</span>
+ }
+ ],
+ <span class="hljs-string">"depTasks"</span>:<span class="hljs-string">"ALL"</span>,
+ <span class="hljs-string">"cycle"</span>:<span class="hljs-string">"day"</span>,
+ <span class="hljs-string">"dateValue"</span>:<span class="hljs-string">"today"</span>
+ }
+ ]
+ },
+ {
+ <span class="hljs-string">"relation"</span>:<span class="hljs-string">"AND"</span>,
+ <span class="hljs-string">"dependItemList"</span>:[
+ {
+ <span class="hljs-string">"projectId"</span>:1,
+ <span class="hljs-string">"definitionId"</span>:5,
+ <span class="hljs-string">"definitionList"</span>:[
+ {
+ <span class="hljs-string">"value"</span>:8,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"MRTask"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:7,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"FlinkTask"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:6,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"SparkTask"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:5,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"SqlTask-Update"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:4,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"SqlTask-Query"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:3,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"SubProcessTask"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:2,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"Python Task"</span>
+ },
+ {
+ <span class="hljs-string">"value"</span>:1,
+ <span class="hljs-string">"label"</span>:<span class="hljs-string">"Shell Task"</span>
+ }
+ ],
+ <span class="hljs-string">"depTasks"</span>:<span class="hljs-string">"SqlTask-Update"</span>,
+ <span class="hljs-string">"cycle"</span>:<span class="hljs-string">"day"</span>,
+ <span class="hljs-string">"dateValue"</span>:<span class="hljs-string">"today"</span>
+ }
+ ]
+ }
+ ]
+ },
+ <span class="hljs-string">"maxRetryTimes"</span>:<span class="hljs-string">"0"</span>,
+ <span class="hljs-string">"retryInterval"</span>:<span class="hljs-string">"1"</span>,
+ <span class="hljs-string">"timeout"</span>:{
+ <span class="hljs-string">"strategy"</span>:<span class="hljs-string">""</span>,
+ <span class="hljs-string">"interval"</span>:null,
+ <span class="hljs-string">"enable"</span>:<span class="hljs-literal">false</span>
+ },
+ <span class="hljs-string">"taskInstancePriority"</span>:<span class="hljs-string">"MEDIUM"</span>,
+ <span class="hljs-string">"workerGroup"</span>:<span class="hljs-string">"default"</span>,
+ <span class="hljs-string">"preTasks"</span>:[
+
+ ]
+ }
+</code></pre>
+</div></section><footer class="footer-container"><div class="footer-body"><img src="/img/ds_gray.svg"/><div class="cols-container"><div class="col col-12"><h3>Disclaimer</h3><p>Apache DolphinScheduler (incubating) is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by Incubator.
+Incubation is required of all newly accepted projects until a further review indicates
+that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects.
+While incubation status is not necessarily a reflection of the completeness or stability of the code,
+it does indicate that the project has yet to be fully endorsed by the ASF.</p></div><div class="col col-6"><dl><dt>文档</dt><dd><a href="/zh-cn/docs/1.2.0/user_doc/architecture-design.html" target="_self">概览</a></dd><dd><a href="/zh-cn/docs/1.2.0/user_doc/quick-start.html" target="_self">快速开始</a></dd><dd><a href="/zh-cn/docs/1.2.0/user_doc/backend-development.html" target="_self">开发者指南</a></dd></dl></div><div class="col col-6"><dl><dt>ASF</dt><dd><a href="http://www.apache.org" target="_se [...]
+ <script src="https://f.alicdn.com/react/15.4.1/react-with-addons.min.js"></script>
+ <script src="https://f.alicdn.com/react/15.4.1/react-dom.min.js"></script>
+ <script>
+ window.rootPath = '';
+ </script>
+ <script src="/build/documentation.js"></script>
+</body>
+</html>
\ No newline at end of file
diff --git a/zh-cn/docs/1.3.0/user_doc/task-structure.json b/zh-cn/docs/1.3.0/user_doc/task-structure.json
new file mode 100644
index 0000000..968bafc
--- /dev/null
+++ b/zh-cn/docs/1.3.0/user_doc/task-structure.json
@@ -0,0 +1,6 @@
+{
+ "filename": "task-structure.md",
+ "__html": "<h1>任务总体存储结构</h1>\n<p>在dolphinscheduler中创建的所有任务都保存在t_ds_process_definition 表中.</p>\n<p>该数据库表结构如下表所示:</p>\n<table>\n<thead>\n<tr>\n<th>序号</th>\n<th>字段</th>\n<th>类型</th>\n<th>描述</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>1</td>\n<td>id</td>\n<td>int(11)</td>\n<td>主键</td>\n</tr>\n<tr>\n<td>2</td>\n<td>name</td>\n<td>varchar(255)</td>\n<td>流程定义名称</td>\n</tr>\n<tr>\n<td>3</td>\n<td>version</td>\n<td>int(11)</td>\n<td>流程定义版本</td>\n</tr>\n<tr>\n<td>4</td>\n<td>release_state</td>\n<t [...]
+ "link": "/zh-cn/docs/1.3.0/user_doc/task-structure.html",
+ "meta": {}
+}
\ No newline at end of file