You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/04/09 08:16:50 UTC
[GitHub] [incubator-dolphinscheduler] feiyalun opened a new issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
feiyalun opened a new issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388
We have a total of 650 script sources and endpoints, namely, STG and app layer have the most scripts. The middle layer is ods, DWD, dwa and DWR. According to the hierarchical construction flow, we rely on nodes to determine whether to go down or not.If one of the STG tables at the source is broken, or there is a problem with one of the mid-level tables.The upstream and downstream data to be replenishment can not be realized by cross-workflow, this scheduling framework can only be executed in this workflow forward, backward, and only execute itself.Once you cross the workflow, nothing is impossible.
In theory, the parent-child dependencies in each workflow can be connected to form a total blood map.In this way, the subsequent complement, relatively convenient.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [dolphinscheduler] atai-555 commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
atai-555 commented on issue #2388:
URL: https://github.com/apache/dolphinscheduler/issues/2388#issuecomment-996519912
Is there any progress on this requirement?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] swxchappy commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
swxchappy commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388#issuecomment-611823112
+1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [dolphinscheduler] Level1Accelerator commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
Level1Accelerator commented on issue #2388:
URL: https://github.com/apache/dolphinscheduler/issues/2388#issuecomment-1000148085
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] feiyalun commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
feiyalun commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388#issuecomment-611397113
我们一共650个脚本 源头和终点 也就是stg、 app层脚本量最多， 中间层 ods、dwd、dwa、dwr啊， 按照分层建流， 依靠节点来当天成功失败来是否往下走。如果源头的一张stg表数据坏了， 或者中层某个表数据有问题。上下游要补数据 靠跨工作流能无法实现重跑， 这个调度框架 只能在本工作流里往前执行、往后执行、仅执行本身。你一旦跨工作流了 ，就无没法实现。
理论上是可以根据各自工作流里面的父子依赖串联起来，形成一个总的血缘图。这样后续要补数，就相对方便了。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-dolphinscheduler] zixi0825 commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
zixi0825 commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388#issuecomment-611858997
+1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388#issuecomment-611461822
good suggestion，already add to Requirement Card
if anybody who like this feature, please reply "+1" or anything you want to reply, like how to do implement it and so on, please feel free
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-dolphinscheduler] lgcareer commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
lgcareer commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388#issuecomment-614450010
Great!+1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-dolphinscheduler] aikuyun commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
aikuyun commented on issue #2388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388#issuecomment-629196063
+1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] MyColorfulDays commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
MyColorfulDays commented on issue #2388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388#issuecomment-619836323
+1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] Rubik-W commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
Rubik-W commented on issue #2388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388#issuecomment-629197408
I am implementing.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] atai-555 commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
atai-555 commented on issue #2388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388#issuecomment-724001203
waiting! +1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] jetaime-chen commented on issue #2388: I recommend supporting data support across workflows（跨工作流的血缘关系建议）
Posted by GitBox <gi...@apache.org>.
jetaime-chen commented on issue #2388:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2388#issuecomment-657383393
+1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org