You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/08/23 14:23:39 UTC
[GitHub] [dolphinscheduler] wen-hemin opened a new issue, #11623: [Improvement][Master Server] When complement data, execution strategy of downstream tasks
wen-hemin opened a new issue, #11623:
URL: https://github.com/apache/dolphinscheduler/issues/11623
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.
### Description
When the upstream task executes the complement data, the downstream task has two trigger mechanisms.
1.After the upstream task is successfully executed, the downstream task is automatically triggered to continue to execute the complement data.The downstream triggering action is determined by the upstream complement data task.
2.The downstream task supports the configuration of whether to follow the upstream execution complement. The downstream triggering action is determined by the downstream task itself.
I personally support the second mechanism, The reason:
1.On the issue of authority and responsibility, the triggering and execution of a task should be decided by the task leader, not by the upstream, because the upstream does not know the execution logic of the downstream task. In fact, upstream can not guarantee that all downstream can perform as expected.
2.Some tasks cannot be re run at any time, such as hive2mysql / hive2doris. Re running tasks will cause no data in the downstream for a period of time.
3.For example, downstream of task A are tasks B、C、D, Upstream of task E are B、C、D. In this case, the result of task E is unpredictable, it may run repeatedly or only once, but the data is wrong.
These are my personal views. Welcome to discuss.
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #11623: [Improvement][Master Server] When complement data, execution strategy of downstream tasks
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #11623:
URL: https://github.com/apache/dolphinscheduler/issues/11623#issuecomment-1224201067
Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] closed issue #11623: [Improvement][Master Server] When complement data, execution strategy of downstream tasks
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #11623: [Improvement][Master Server] When complement data, execution strategy of downstream tasks
URL: https://github.com/apache/dolphinscheduler/issues/11623
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #11623: [Improvement][Master Server] When complement data, execution strategy of downstream tasks
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #11623:
URL: https://github.com/apache/dolphinscheduler/issues/11623#issuecomment-1256815401
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #11623: [Improvement][Master Server] When complement data, execution strategy of downstream tasks
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #11623:
URL: https://github.com/apache/dolphinscheduler/issues/11623#issuecomment-1264170814
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org