You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "starrysxy (via GitHub)" <gi...@apache.org> on 2024/07/07 03:25:28 UTC
[I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
starrysxy opened a new issue, #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
First of all, I'm not sure if this is a code bug. I checked the code and the phenomenon is consistent with the current code logic, but for the business logic, I don't think it is very reasonable. If necessary, please help to modify the tag.
Suppose there are two workflows A and B. Workflow A has tasks A-1, A-2, and A-3. Workflow B depends on task A-3 in workflow A. When the A workflow is finished, if the A-1 task in the A workflow is re-executed separately and the B workflow instance in the same cycle has not been executed, the dependent node in the B workflow will fail, which will cause the B workflow instance to fail.
The logic in the code is to find the workflow instance with the latest endTime in each cycle, so the workflow instance where the A-1 task is executed alone will be found, but this workflow instance does not have the A-3 task that the downstream B workflow depends on. Therefore, after getting the A workflow instance, the A-3 task instance cannot be found when traversing the task instances. At the same time, the A workflow instance is in the completed state, so the dependent node is marked as failed, and then the B workflow is marked as failed.
In my opinion, the logic of this part of the code is to facilitate the selection of 'ALL' for dependent tasks, without having to check the status of each task in the upstream workflow, but directly check the status of the entire upstream workflow. However, I think that in actual work, it is inevitable to modify the workflow, and it is also inevitable to re-execute the task after modifying the workflow. At the same time, re-executing the entire workflow may lead to problems such as late result output and waste of machine resources. Therefore, the logic here may be optimized.
### What you expected to happen
If a dependent task in an upstream workflow has ever succeeded, the node status of the dependent task in the downstream workflow of the same cycle should be marked as successful.
### How to reproduce
Suppose there are two workflows A and B. Workflow A has tasks A-1, A-2, and A-3. Workflow B depends on task A-3 in workflow A. When the A workflow is finished, if the A-1 task in the A workflow is re-executed separately and the B workflow instance in the same cycle has not been executed, the dependent node in the B workflow will fail, which will cause the B workflow instance to fail.
### Anything else
_No response_
### Version
3.1.x
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2290808584
> Do you think the status of the downstream task should be waiting until the upstream task has no more retries?
Yes. However, it is not easy to implement under the existing architecture. We can optimze it after this refatoring is merged. #16423
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2293807429
@EricGao888 Yes, like I say, https://github.com/apache/dolphinscheduler/pull/15795 and https://github.com/apache/dolphinscheduler/pull/15712 worked. But I think @SbloodyS wants to find a new way to fix this bug, which will make the task instance not bind with the workflow instance status. Am I right?
> But this logic was added only in and after 3.2.2-release:
<select id="queryLastRunningProcess"...>
...
My dev branch is the lastest version, and I have also checked 3.2.2-release branch, but I can't find `<select id="queryLastRunningProcess"...>`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2290759566
This PR #15795 fixes a different issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "EricGao888 (via GitHub)" <gi...@apache.org>.
EricGao888 commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2292652033
@starrysxy It is a bug. However, I don't think it still exists in 3.2.2-release or dev. You could cherry-pick related stuff to patch your local code.
As you could see in the below code fragments, in the latest logic, the query joins the task instances table to make sure the upstream task included when querying last workflow instance.
https://github.com/apache/dolphinscheduler/blob/57c80f2af5d1f29417fdbea09b27221f54987655/dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ProcessInstanceMapper.xml#L192-L234
But this logic was added only in and after 3.2.2-release:
https://github.com/apache/dolphinscheduler/blob/15d356b79d4dc14fa187f618107bc50e824061ac/dolphinscheduler-dao/src/main/resources/org/apache/dolphinscheduler/dao/mapper/ProcessInstanceMapper.xml#L209-L236
cc @SbloodyS @ruanwenjun
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2290802170
> #15795 has nothing to do with `the task instance status should not bind with workflow instance status`
ok, I get you. I mean #15795 worked. I'll find a new way to fix this issue.
BTW, please take a look at this scenario(https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2290629944) again.
Do you think the status of the downstream task should be waiting until the upstream task has no more retries?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Question] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2219692685
I think I know what your problem is. The current dependency node check will get the latest workflow instance to verify that the task instance in it meets the configuration conditions. However, this judgment does not take into account the case of manually starting individual tasks, which can only execute some of the nodes. This scenario calls for a solution discussion.
cc @caishunfeng @ruanwenjun @EricGao888 @rickchengx
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2375497071
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #16285: [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on
URL: https://github.com/apache/dolphinscheduler/issues/16285
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2219783629
> I think I know what your problem is. The current dependency node check will get the latest workflow instance to verify that the task instance in it meets the configuration conditions. However, this judgment does not take into account the case of manually starting individual tasks, which can only execute some of the nodes. This scenario calls for a solution discussion.
>
> cc @caishunfeng @ruanwenjun @EricGao888 @rickchengx
Yes, that's what I mean. Btw, my version is 3.1.8.(The logic of this part is still the same in later versions). I have checked the code, and I think this scenario is common, especially if you've just switched to DS from another dispatch system. Because tasks will not be migrated all at once, but will be migrated one by one, which means the process definition will be modified frequently.
**Maybe we can start with these two places in the code:**
1. `org.apache.dolphinscheduler.server.master.utils.DependentExecute#calculateResultForTasks`
2. `org.apache.dolphinscheduler.server.master.utils.DependentExecute#getDependTaskResult`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2230103855
> In my opinion, this is a bug, the task instance status should not bind with workflow instance status.
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2290629944
> > @SbloodyS When I try to fix this bug, using the dev branch, I found it has been fixed in #15795. But the bug is still there in version 3.1.x. I'm not sure if I should commit to fix this bug in version 3.1.x. If yes, which brach should I use to commit a PR.
>
> After take a deep look at it, I found the task instance status still bind with workflow instance status in the `dev` branch.
You mean current fix is not good enough, right? BTW, I found a new scenario which could cause the same problem.
Both workflows are the same as https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2216171367
I set the failure retry time for A-3 to 5 minutes. Assume that A workflow failed at 7:00 am, because A-3 is failed. Then B workflow failed at 7:03, because at that time, A-3's status is failure. At 7:05, A-3 retried and succeeded. So, when I check the result of the both workflows, I found the status of A is success and B is failure.
So, I think if a task like A-3 is depended by other tasks and a retry policy has been set, the status of the downstream task should be waiting until the upstream task has no more retries.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2291167808
OK, I'll find a new way to fix this issue first, which will make the task instance not bind with the workflow instance status. And I'll take a look at the new architecture later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2291208229
> OK, I'll find a new way to fix this issue first, which will make the task instance not bind with the workflow instance status. And I'll take a look at the new architecture later.
You can start from here `org.apache.dolphinscheduler.server.master.utils.DependentExecute#dependResultByAllTaskOfProcessInstance`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2249968514
@SbloodyS When I try to fix this bug, using the dev branch, I found it has been fixed in https://github.com/apache/dolphinscheduler/pull/15795. But the bug is still there in version 3.1.x. I'm not sure if I should commit to fix this bug in version 3.1.x. If yes, which brach should I use to commit a PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "ruanwenjun (via GitHub)" <gi...@apache.org>.
ruanwenjun commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2221087243
> I think I know what your problem is. The current dependency node check will get the latest workflow instance to verify that the task instance in it meets the configuration conditions. However, this judgment does not take into account the case of manually starting individual tasks, which can only execute some of the nodes. This scenario calls for a solution discussion.
>
> cc @caishunfeng @ruanwenjun @EricGao888 @rickchengx
In my opinion, this is a bug, the task instance status should not bind with workflow instance status.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2354255637
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2228795301
> I think I know what your problem is. The current dependency node check will get the latest workflow instance to verify that the task instance in it meets the configuration conditions. However, this judgment does not take into account the case of manually starting individual tasks, which can only execute some of the nodes. This scenario calls for a solution discussion.
>
> cc @caishunfeng @ruanwenjun @EricGao888 @rickchengx
Looking forward to others' opinions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2290785140
> This PR #15795 fixes a different issue.
I think this PR fixes the same issue. The defference between #15795 and #15707 is that the instance is triggered by scheduler or manually.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Question] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2214025831
The `ALL` in a dependency means that all tasks in the workflow need to be executed successfully. If you want to re-execute a node in the workflow without affecting the results of the dependent nodes, you should choose tasks in the dependency workflow or reorganize your workflow. @starrysxy
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Question] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2216171367
> > The `ALL` in a dependency means that all tasks in the workflow need to be executed successfully. If you want to re-execute a node in the workflow without affecting the results of the dependent nodes, you should choose tasks in the dependency workflow or reorganize your workflow. @starrysxy
>
> Like I said. The `ALL` in a dependency means that all tasks in the workflow need to be executed successfully. In particular, it prevents you from manually re-executing a node like this. If the downstream execution continues only after all upstream nodes are executed, manually executing a single node is an illegal operation, which may cause downstream data exceptions.
I'm sure I get you. But my downstream don't depend on all tasks in the upstream, but only one task.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2212307071
I saw you commented in another question(https://github.com/apache/dolphinscheduler/issues/15807#issuecomment-2041720428), please take some time to look at this one, thanks @SbloodyS
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Question] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "starrysxy (via GitHub)" <gi...@apache.org>.
starrysxy commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2214342218
> The `ALL` in a dependency means that all tasks in the workflow need to be executed successfully. If you want to re-execute a node in the workflow without affecting the results of the dependent nodes, you should choose tasks in the dependency workflow or reorganize your workflow. @starrysxy
Thanks for your comment, I know the `ALL` in a dependency means that all tasks in the workflow need to be executed successfully. But my downstream only depends on 1 task in the upstream, not all tasks.
When I re-execute a node in the upstream, the dependent node in the downstream will fail if the downstream is executed after the upstream is successfully re-executed.
e.g: Upstream dispatch at 1 a.m. Meanwhile, downstream dispatch at 10 a.m. If I re-execute on task, that is not dependent on a dependency type node in the downstream, in the upstream at 7 a.m. And it will be successful in 1 hour. The downstream will fail in few seconds when it's dispatched at 10 a.m.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2290453719
> @SbloodyS When I try to fix this bug, using the dev branch, I found it has been fixed in #15795. But the bug is still there in version 3.1.x. I'm not sure if I should commit to fix this bug in version 3.1.x. If yes, which brach should I use to commit a PR.
After take a deep look at it, I found the task instance status still bind with workflow instance status in the `dev` branch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2290794338
#15795 has nothing to do with `the task instance status should not bind with workflow instance status`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Question] [Master] Dependent nodes failed when the upstream rerun without the task relied on [dolphinscheduler]
Posted by "SbloodyS (via GitHub)" <gi...@apache.org>.
SbloodyS commented on issue #16285:
URL: https://github.com/apache/dolphinscheduler/issues/16285#issuecomment-2215959057
> The `ALL` in a dependency means that all tasks in the workflow need to be executed successfully. If you want to re-execute a node in the workflow without affecting the results of the dependent nodes, you should choose tasks in the dependency workflow or reorganize your workflow. @starrysxy
Like I said. The `ALL` in a dependency means that all tasks in the workflow need to be executed successfully. In particular, it prevents you from manually re-executing a node like this. If the downstream execution continues only after all upstream nodes are executed, manually executing a single node is an illegal operation, which may cause downstream data exceptions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org