You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/06/29 14:48:37 UTC
[GitHub] [dolphinscheduler] lordk911 opened a new issue, #10679: [Bug] [dependent node] dependent node blocked when the depend on process have wrong metadata
lordk911 opened a new issue, #10679:
URL: https://github.com/apache/dolphinscheduler/issues/10679
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
a dependent task node (tA) depend on one scheduled process's (pB) task (tB) . I don't know for what reason, the depend on task(tB) blocked, so I kill the process (pB), then the killed process (pB) didn't have a endTime , after manually start process (pB), the task node (tA) still be blocked , the error log in master is :
```
org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteThread:[689] - submit standby task error
java.lang.NullPointerException: null
at java.util.Date.getMillisOf(Date.java:958)
at java.util.Date.after(Date.java:931)
at org.apache.dolphinscheduler.server.utils.DependentExecute.findLastProcessInterval(DependentExecute.java:204)
at org.apache.dolphinscheduler.server.utils.DependentExecute.calculateResultForTasks(DependentExecute.java:110)
at org.apache.dolphinscheduler.server.utils.DependentExecute.getDependentResultForItem(DependentExecute.java:95)
at org.apache.dolphinscheduler.server.utils.DependentExecute.getDependResultForItem(DependentExecute.java:288)
at org.apache.dolphinscheduler.server.utils.DependentExecute.getModelDependResult(DependentExecute.java:266)
at org.apache.dolphinscheduler.server.utils.DependentExecute.finish(DependentExecute.java:249)
at org.apache.dolphinscheduler.server.master.runner.task.DependentTaskProcessor.allDependentTaskFinish(DependentTaskProcessor.java:190)
at org.apache.dolphinscheduler.server.master.runner.task.DependentTaskProcessor.runTask(DependentTaskProcessor.java:103)
at org.apache.dolphinscheduler.server.master.runner.task.BaseTaskProcessor.run(BaseTaskProcessor.java:183)
at org.apache.dolphinscheduler.server.master.runner.task.BaseTaskProcessor.action(BaseTaskProcessor.java:168)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteThread.submitTaskExec(WorkflowExecuteThread.java:666)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteThread.submitStandByTask(WorkflowExecuteThread.java:1394)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteThread.submitPostNode(WorkflowExecuteThread.java:930)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteThread.startProcess(WorkflowExecuteThread.java:544)
at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteThread.run(WorkflowExecuteThread.java:239)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
```
the code throw the Exception is :
`return (lastManualProcess.getEndTime().after(lastSchedulerProcess.getEndTime())) ? lastManualProcess : lastSchedulerProcess;`
### What you expected to happen
if the metadata is wrong , exception should be handled
### How to reproduce
just remove one t_ds_process_instance record's end_time ,and set some task depend on it
### Anything else
_No response_
### Version
2.0.5
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #10679: [Bug] [dependent node] dependent node blocked when the depend on process have wrong metadata
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #10679:
URL: https://github.com/apache/dolphinscheduler/issues/10679#issuecomment-1207304067
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] closed issue #10679: [Bug] [dependent node] dependent node blocked when the depend on process have wrong metadata
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #10679: [Bug] [dependent node] dependent node blocked when the depend on process have wrong metadata
URL: https://github.com/apache/dolphinscheduler/issues/10679
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #10679: [Bug] [dependent node] dependent node blocked when the depend on process have wrong metadata
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #10679:
URL: https://github.com/apache/dolphinscheduler/issues/10679#issuecomment-1200319181
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #10679: [Bug] [dependent node] dependent node blocked when the depend on process have wrong metadata
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #10679:
URL: https://github.com/apache/dolphinscheduler/issues/10679#issuecomment-1170111473
Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org