You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "epitomizelu (via GitHub)" <gi...@apache.org> on 2024/02/26 07:54:23 UTC
[I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
epitomizelu opened a new issue, #15633:
URL: https://github.com/apache/dolphinscheduler/issues/15633
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
it looks same as the bug 7441.
the version is 3.1.8, and the cluster have 2 masters, 4 workers.
I found a workflow instance running for more than 12 hours and it is abnormal. Then I found a task of the sub workflow is waiting to be executed for more than 10 hours.
When I ended the workflow and restart it, the problem usually does not reproduce.
### What you expected to happen
if a task waits for more than 5 minuts and can not be executed, the task should be failed.
### How to reproduce
It is hard to reproduce, the workflow works normally for most of the time. And When I ended the workflow and restart it, the problem usually does not reproduce.
### Anything else
_No response_
### Version
3.1.x
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
Posted by "leachli (via GitHub)" <gi...@apache.org>.
leachli commented on issue #15633:
URL: https://github.com/apache/dolphinscheduler/issues/15633#issuecomment-1966012691
@ruanwenjun 你好，在使用带有subprocess的任务时，主流程到达 subprocess一直处于等待状态，实际上子节点已完成，看了主任务状态还是运行中，下图是任务执行状态和集群部署情况，期待你的回复
<img width="371" alt="image" src="https://github.com/apache/dolphinscheduler/assets/30209856/8d6d3b95-d4c3-425a-be96-34a7851ab98f">
<img width="603" alt="image" src="https://github.com/apache/dolphinscheduler/assets/30209856/f5f868de-d2fa-4b3b-bda3-8febfcbdaec0">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
Posted by "maxiangmin (via GitHub)" <gi...@apache.org>.
maxiangmin commented on issue #15633:
URL: https://github.com/apache/dolphinscheduler/issues/15633#issuecomment-2024269146
@ruanwenjun 你好，3.2x中包含子工作流时，如果子工作流中有任务失败，点击从失败节点重跑，子工作流中成功的任务也会全部被拉起来，你们又遇到类似的问题吗
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
Posted by "ruanwenjun (via GitHub)" <gi...@apache.org>.
ruanwenjun commented on issue #15633:
URL: https://github.com/apache/dolphinscheduler/issues/15633#issuecomment-1964193198
It would be better if you can provide the master log related to the parent workflow instance and sub workflow instance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
Posted by "ruanwenjun (via GitHub)" <gi...@apache.org>.
ruanwenjun commented on issue #15633:
URL: https://github.com/apache/dolphinscheduler/issues/15633#issuecomment-1965658648
> hi @epitomizelu #14986 maybe can fix you problem, It may have actually been executed, but it has been running because of the message backlog of the subprocess type task. cc @ruanwenjun WDYT?
We may need to add metrics to record the size of `xxCheckList` in `StateWheelExecuteThread`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #15633:
URL: https://github.com/apache/dolphinscheduler/issues/15633#issuecomment-2095015188
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
Posted by "fuchanghai (via GitHub)" <gi...@apache.org>.
fuchanghai commented on issue #15633:
URL: https://github.com/apache/dolphinscheduler/issues/15633#issuecomment-1965629155
hi @epitomizelu #14986 maybe can fix you problem, It may have actually been executed, but it has been running because of the message backlog of the subprocess type task. cc @ruanwenjun WDYT?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
Posted by "fuchanghai (via GitHub)" <gi...@apache.org>.
fuchanghai commented on issue #15633:
URL: https://github.com/apache/dolphinscheduler/issues/15633#issuecomment-1965887579
> > hi @epitomizelu #14986 maybe can fix you problem, It may have actually been executed, but it has been running because of the message backlog of the subprocess type task. cc @ruanwenjun WDYT?
>
> We may need to add metrics to record the size of `xxCheckList` in `StateWheelExecuteThread`.
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #15633:
URL: https://github.com/apache/dolphinscheduler/issues/15633#issuecomment-2081262164
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
Posted by "ruanwenjun (via GitHub)" <gi...@apache.org>.
ruanwenjun commented on issue #15633:
URL: https://github.com/apache/dolphinscheduler/issues/15633#issuecomment-1968728502
> @ruanwenjun 你好，在使用带有subprocess的任务时，主流程到达 subprocess一直处于等待状态，实际上子节点已完成，看了主任务状态还是运行中，下图是任务执行状态和集群部署情况，期待你的回复
> <img alt="image" width="371" src="https://private-user-images.githubusercontent.com/30209856/308089711-8d6d3b95-d4c3-425a-be96-34a7851ab98f.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDkxMTc5NDIsIm5iZiI6MTcwOTExNzY0MiwicGF0aCI6Ii8zMDIwOTg1Ni8zMDgwODk3MTEtOGQ2ZDNiOTUtZDRjMy00MjVhLWJlOTYtMzRhNzg1MWFiOThmLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDAyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwMjI4VDEwNTQwMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWJiM2Y4YmQwN2Q5MzgyMjUxMDA5YmU0ZjUxZWUzYjE5NzgwNzc5MTUzYzE4YTMwNTM4NmFlMDdmM2IzNmZjNzImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.7BE65HrdVzEEfqmNdpE3jEvzmECWCauH2sxx9s_z2lA">
> <img alt="image" width="603" src="https://private-user-images.githubusercontent.com/30209856/308090401-f5f868de-d2fa-4b3b-bda3-8febfcbdaec0.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDkxMTc5NDIsIm5iZiI6MTcwOTExNzY0MiwicGF0aCI6Ii8zMDIwOTg1Ni8zMDgwOTA0MDEtZjVmODY4ZGUtZDJmYS00YjNiLWJkYTMtOGZlYmZjYmRhZWMwLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDAyMjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwMjI4VDEwNTQwMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTRiM2JkNDZmNDJkZDI3MDE4YmRhZWFkNGUwOTQ4YzMwZTUyZTI4Mjk3OGIyOWFhMTliNDU2NjI3NDczNTJjMmMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.3feQZxBbY5_XxOxBd0_uh5CgsGgIECKeu_pHoYdm4Y0">
看这个图，子工作流逻辑节点已经成功了？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] task is waiting to excecuted for more than 12 hours and seems not to be overtimed [dolphinscheduler]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #15633: task is waiting to excecuted for more than 12 hours and seems not to be overtimed
URL: https://github.com/apache/dolphinscheduler/issues/15633
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org