You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/08/04 11:33:05 UTC
[GitHub] [dolphinscheduler] Quan-HS opened a new issue, #11302: [Bug] [Master] Lots of wrong tasks「 failedDispatchTasks 」put 「taskPriorityQueue」，cause normal tasks cannot be distributed
Quan-HS opened a new issue, #11302:
URL: https://github.com/apache/dolphinscheduler/issues/11302
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
in this file 「TaskPriorityQueueConsumer」，there are lots of wrong tasks when task dispatch failed,if let those task「 failedDispatchTasks 」put「taskPriorityQueue」，cause normal tasks cannot be distributed.
### What you expected to happen
1. It doesn't matter what the priority of the task is, 「the task is tens of thousands of times larger」, it will happen
2. This is not valid，use level , fail count or Set a larger retry interval，Because the failed task will do a lot of invalid computations in the case of a large number of tasks，normal tasks are still not being distributed, It still creates a backlog
### How to reproduce
maybe we need handle the failed task separately, new queue, new thread.Retry the forced stop multiple times and wait for user confirmation
### Anything else
You are the best.
### Version
3.0.0-beta-2
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] closed issue #11302: [Bug] [Master] Lots of wrong tasks「 failedDispatchTasks 」put 「taskPriorityQueue」，cause normal tasks cannot be distributed
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #11302: [Bug] [Master] Lots of wrong tasks「 failedDispatchTasks 」put 「taskPriorityQueue」，cause normal tasks cannot be distributed
URL: https://github.com/apache/dolphinscheduler/issues/11302
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] SbloodyS commented on issue #11302: [Bug] [Master] Lots of wrong tasks「 failedDispatchTasks 」put 「taskPriorityQueue」，cause normal tasks cannot be distributed
Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #11302:
URL: https://github.com/apache/dolphinscheduler/issues/11302#issuecomment-1205938948
cc @caishunfeng @ruanwenjun
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #11302: [Bug] [Master] Lots of wrong tasks「 failedDispatchTasks 」put 「taskPriorityQueue」，cause normal tasks cannot be distributed
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #11302:
URL: https://github.com/apache/dolphinscheduler/issues/11302#issuecomment-1246083866
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #11302: [Bug] [Master] Lots of wrong tasks「 failedDispatchTasks 」put 「taskPriorityQueue」，cause normal tasks cannot be distributed
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #11302:
URL: https://github.com/apache/dolphinscheduler/issues/11302#issuecomment-1236447452
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #11302: [Bug] [Master] Lots of wrong tasks「 failedDispatchTasks 」put 「taskPriorityQueue」，cause normal tasks cannot be distributed
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #11302:
URL: https://github.com/apache/dolphinscheduler/issues/11302#issuecomment-1205142740
Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
* In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
* If you haven't received a reply for a long time, you can [join our slack](https://s.apache.org/dolphinscheduler-slack) and send your question to channel `#troubleshooting`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org