You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2022/12/28 09:22:34 UTC
[GitHub] [doris] spaces-X opened a new issue, #15446: [Bug] spark load push tasks are not cleaned up when timeout aborted
spaces-X opened a new issue, #15446:
URL: https://github.com/apache/doris/issues/15446
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
From 0.13 to the newest
### What's Wrong?
When the transaction of spark load is timeout and aborted, the push tasks are not cleaned up and alway kept in AgentTaskQueue.
This will cause useless push tasks are always scheduled in BE.
### What You Expected?
Clear spark load job, when spark load's transaction is timeout and aborted.
### How to Reproduce?
1. set `spark_load_default_timeout_second` to 60s
2. start a heavy spark load job, which exceeds 60s
3. wait for transaction timeout and abort
4. find out whether the push tasks of the aborted job are still kept in BE
### Anything Else?
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] wangbo closed issue #15446: [Bug] sparkload push tasks are not cleaned up when txn timeout aborted
Posted by GitBox <gi...@apache.org>.
wangbo closed issue #15446: [Bug] sparkload push tasks are not cleaned up when txn timeout aborted
URL: https://github.com/apache/doris/issues/15446
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org