You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/10/13 04:23:34 UTC
[GitHub] [druid] FrankChen021 opened a new issue #10508: Kill task launched from web console is stuck
FrankChen021 opened a new issue #10508:
URL: https://github.com/apache/druid/issues/10508
### Affected Version
It's been verified on 0.16 and 0.19, and I think 0.17 and 0.18 are also affected.
### Description
Steps to reproduce this problem:
1. start a realtime ingestion task for one data source
2. issue a kill task for the same data source through menu item "Delete unused segments" on the web-console UI
The kill task is created successfully but its status is always WAITING even after the ingestion task for current segment completes and a new ingestion task starts for another new segment.
From the image above, we can see:
1. ingestion task started at 02:55
2. kill task started at 02:26
3. an hour(segment granularity) later, ingestion task finished at about 03:55, and a new task started at 03:55
There's no chance for the kill task to be scheduled, and its status is always WAITING.
### Analysis
When launching a kill-task from web console, a kill-task request with `interval` ranging from year 1000 to year 3000 is sent to druid backend service. While there's a running ingestion task which holds time chunk lock, this kill request couldn't obtain the time chunk lock because the given interval is too large.
To solve this, I think there're two ways to solve it as follows, both of which requires some modifications on web console
1. do it as the way 'Mark as unused segment by interval' does, ask for a given interval from user instead of using year 3000 as the end interval
or
2. set `forceTimeChunkLock` of `context` parameter to `false` in the kill task request
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] remizyaka commented on issue #10508: Kill task launched from web console is stuck
Posted by GitBox <gi...@apache.org>.
remizyaka commented on issue #10508:
URL: https://github.com/apache/druid/issues/10508#issuecomment-742738605
You can always suspend supervisor, wait till kill task finished and after that - resume supervisor.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] FrankChen021 commented on issue #10508: Kill task launched from web console is stuck
Posted by GitBox <gi...@apache.org>.
FrankChen021 commented on issue #10508:
URL: https://github.com/apache/druid/issues/10508#issuecomment-796665673
I almost forgot this problem. @remizyaka I think it's not a solution in production because suspending supervisors would cause index tasks to stop.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] FrankChen021 commented on issue #10508: Kill task launched from web console is stuck
Posted by GitBox <gi...@apache.org>.
FrankChen021 commented on issue #10508:
URL: https://github.com/apache/druid/issues/10508#issuecomment-707477770
@jihoonson @vogievetsky what do you think about it ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org