You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2021/03/11 10:24:03 UTC
[GitHub] [druid] iercan opened a new issue #10981: Kafka datasource kill task waits indefinitely
iercan opened a new issue #10981:
URL: https://github.com/apache/druid/issues/10981
I've created a kafka supervisor which create ingestion task per hour. When I create a kill task it stays wait state even if supervisor change to new task
In the picture supervisor creates task at 8:35. I finished at 9:35 and I'd expect kill task take place but it still can not start and new ingestion task start. As a result kill task wait forever. How can I overcome this?
### Affected Version
Druid version: 0.20.1
### Description
I see below log in overlord. Looks like it is a priority issue but couldn't figure out how to resolve.
```
2021-03-11T08:01:13,810 INFO [TaskQueue-Manager] org.apache.druid.indexing.overlord.TaskLockbox - Cannot create a new taskLockPosse for request..... taskIds=[....]}]] have same or higher priorities
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] FrankChen021 commented on issue #10981: Kafka datasource kill task waits indefinitely
Posted by GitBox <gi...@apache.org>.
FrankChen021 commented on issue #10981:
URL: https://github.com/apache/druid/issues/10981#issuecomment-796696640
Look at [this](https://druid.apache.org/docs/latest/tutorials/tutorial-delete-data.html#run-a-kill-task)
The request body looks like
```
{
"type": "kill",
"dataSource": "your-data-source-name",
"interval" : "2015-09-12/2015-09-13"
}
```
The range of interval should not include the intervals of running ingestion tasks, or the kill task would wait ingestion tasks to complete.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] iercan commented on issue #10981: Kafka datasource kill task waits indefinitely
Posted by GitBox <gi...@apache.org>.
iercan commented on issue #10981:
URL: https://github.com/apache/druid/issues/10981#issuecomment-796690081
@FrankChen021 How to set interval? I'd appreciated if you can explain in details
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] FrankChen021 commented on issue #10981: Kafka datasource kill task waits indefinitely
Posted by GitBox <gi...@apache.org>.
FrankChen021 commented on issue #10981:
URL: https://github.com/apache/druid/issues/10981#issuecomment-796664713
It seems it's the same problem as #10508. One solution is to cancel the kill task and issue a kill task manually through HTTP interface by limiting the interval parameter.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] iercan commented on issue #10981: Kafka datasource kill task waits indefinitely
Posted by GitBox <gi...@apache.org>.
iercan commented on issue #10981:
URL: https://github.com/apache/druid/issues/10981#issuecomment-796730481
@FrankChen021 I resolved issue by increasing start delay of tasks managed by supervisor. So that kill task can have a time to start
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] iercan closed issue #10981: Kafka datasource kill task waits indefinitely
Posted by GitBox <gi...@apache.org>.
iercan closed issue #10981:
URL: https://github.com/apache/druid/issues/10981
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org