You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/02/26 04:44:47 UTC
[GitHub] [druid] xianyinxin opened a new issue #9406: Kafka indexing task
pause forever.
xianyinxin opened a new issue #9406: Kafka indexing task pause forever.
URL: https://github.com/apache/druid/issues/9406
### Affected Version
0.14.2
### Description
We observed our the kafka index tasks run for hours (the task duration is 30min) and did not consume data from kafka even though there's data flows in kafka.
After some investigation, we found one task is actually oom, but it didn't exit. The other two tasks enter PAUSED state. The overlord continuously contacting the lost task, for hours:
```
2020-02-19T08:24:52,586 INFO [IndexTaskClient-thanos-1] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskClient - Still waiting for task [index_kafka_thanos_cb074a124e21226_ilohnejp] to change its status to [PAUSED]; will try again in [PT2S]
...
```
For details see the attached logs for overlord and tasks.
[log.zip](https://github.com/apache/druid/files/4253439/log.zip)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org