You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by "kaisun2000 (via GitHub)" <gi...@apache.org> on 2023/05/25 22:58:22 UTC
[GitHub] [druid] kaisun2000 opened a new issue, #14344: Kafka ingest task with the "OffsetOutOfRangeException with message" would still succeeds.
kaisun2000 opened a new issue, #14344:
URL: https://github.com/apache/druid/issues/14344
Kafka ingestion task has the following warning:
`
2023-05-25T20:47:11,184 WARN [task-runner-0-priority-0] org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner - OffsetOutOfRangeException with message [Fetch position FetchPosition{offset=4791341818, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[...
`
This seems to signify the Kafka client can't locate data in the Kafka server side. The data is lost in the Kafka server either due to out of retention or server operation issues. This error is not recoverable from the Kafka ingestion task perspective.
We should instead fail the task or at least give some signal in the metrics?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
Re: [I] Kafka ingest task with the "OffsetOutOfRangeException with message" would still succeeds. (druid)
Posted by "sc-sityad (via GitHub)" <gi...@apache.org>.
sc-sityad commented on issue #14344:
URL: https://github.com/apache/druid/issues/14344#issuecomment-2063490550
@Vivek-Kalola @kaisun2000 Any solution on above queries, facing the same issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
Re: [I] Kafka ingest task with the "OffsetOutOfRangeException with message" would still succeeds. (druid)
Posted by "Vivek-Kalola (via GitHub)" <gi...@apache.org>.
Vivek-Kalola commented on issue #14344:
URL: https://github.com/apache/druid/issues/14344#issuecomment-1862118686
Facing a similar issue, any fix on this?
`WARN [task-runner-0-priority-0] org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner - OffsetOutOfRangeException with message [Fetch position FetchPosition{offset=3192, offsetEpoch=Optional.empty, currentLeader=LeaderAndEpoch{leader=Optional[REVDAU-LTP031:9092 (id: 0 rack: null)], epoch=0}} is out of range for partition snmp_interface-0]`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org