[GitHub] [druid] FrankChen021 commented on issue #11658: Infinite automatic Kafka offset resetting

[GitBox <gi...@apache.org>]

FrankChen021 commented on issue #11658:
URL: https://github.com/apache/druid/issues/11658#issuecomment-983199876


   @samarthjain Sorry, these two numbers are too long that I took the earliest as the larger one. In your case, I bet the latest offset is also less than your current offset. I have never encountered such problem at Kafka side if there's no change on this topic. 
   
   There's a scenario that I can come up with which would lead to such problem: after consuming the topic for a while, delete the topic and then re-create the topic, the log offset at Kafka side would go back to start from zero, which both earliest and latest offset are less than the offset used at the consumer side.
   
   So, for such case, I think we could check if the latest offset is also less than the current offset, if it, maybe we should reset the offset to the latest.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org