[GitHub] [pinot] yupeng9 commented on issue #7039: More control of realtime segments - topic partitions offsets

[GitBox <gi...@apache.org>]

yupeng9 commented on issue #7039:
URL: https://github.com/apache/pinot/issues/7039#issuecomment-947106174


   We also ran into this issue in some scenarios:
    - A topic is recreated and the offset needs to be reset
    - User needs to change the Kafka cluster of the topic, which has different offset mappings
   
   Currently the Kafka consumer in Pinot keeps resetting the offset, because the starting offset is determined by the previous segment. It'll be good to have a robust way to adapt the high/low watermark change on the topic.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org