[GitHub] [incubator-pinot] fx19880617 commented on issue #6637: Kafka ingestion: Allow users to reset the offset to consume

[GitBox <gi...@apache.org>]

fx19880617 commented on issue #6637:
URL: https://github.com/apache/incubator-pinot/issues/6637#issuecomment-790210491


   Agreed with the first approach. Approach two assumes that the bad data are coming in normal traffic load, we observed sometimes that upstream data producers may dump a lot of data due to error, so the skipping option can handle both cases.
   
   In my view, this API should take a map of Kafka topic partitions to offsets mapping(no need for all the partitions), then seal all related partition segments then create new segments using the given start offsets.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org