You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/07/22 19:28:21 UTC
[GitHub] [pinot] Jackie-Jiang commented on issue #9091: LL Realtime ingestion may drop messages if the segment time threshold is crossed
Jackie-Jiang commented on issue #9091:
URL: https://github.com/apache/pinot/issues/9091#issuecomment-1192874026
@ddcprg This is great analysis!
The root cause is that some messages in the batch is skipped, so in order to fix it, we can introduce a boolean return to the `processStreamEvents()` method which indicates whether all the messages are processed (or whether the end criteria is reached), then decide how to process the offset.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org