[GitHub] [incubator-pinot] sunithabeeram commented on issue #4007: Improve/Add completeness and freshness metrics for Pinot

[GitBox <gi...@apache.org>]

sunithabeeram commented on issue #4007: Improve/Add completeness and freshness metrics for Pinot
URL: https://github.com/apache/incubator-pinot/issues/4007#issuecomment-475688738
 
 
   https://github.com/apache/incubator-pinot/pull/3942 tracks Completeness (a) part of the issue. Note the following caveats:
   - There is a legitimate case where the servers may not have segments available - this happens during retention. We don't consider to be a serving error. The change makes a best effort attempt to track recently deleted segments using an in-memory cache. This does mean that on server restarts the segments retained out segments can be marked as missing.
   - When segments move or get refreshed with explicit state transitions (ie, an online->offline transition is triggered followed by a offline->online transition), and the query reaches a server after the online->offline transition), the server won't have the segment and we will count them as partial responses.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org