[GitHub] npawar opened a new pull request #3644: Split ValidationManager duties into separate ControllerPeriodicTasks

[GitBox <gi...@apache.org>]

npawar opened a new pull request #3644: Split ValidationManager duties into separate ControllerPeriodicTasks
URL: https://github.com/apache/incubator-pinot/pull/3644
 
 
   As discussed in issue https://github.com/apache/incubator-pinot/issues/3642 we want to be able to run realtime part of the validation manager much faster than all the other activities  in validation manager. 
   Splitting all the tasks of the ValidationManager into separate ControllerPeriodicTasks, so that we can better control the frequency of each one:
   1) OfflineSegmentIntervalChecker - to check for missing offline segments, can run daily by default
   2) RealtimeSegmentValidationManager - to fix partitions which have stopped consuming, can run hourly by default. Can be configured at the controller level to match realtime SLA of the cluster
   3) BrokerResourceValidationManager - to update broker on instance set changes

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org
For additional commands, e-mail: dev-help@pinot.apache.org