[GitHub] npawar opened a new pull request #3668: Split validation manager tasks into separate periodic tasks

[GitBox <gi...@apache.org>]

npawar opened a new pull request #3668: Split validation manager tasks into separate periodic tasks
URL: https://github.com/apache/incubator-pinot/pull/3668
 
 
   
   
   Moving over from https://github.com/apache/incubator-pinot/pull/3644
   As discussed in issue #3642 we want to be able to run realtime part of the validation manager much faster than all the other activities in validation manager.
   Splitting all the tasks of the ValidationManager into separate ControllerPeriodicTasks, so that we can better control the frequency of each one:
   
   OfflineSegmentIntervalChecker - to check for missing offline segments, can run daily by default
   RealtimeSegmentValidationManager - to fix partitions which have stopped consuming, can run hourly by default. Can be configured at the controller level to match realtime SLA of the cluster
   BrokerResourceValidationManager - to update broker on instance set changes

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org
For additional commands, e-mail: dev-help@pinot.apache.org