[GitHub] [incubator-pinot] sunithabeeram opened a new pull request #3946: Make RetentionManager and OfflineSegmentIntervalChecker initial delays configurable

[GitBox <gi...@apache.org>]

sunithabeeram opened a new pull request #3946: Make RetentionManager and OfflineSegmentIntervalChecker initial delays configurable
URL: https://github.com/apache/incubator-pinot/pull/3946
 
 
   *Motivation*: In one of our clusters that hosts 1000's of tables with 1000's of segments each, we are noticing frequent controller leadership changes due to long GC pauses. Analysis shows that the GC pressure might be due to heavy hitting tasks running concurrently. RetentionManager and OfflineSegmentIntervalChecker tasks hold tables segment metadata in memory while working with tables and are likely to cause high GC pressure when run concurrently.  While the issue can be addressed in many ways, this change attempts a simpler/short-term fix to stagger the start time by making them configurable.
   
   *Testing done*: Existing tests pass. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org