[GitHub] QiuMM opened a new pull request #6775: make thread pool size can be configured for loadqueuepeon

[GitBox <gi...@apache.org>]

QiuMM opened a new pull request #6775: make thread pool size can be configured for loadqueuepeon
URL: https://github.com/apache/incubator-druid/pull/6775
 
 
   In my scenario, the KIS tasks would produce thousands of segments at the end of every hour. It will take long time to load the segments, so I want to set the thread pool size for the `loadqueuepeon` to load/drop segments concurrently. 
   
   This PR also modified the CuratorLoadQueuePeon#processSegmentChangeRequest since several threads may enter this method and consider `currentlyProcessing == null` at the same moment.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org