[GitHub] gianm opened a new issue #6087: Synchronized segment allocation

[GitBox <gi...@apache.org>]

gianm opened a new issue #6087: Synchronized segment allocation
URL: https://github.com/apache/incubator-druid/issues/6087
 
 
   Today, when SegmentAllocateAction is run by multiple threads at once, it can end up doing a lot of internal retries due to its SELECT -> INSERT logic (see `allocatePendingSegment` in IndexerSQLMetadataStorageCoordinator). There isn't much point in running concurrent allocations for the same datasource anyway, and the contention causes retries which add delay due to sleeps. It might work better to synchronize allocations on a per-datasource basis, so only one can happen at a time per datasource.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org