You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2019/03/29 20:30:53 UTC
[GitHub] [incubator-druid] leventov opened a new issue #7382:
BroadcastDistributionRules to load segments on whole tiers rather than
making server-by-server decisions
leventov opened a new issue #7382: BroadcastDistributionRules to load segments on whole tiers rather than making server-by-server decisions
URL: https://github.com/apache/incubator-druid/issues/7382
Broadcast rules which load segments on servers with colocated data sources (server-by-server decision) are very hard or impossible to implement correctly. I think the problems of non-atomic moves during balancing are underestimated.
When rules are loaded from the metadata store, Coordinator can figure out load rules for data sources and maps them to "colocated data sources", obtaining tiers on which broadcasted segments should be effectively loaded. Then it loads broadcasted segments on all servers in the needed tiers, as described here: https://github.com/apache/incubator-druid/pull/4077#issuecomment-293732924
FYI @jihoonson @gianm
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org