You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2020/01/04 01:01:05 UTC

[GitHub] [incubator-pinot] Jackie-Jiang opened a new issue #4958: Decouple segment selection/pruning from routing table builder

Jackie-Jiang opened a new issue #4958: Decouple segment selection/pruning from routing table builder
URL: https://github.com/apache/incubator-pinot/issues/4958
 
 
   On broker side, in order to route the query to the correct servers, broker needs to do the following steps:
   - Select segments for the table (e.g. select only HLC or LLC segments; select merged segments)
   - Prune segments (e.g. partitioning)
   - Choose servers for the segments (e.g. evenly distribute the segments; replica-group)
   
   Currently, routing table builder is handling all these steps, which is making it hard to add new features, and support certain scenarios (partitioning is coupled with replica-group routing).
   We should decouple all these steps to make future broker enhancement easier (e.g. handle single server failure etc.)

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #4958: Decouple segment selection/pruning from routing table builder

Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #4958: Decouple segment selection/pruning from routing table builder
URL: https://github.com/apache/incubator-pinot/issues/4958#issuecomment-589800312
 
 
   Implementation: #5046 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #4958: Decouple segment selection/pruning from routing table builder

Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #4958: Decouple segment selection/pruning from routing table builder
URL: https://github.com/apache/incubator-pinot/issues/4958#issuecomment-589800536
 
 
   Plug in the implementation: #5082 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] Jackie-Jiang closed issue #4958: Decouple segment selection/pruning from routing table builder

Posted by GitBox <gi...@apache.org>.
Jackie-Jiang closed issue #4958: Decouple segment selection/pruning from routing table builder
URL: https://github.com/apache/incubator-pinot/issues/4958
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] Jackie-Jiang commented on issue #4958: Decouple segment selection/pruning from routing table builder

Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #4958: Decouple segment selection/pruning from routing table builder
URL: https://github.com/apache/incubator-pinot/issues/4958#issuecomment-592240066
 
 
   Clean up the old implementation: #5101 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org