You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2021/09/27 22:55:07 UTC

[GitHub] [pinot] chenboat opened a new issue #7491: Adding brokers to an existing tenant caused TableNotFound query exception

chenboat opened a new issue #7491:
URL: https://github.com/apache/pinot/issues/7491


   We tried to expand a broker tenant _A_ by adding the tenant tag _A_ to a few free brokers (via Controller UI). We observed that the new added brokers started to accept queries even though table re-assignment through Helix is still ongoing. This caused the broker to throw TableNotFound exceptions. This problem is particularly serious if the tenant has a lot of tables and queries. -- which means the Helix transition take longer time to finish. 
   
   The new added brokers should not start accepting queries until the table reassignment through Helix is done.    


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [pinot] Jackie-Jiang commented on issue #7491: Adding brokers to an existing tenant caused TableNotFound query exception

Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #7491:
URL: https://github.com/apache/pinot/issues/7491#issuecomment-937343881


   Correct. We should add a controller API to read the `BrokerResource` external view, and returns the broker list based on that.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [pinot] Jackie-Jiang commented on issue #7491: Adding brokers to an existing tenant caused TableNotFound query exception

Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #7491:
URL: https://github.com/apache/pinot/issues/7491#issuecomment-937343881


   Correct. We should add a controller API to read the `BrokerResource` external view, and returns the broker list based on that.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [pinot] chenboat commented on issue #7491: Adding brokers to an existing tenant caused TableNotFound query exception

Posted by GitBox <gi...@apache.org>.
chenboat commented on issue #7491:
URL: https://github.com/apache/pinot/issues/7491#issuecomment-934875663


   We use the following controller API 
   
   https://github.com/apache/pinot/blob/bb34406aaa205f5c85b88c928d477fd267eda1b4/pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTableInstances.java#L57
   
   to get the brokers instance of a table. This API gets the brokers based on the instance tag. It does not consider if the external view of the table is updated with the brokers. Instead a controller API should use the same way `DynamicBrokerSelector` discovers the live brokers based on the external view.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org