[GitHub] [pinot] Jackie-Jiang commented on issue #8469: [Feature request] Notify when a new OFFLINE segment is query-able

[GitBox <gi...@apache.org>]

Jackie-Jiang commented on issue #8469:
URL: https://github.com/apache/pinot/issues/8469#issuecomment-1090601570

   In order to know if a new segment is ready for query, the information should come from the broker. Here is the steps of new segment becoming queryable:
   1. Segment uploaded to the deep store via controller (or metadata push)
   2. Server gets notified to download and load the segment
   3. Controller collects server status and updates table's external view
   4. Broker listens to the external view change and includes the query into the routing. The segment is queryable only when it is loaded on an enabled server that is not disabled for routing.
   
   Do you think it can solve the problem if we add an API to the broker to return if the given segment is ready for query (and all queryable segments for a given table)? We may also add the API to the controller to be redirected to the broker


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org