You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "dang-stripe (via GitHub)" <gi...@apache.org> on 2026/04/14 23:29:41 UTC
[I] [multistage] support broker segment pruning [pinot]
dang-stripe opened a new issue, #18201:
URL: https://github.com/apache/pinot/issues/18201
The default MSE query planner does not support [broker-side segment pruning](https://docs.pinot.apache.org/operate-pinot/tuning/segment-pruning) today. The physical optimizer (v2 planner) does support it, but it does not have full feature parity with MSE yet (https://github.com/apache/pinot/issues/15455).
We've noticed if one server becomes unhealthy through a gray failure, it can affect nearly all queries on the tenant since they fan out to all servers. Having pinot automatically route around unhealthy servers is being dealt with in https://github.com/apache/pinot/issues/16253, but ideal the query planner also avoids querying servers unnecessarily.
cc @Jackie-Jiang @yashmayya
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] [multistage] support broker segment pruning [pinot]
Posted by "yashmayya (via GitHub)" <gi...@apache.org>.
yashmayya closed issue #18201: [multistage] support broker segment pruning
URL: https://github.com/apache/pinot/issues/18201
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] [multistage] support broker segment pruning [pinot]
Posted by "dang-stripe (via GitHub)" <gi...@apache.org>.
dang-stripe commented on issue #18201:
URL: https://github.com/apache/pinot/issues/18201#issuecomment-4247992890
We're testing a change internally for the non-partitioned path taking a similar approach to https://github.com/apache/pinot/blob/master/pinot-query-planner/src/main/java/org/apache/pinot/query/planner/logical/LeafStageToPinotQuery.java. We'll upstream once we validate it for correctness + performance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] [multistage] support broker segment pruning [pinot]
Posted by "yashmayya (via GitHub)" <gi...@apache.org>.
yashmayya commented on issue #18201:
URL: https://github.com/apache/pinot/issues/18201#issuecomment-4985728382
@timothy-e we still don't support broker pruning for colocated join cases (that would necessitate much broader changes than the ones we had to make to simply support partitioned leaf stage cases), so I'd keep this one open for now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] [multistage] support broker segment pruning [pinot]
Posted by "timothy-e (via GitHub)" <gi...@apache.org>.
timothy-e commented on issue #18201:
URL: https://github.com/apache/pinot/issues/18201#issuecomment-4985274151
@yashmayya do you think we're good to close this ticket?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org