You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2021/06/01 21:45:45 UTC

[GitHub] [incubator-pinot] GSharayu opened a new issue #7005: Support IN operator in BloomFilter based segment pruner

GSharayu opened a new issue #7005:
URL: https://github.com/apache/incubator-pinot/issues/7005


   Server side segment pruning is currently supported for =, RANGE,IN filter operators using min-max value stats (segment metadata). Similarly, bloom filter is also used for = filter. 
   
   For IN filter operator, we should add support for bloom filter based pruning if the number of values in the IN clause are below a certain threshold. 
   
   Adding this support for large number of values in IN clause won't be helpful as the pruning may not happen (since values are likely to be spread across several segments) and the time to prune itself may negate the benefits.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] siddharthteotia closed issue #7005: Support IN operator in BloomFilter based segment pruner

Posted by GitBox <gi...@apache.org>.
siddharthteotia closed issue #7005:
URL: https://github.com/apache/incubator-pinot/issues/7005


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] siddharthteotia commented on issue #7005: Support IN operator in BloomFilter based segment pruner

Posted by GitBox <gi...@apache.org>.
siddharthteotia commented on issue #7005:
URL: https://github.com/apache/incubator-pinot/issues/7005#issuecomment-853491171


   Support added in PR https://github.com/apache/incubator-pinot/pull/7007


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] siddharthteotia commented on issue #7005: Support IN operator in BloomFilter based segment pruner

Posted by GitBox <gi...@apache.org>.
siddharthteotia commented on issue #7005:
URL: https://github.com/apache/incubator-pinot/issues/7005#issuecomment-853491171


   Support added in PR https://github.com/apache/incubator-pinot/pull/7007


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org


[GitHub] [incubator-pinot] siddharthteotia closed issue #7005: Support IN operator in BloomFilter based segment pruner

Posted by GitBox <gi...@apache.org>.
siddharthteotia closed issue #7005:
URL: https://github.com/apache/incubator-pinot/issues/7005


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org