You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "egalpin (via GitHub)" <gi...@apache.org> on 2023/06/28 23:26:34 UTC
[GitHub] [pinot] egalpin opened a new issue, #10998: Block-level, intra-segment bloom filters
egalpin opened a new issue, #10998:
URL: https://github.com/apache/pinot/issues/10998
This idea is not mine, but rather was mentioned by @npawar during the '22 RTA Summit video covering Tiered Storage[1]. The context in the video was using block-level bloom filters to enable loading of blocks in parallel / knowing which blocks would (likely) contain the sought after data.
Has this idea been explored for "local" pinot as well (coupled compute and storage), or would its overhead not provide query processing speed improvements?
[1] https://www.youtube.com/watch?v=nEAvHAvh0tY
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] egalpin closed issue #10998: Block-level, intra-segment bloom filters
Posted by "egalpin (via GitHub)" <gi...@apache.org>.
egalpin closed issue #10998: Block-level, intra-segment bloom filters
URL: https://github.com/apache/pinot/issues/10998
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang commented on issue #10998: Block-level, intra-segment bloom filters
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang commented on issue #10998:
URL: https://github.com/apache/pinot/issues/10998#issuecomment-1614255698
cc @klsince
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] klsince commented on issue #10998: Block-level, intra-segment bloom filters
Posted by "klsince (via GitHub)" <gi...@apache.org>.
klsince commented on issue #10998:
URL: https://github.com/apache/pinot/issues/10998#issuecomment-1614669230
Yes. This idea has been implemented as sparse index, an extension available in StarTree Pinot: https://dev.startree.ai/docs/startree-extensions/sparse-index for more details. It works well with both “local” and “remote”, particularly for columns with very high cardinality.
Loop in @gortiz the author of this feature to shed more light if needed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] egalpin commented on issue #10998: Block-level, intra-segment bloom filters
Posted by "egalpin (via GitHub)" <gi...@apache.org>.
egalpin commented on issue #10998:
URL: https://github.com/apache/pinot/issues/10998#issuecomment-1614872611
Thanks all 👍 I'll close this issue out so it doesn't appear as outstanding work etc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org