You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 04:32:51 UTC
[I] Implement: Metadata based bloom index - read path [hudi]
hudi-bot opened a new issue, #14910:
URL: https://github.com/apache/hudi/issues/14910
Metadata table based bloom index - read path implementation.
This involves all changes needed to the index lookup to look at the new bloom index maintained in the metadata table.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-2701
- Type: Improvement
- Fix version(s):
- 1.1.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Implement: Metadata based bloom index - read path [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #14910: Implement: Metadata based bloom index - read path
URL: https://github.com/apache/hudi/issues/14910
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Implement: Metadata based bloom index - read path [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #14910:
URL: https://github.com/apache/hudi/issues/14910#issuecomment-4795280873
This task appears to have been implemented in master. The metadata-table bloom index read path is in place:
- `SparkHoodieBloomIndexHelper` reads bloom filters from the MDT `bloom_filters` partition (uses `HoodieMetadataPayload.getBloomFilterIndexKey` + `MetadataPartitionType.BLOOM_FILTERS`).
- `HoodieMetadataBloomFilterProbingFunction` is the dedicated probing function for the read path.
- Behavior is controlled by `hoodie.bloom.index.use.metadata` (`HoodieIndexConfig.BLOOM_INDEX_USE_METADATA`).
Relevant commits: HUDI-1295 (#4352, initial implementation), HUDI-3807 (#5268, config gate), HUDI-5534 (#7642, lookup optimization). If there's still scope remaining under HUDI-2701, could the description be updated to capture what's left? Otherwise this can likely be closed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org