You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 03:26:36 UTC
[I] [Umbrella] Record level, global low-latency index implementation [hudi]
hudi-bot opened a new issue, #14516:
URL: https://github.com/apache/hudi/issues/14516
Improve record indexing using record -> partitionpath, fileId look up.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-466
- Type: Epic
- Fix version(s):
- 1.1.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Umbrella] Record level, global low-latency index implementation [hudi]
Posted by "deepakpanda93 (via GitHub)" <gi...@apache.org>.
deepakpanda93 commented on issue #14516:
URL: https://github.com/apache/hudi/issues/14516#issuecomment-5255662549
This issue was reviewed as part of the JIRA-migrated backlog triage.
Findings: this umbrella was delivered as the **Record Level Index**, shipped in **0.14.0**. The ask here — "improve record indexing using record -> partitionpath, fileId look up" — is exactly what RLI implements (see [RFC-8: Metadata based record index](https://github.com/apache/hudi/blob/master/rfc/rfc-8/rfc-8.md#rfc-8-metadata-based-record-index)).
Evidence:
- `MetadataPartitionType.RECORD_INDEX` is present at the `release-0.14.0` tag (`hudi-common/.../metadata/MetadataPartitionType.java:31`), alongside `FILES`, `COLUMN_STATS` and `BLOOM_FILTERS`.
- The enabling config `hoodie.metadata.record.index.enable` (today aliased by `hoodie.metadata.global.record.level.index.enable`, `HoodieMetadataConfig.java:362-368`) is annotated `sinceVersion("0.14.0")`.
- The 0.14.0 release notes list *Record Level Index* under Release Highlights.
It has continued to be extended since — async-indexer support (#9517), SQL equality-query pushdown (#9308), and index-definition support (#13741) — and the partition type is still live on `master`.
If any specific sub-capability of this umbrella is still missing, please open a scoped ticket for it rather than reopening the umbrella.
Closing as fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Umbrella] Record level, global low-latency index implementation [hudi]
Posted by "deepakpanda93 (via GitHub)" <gi...@apache.org>.
deepakpanda93 closed issue #14516: [Umbrella] Record level, global low-latency index implementation
URL: https://github.com/apache/hudi/issues/14516
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org