You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Rajesh Mahindra (Jira)" <ji...@apache.org> on 2022/02/01 04:31:00 UTC
[jira] [Updated] (HUDI-1295) Implement: Metadata based bloom index - write path
[ https://issues.apache.org/jira/browse/HUDI-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajesh Mahindra updated HUDI-1295:
----------------------------------
Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31 (was: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24)
> Implement: Metadata based bloom index - write path
> --------------------------------------------------
>
> Key: HUDI-1295
> URL: https://issues.apache.org/jira/browse/HUDI-1295
> Project: Apache Hudi
> Issue Type: Task
> Components: writer-core
> Affects Versions: 0.9.0
> Reporter: Vinoth Chandar
> Assignee: Manoj Govindassamy
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Idea here to maintain our bloom filters outside of parquet for speedier access from bloom.
>
> - Design and impl bloom filter migration to metadata table.
> Design:
> schema for the payload:
> key: partitionName_fileName
> payload schema:
> isDeleted (boolean): true/false
> bloom_type: short
> ser_bloom: byte[] representing serialized bloom filter.
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)