You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Rajesh Mahindra (Jira)" <ji...@apache.org> on 2022/02/01 04:31:00 UTC

[jira] [Updated] (HUDI-1295) Implement: Metadata based bloom index - write path

     [ https://issues.apache.org/jira/browse/HUDI-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rajesh Mahindra updated HUDI-1295:
----------------------------------
    Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31  (was: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24)

> Implement: Metadata based bloom index - write path
> --------------------------------------------------
>
>                 Key: HUDI-1295
>                 URL: https://issues.apache.org/jira/browse/HUDI-1295
>             Project: Apache Hudi
>          Issue Type: Task
>          Components: writer-core
>    Affects Versions: 0.9.0
>            Reporter: Vinoth Chandar
>            Assignee: Manoj Govindassamy
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.11.0
>
>
> Idea here to maintain our bloom filters outside of parquet for speedier access from bloom.
>  
> - Design and impl bloom filter migration to metadata table. 
> Design:
> schema for the payload: 
> key: partitionName_fileName
> payload schema:
> isDeleted (boolean): true/false
> bloom_type: short
> ser_bloom: byte[] representing serialized bloom filter. 
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)