You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Manoj Govindassamy (Jira)" <ji...@apache.org> on 2021/11/02 08:42:00 UTC

[jira] [Updated] (HUDI-1295) Design and Impl bloom filters as a part of metadata table

     [ https://issues.apache.org/jira/browse/HUDI-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Manoj Govindassamy updated HUDI-1295:
-------------------------------------
    Status: Patch Available  (was: In Progress)

> Design and Impl bloom filters as a part of metadata table
> ---------------------------------------------------------
>
>                 Key: HUDI-1295
>                 URL: https://issues.apache.org/jira/browse/HUDI-1295
>             Project: Apache Hudi
>          Issue Type: Sub-task
>          Components: Writer Core
>    Affects Versions: 0.9.0
>            Reporter: Vinoth Chandar
>            Assignee: Manoj Govindassamy
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.10.0
>
>
> Idea here to maintain our bloom filters outside of parquet for speedier access from bloom.
>  
> - Design and impl bloom filter migration to metadata table. 
> Design:
> schema for the payload: 
> key: partitionName_fileName
> payload schema:
> isDeleted (boolean): true/false
> bloom_type: short
> ser_bloom: byte[] representing serialized bloom filter. 
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)