You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Manoj Govindassamy (Jira)" <ji...@apache.org> on 2021/11/02 08:42:00 UTC
[jira] [Updated] (HUDI-1295) Design and Impl bloom filters as a
part of metadata table
[ https://issues.apache.org/jira/browse/HUDI-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Manoj Govindassamy updated HUDI-1295:
-------------------------------------
Status: Patch Available (was: In Progress)
> Design and Impl bloom filters as a part of metadata table
> ---------------------------------------------------------
>
> Key: HUDI-1295
> URL: https://issues.apache.org/jira/browse/HUDI-1295
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Writer Core
> Affects Versions: 0.9.0
> Reporter: Vinoth Chandar
> Assignee: Manoj Govindassamy
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.10.0
>
>
> Idea here to maintain our bloom filters outside of parquet for speedier access from bloom.
>
> - Design and impl bloom filter migration to metadata table.
> Design:
> schema for the payload:
> key: partitionName_fileName
> payload schema:
> isDeleted (boolean): true/false
> bloom_type: short
> ser_bloom: byte[] representing serialized bloom filter.
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)