You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2022/01/04 04:16:00 UTC
[jira] [Updated] (HUDI-1295) Implement: Metadata based bloom index - write path
[ https://issues.apache.org/jira/browse/HUDI-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinoth Chandar updated HUDI-1295:
---------------------------------
Sprint: Hudi-Sprint-Jan-3
> Implement: Metadata based bloom index - write path
> --------------------------------------------------
>
> Key: HUDI-1295
> URL: https://issues.apache.org/jira/browse/HUDI-1295
> Project: Apache Hudi
> Issue Type: Task
> Components: Writer Core
> Affects Versions: 0.9.0
> Reporter: Vinoth Chandar
> Assignee: Manoj Govindassamy
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.11.0
>
>
> Idea here to maintain our bloom filters outside of parquet for speedier access from bloom.
>
> - Design and impl bloom filter migration to metadata table.
> Design:
> schema for the payload:
> key: partitionName_fileName
> payload schema:
> isDeleted (boolean): true/false
> bloom_type: short
> ser_bloom: byte[] representing serialized bloom filter.
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)