You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/01/11 01:52:00 UTC

[jira] [Assigned] (HUDI-3206) Unify Hive's MOR `InputFormat` implementations (Parquet, HFile)

     [ https://issues.apache.org/jira/browse/HUDI-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Kudinkin reassigned HUDI-3206:
-------------------------------------

    Assignee: Alexey Kudinkin

> Unify Hive's MOR `InputFormat` implementations (Parquet, HFile)
> ---------------------------------------------------------------
>
>                 Key: HUDI-3206
>                 URL: https://issues.apache.org/jira/browse/HUDI-3206
>             Project: Apache Hudi
>          Issue Type: Sub-task
>            Reporter: Alexey Kudinkin
>            Assignee: Alexey Kudinkin
>            Priority: Major
>
> Essentially, HIve's different MOR implementations should only differ in the file-format of the actual base-files written. 
>  
> Today, that's not the case: currently Hive's MOR `InputFormat` implementations inherit from their respective COW file-format counterparts (
> `HoodieParquetInputFormat`, `HoodieHFileInputFormat`).
>  
> Instead we should unify both MOR impls to have common base class, which separate file-format specific impls would extend (Parquet, HFile), only overriding the `getRecordReader` method



--
This message was sent by Atlassian Jira
(v8.20.1#820001)