You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Yanjia Gary Li (Jira)" <ji...@apache.org> on 2020/06/09 19:39:00 UTC

[jira] [Updated] (HUDI-610) MOR table Impala read support

     [ https://issues.apache.org/jira/browse/HUDI-610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yanjia Gary Li updated HUDI-610:
--------------------------------
    Summary: MOR table Impala read support  (was: Impala nea real time table support)

> MOR table Impala read support
> -----------------------------
>
>                 Key: HUDI-610
>                 URL: https://issues.apache.org/jira/browse/HUDI-610
>             Project: Apache Hudi
>          Issue Type: New Feature
>            Reporter: Yanjia Gary Li
>            Priority: Major
>
> Impala uses the JAVA based module call "frontend" to list all the files to scan and let the C++ based "backend" to do all the file scanning. 
> Merge Avro and Parquet could be difficult because it might need to have a custom merging logic like RealtimeCompactedRecordReader to be implemented in backend using C++, but I think it will be doable to have something like RealtimeUnmergedRecordReader which only need some changes in the frontend. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)