You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Yanjia Gary Li (Jira)" <ji...@apache.org> on 2020/06/09 19:38:00 UTC

[jira] [Assigned] (HUDI-610) Impala nea real time table support

     [ https://issues.apache.org/jira/browse/HUDI-610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yanjia Gary Li reassigned HUDI-610:
-----------------------------------

    Assignee:     (was: Yanjia Gary Li)

> Impala nea real time table support
> ----------------------------------
>
>                 Key: HUDI-610
>                 URL: https://issues.apache.org/jira/browse/HUDI-610
>             Project: Apache Hudi
>          Issue Type: New Feature
>            Reporter: Yanjia Gary Li
>            Priority: Major
>
> Impala uses the JAVA based module call "frontend" to list all the files to scan and let the C++ based "backend" to do all the file scanning. 
> Merge Avro and Parquet could be difficult because it might need to have a custom merging logic like RealtimeCompactedRecordReader to be implemented in backend using C++, but I think it will be doable to have something like RealtimeUnmergedRecordReader which only need some changes in the frontend. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)