You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2020/08/05 04:20:00 UTC
[jira] [Updated] (HUDI-841) Abstract common meta sync module
support multiple meta service
[ https://issues.apache.org/jira/browse/HUDI-841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinoth Chandar updated HUDI-841:
--------------------------------
Status: In Progress (was: Open)
> Abstract common meta sync module support multiple meta service
> --------------------------------------------------------------
>
> Key: HUDI-841
> URL: https://issues.apache.org/jira/browse/HUDI-841
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Hive Integration
> Reporter: liwei
> Assignee: liwei
> Priority: Blocker
> Fix For: 0.6.0
>
>
> Currently Hudi only supports sync dataset metadata to Hive through hive jdbc and IMetaStoreClient. When you need to sync to other frameworks, such as aws glue, aliyun DataLake analytics, etc. You need to copy a lot of code from HoodieHiveClient, which creates a lot of redundant code. So need to redesign the hudi-hive-sync module to support other frameworks and reuse current code as much as possible. Only the interface is provided by Hudi, and the implement is customized by different services as hive 、aws glue、aliyun DataLake analytics.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)