You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "liwei (Jira)" <ji...@apache.org> on 2020/04/27 11:27:00 UTC

[jira] [Created] (HUDI-841) abstract common meta sync module support multiple meta service

liwei created HUDI-841:
--------------------------

             Summary: abstract common meta sync module support multiple meta service
                 Key: HUDI-841
                 URL: https://issues.apache.org/jira/browse/HUDI-841
             Project: Apache Hudi (incubating)
          Issue Type: Improvement
          Components: Hive Integration
            Reporter: liwei
            Assignee: liwei


Currently Hudi only supports sync dataset metadata to Hive through hive jdbc and IMetaStoreClient. When you need to sync to other frameworks, such as aws glue, aliyun DataLake analytics, etc. You need to copy a lot of code from HoodieHiveClient, which creates a lot of redundant code. So need to redesign the hudi-hive-sync module to support other frameworks and reuse current code as much as possible. Only the interface is provided by Hudi, and the implement is customized by different services as hive 、aws glue、aliyun DataLake analytics.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)