[jira] [Commented] (HUDI-2757) Support AWS Glue API for metastore sync

["sivabalan narayanan (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481472#comment-17481472 ] 

sivabalan narayanan commented on HUDI-2757:
-------------------------------------------

copying a comment from user from github issue:

 

we're using EMR on EKS. We overwritten EMR Hudi jars from 0.8.0 to 0.10.0, then we can leverage hive sync tool and sync tables with Glue Data Catalog.
For this, you must pass the follow spark config:

{{spark.hadoop.hive.metastore.client.factory.class=com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory}}
For a new session, use
.enableHiveSupport()
 

> Support AWS Glue API for metastore sync
> ---------------------------------------
>
>                 Key: HUDI-2757
>                 URL: https://issues.apache.org/jira/browse/HUDI-2757
>             Project: Apache Hudi
>          Issue Type: New Feature
>          Components: hive
>            Reporter: Raymond Xu
>            Assignee: Rajesh Mahindra
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.11.0
>
>
> Raised in https://github.com/apache/hudi/issues/3954



--
This message was sent by Atlassian Jira
(v8.20.1#820001)