You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2021/10/06 14:10:00 UTC
[jira] [Updated] (HUDI-2484) Hive sync not working in HMS mode with
DeltaStreamer
[ https://issues.apache.org/jira/browse/HUDI-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinoth Chandar updated HUDI-2484:
---------------------------------
Labels: pull-request-available sev:critical user-support-issues (was: pull-request-available)
> Hive sync not working in HMS mode with DeltaStreamer
> ----------------------------------------------------
>
> Key: HUDI-2484
> URL: https://issues.apache.org/jira/browse/HUDI-2484
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Sagar Sumit
> Assignee: Sagar Sumit
> Priority: Major
> Labels: pull-request-available, sev:critical, user-support-issues
> Fix For: 0.10.0
>
>
> Set Hive sync mdoe to HMS and disable JDBC mode:
> ```
> --hoodie-conf hoodie.datasource.hive_sync.mode=hms
> --hoodie-conf hoodie.datasource.hive_sync.use_jdbc=false
> ```
> It throws the following exception:
> ```
> Caused by: java.lang.NoClassDefFoundError: org/apache/calcite/rel/type/RelDataTypeSystem
> at org.apache.hadoop.hive.ql.parse.SemanticAnalyzerFactory.get(SemanticAnalyzerFactory.java:318)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:484)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317)
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1457)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227)
> at org.apache.hudi.hive.ddl.HiveQueryDDLExecutor.updateHiveSQLs(HiveQueryDDLExecutor.java:94)
> at org.apache.hudi.hive.ddl.HiveQueryDDLExecutor.runSQL(HiveQueryDDLExecutor.java:85)
> at org.apache.hudi.hive.ddl.QueryBasedDDLExecutor.createTable(QueryBasedDDLExecutor.java:82)
> at org.apache.hudi.hive.HoodieHiveClient.createTable(HoodieHiveClient.java:191)
> at org.apache.hudi.hive.HiveSyncTool.syncSchema(HiveSyncTool.java:237)
> at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:182)
> at org.apache.hudi.hive.HiveSyncTool.doSync(HiveSyncTool.java:131)
> at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:117)
> at org.apache.hudi.utilities.deltastreamer.DeltaSync.syncHive(DeltaSync.java:625)
> ```
> The same works with Spark data source.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)