You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/07/16 13:29:35 UTC

[GitHub] [hudi] MikelDelTio commented on issue #2688: [SUPPORT] Sync to Hive using Metastore

MikelDelTio commented on issue #2688:
URL: https://github.com/apache/hudi/issues/2688#issuecomment-881451261


   Same problem here using emr-6.3.0 and hudi 0.7.0.
   
   Spark Session:
   ```
   spark = (
       SparkSession.builder.appName(spark_application_name)
       .enableHiveSupport()
       .getOrCreate()
   )
   ```
   
   Stacktrace:
   ```
   py4j.protocol.Py4JJavaError: An error occurred while calling o103.save.
   : java.lang.NoSuchMethodError: org.apache.hadoop.hive.ql.Driver.close()V
           at org.apache.hudi.hive.HoodieHiveClient.updateHiveSQLs(HoodieHiveClient.java:417)
           at org.apache.hudi.hive.HoodieHiveClient.updateHiveSQLUsingHiveDriver(HoodieHiveClient.java:384)
           at org.apache.hudi.hive.HoodieHiveClient.updateHiveSQL(HoodieHiveClient.java:374)
           at org.apache.hudi.hive.HoodieHiveClient.createTable(HoodieHiveClient.java:263)
           at org.apache.hudi.hive.HiveSyncTool.syncSchema(HiveSyncTool.java:181)
           at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:136)
           at org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:94)
           at org.apache.hudi.HoodieSparkSqlWriter$.syncHive(HoodieSparkSqlWriter.scala:355)
   ```
   
   Any recommendation? Thank you.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org