You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/05/02 21:05:59 UTC

[GitHub] [incubator-hudi] WTa-hash edited a comment on issue #1581: [SUPPORT] Hive Metastore not in sync with Hudi Dataset using DataSource API

WTa-hash edited a comment on issue #1581:
URL: https://github.com/apache/incubator-hudi/issues/1581#issuecomment-623013007


   [log_INITIAL.log](https://github.com/apache/incubator-hudi/files/4568939/log_INITIAL.log)
   [log_CDC.log](https://github.com/apache/incubator-hudi/files/4568940/log_CDC.log)
   
   @bvaradar - I have attached 2 log files.
   log_INITIAL.log - this is the creation of a new Hudi Dataset. The Hive table looks correct.
   log_CDC.log - this is the processing of changed data (including schema changes = new column). The Hive table is not updated.
   
   For log_CDC.log, I do see an error:
   `org.apache.hudi.hive.HoodieHiveSyncException: Failed in executing SQL ALTER TABLE...`
   
   I'm not sure why going with DataSource API, it fails to sync the hive table properly, but DeltaStreamer is able to sync properly.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org