You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/05/19 20:00:35 UTC

[GitHub] [hudi] vicuna96 commented on issue #5582: [SUPPORT] NullPointerException in merge into Spark Sql HoodieSparkSqlWriter$.mergeParamsAndGetHoodieConfig

vicuna96 commented on issue #5582:
URL: https://github.com/apache/hudi/issues/5582#issuecomment-1132142632

   Hi team, just to update - it looks like this hms table create may not be updating fields such as `primaryKey`, `type`, `preCombineField` as they are optional. I'm assuming we need to specify them in the spark-sql environment itself during execution?
   
   ```
   spark.sql("show create table testing.test_hudi_hive_sync").show(false)
   
   CREATE TABLE `testing`.`test_hudi_hive_sync` (`_hoodie_commit_time` STRING, `_hoodie_commit_seqno` STRING, `_hoodie_record_key` STRING, `_hoodie_partition_path` STRING, `_hoodie_file_name` STRING, `KEY1` INT, `KEY2` STRING, `PROCESSING_TS` TIMESTAMP, `PARTITION_DT` DATE)
   USING hudi
   OPTIONS (
     `serialization.format` '1',
     path 'gs://my_hudi_bucket/staging_zone/WorkflowPublish/orderTableTesting'
   )
   PARTITIONED BY (PARTITION_DT)
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org