You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/05/27 04:05:11 UTC

[GitHub] [hudi] creactiviti commented on issue #1670: Error opening Hive split: Unknown converted type TIMESTAMP_MICROS

creactiviti commented on issue #1670:
URL: https://github.com/apache/hudi/issues/1670#issuecomment-634199560


   Was able to verify that Hudi is writing out using `TIMESTAMP_MICROS` (which presto does not seem to support) even though the source file is using `TIMESTAMP_MILLIS`:
   
   ```
   $ java -jar parquet-tools-1.8.2.jar schema source.parquet 
   
   message schema {
     optional int32 order_id;
     optional int32 order_qty;
     optional binary customer_name (UTF8);
     optional int64 updated_at (TIMESTAMP_MILLIS);
     optional int64 created_at (TIMESTAMP_MILLIS);
   }
   
   $ java -jar parquet-tools-1.8.2.jar schema 68aa1859-0a69-4483-ac3a-ee0f5fb79972-0_2-22-12020_20200526173709.parquet
   
   message hoodie.orders.orders_record {
     optional binary _hoodie_commit_time (UTF8);
     optional binary _hoodie_commit_seqno (UTF8);
     optional binary _hoodie_record_key (UTF8);
     optional binary _hoodie_partition_path (UTF8);
     optional binary _hoodie_file_name (UTF8);
     optional int32 order_id;
     optional int32 order_qty;
     optional binary customer_name (UTF8);
     optional int64 updated_at (TIMESTAMP_MICROS);
     optional int64 created_at (TIMESTAMP_MICROS);
   }
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org