You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/05/27 04:05:11 UTC
[GitHub] [hudi] creactiviti commented on issue #1670: Error opening Hive split: Unknown converted type TIMESTAMP_MICROS
creactiviti commented on issue #1670:
URL: https://github.com/apache/hudi/issues/1670#issuecomment-634199560
Was able to verify that Hudi is writing out using `TIMESTAMP_MICROS` (which presto does not seem to support) even though the source file is using `TIMESTAMP_MILLIS`:
```
$ java -jar parquet-tools-1.8.2.jar schema source.parquet
message schema {
optional int32 order_id;
optional int32 order_qty;
optional binary customer_name (UTF8);
optional int64 updated_at (TIMESTAMP_MILLIS);
optional int64 created_at (TIMESTAMP_MILLIS);
}
$ java -jar parquet-tools-1.8.2.jar schema 68aa1859-0a69-4483-ac3a-ee0f5fb79972-0_2-22-12020_20200526173709.parquet
message hoodie.orders.orders_record {
optional binary _hoodie_commit_time (UTF8);
optional binary _hoodie_commit_seqno (UTF8);
optional binary _hoodie_record_key (UTF8);
optional binary _hoodie_partition_path (UTF8);
optional binary _hoodie_file_name (UTF8);
optional int32 order_id;
optional int32 order_qty;
optional binary customer_name (UTF8);
optional int64 updated_at (TIMESTAMP_MICROS);
optional int64 created_at (TIMESTAMP_MICROS);
}
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org