You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/02/09 15:16:09 UTC

[GitHub] [hudi] cdmikechen edited a comment on issue #2544: [SUPPORT]failed to read timestamp column in version 0.7.0 even when HIVE_SUPPORT_TIMESTAMP is enabled

cdmikechen edited a comment on issue #2544:
URL: https://github.com/apache/hudi/issues/2544#issuecomment-776007206


   I think it is still a problem in Hive2. In Hive2, Hive can not identify logical timestamp type.
   Spark3 user hive2 lib, if we use spark sql with `enableHiveSupport()` to read a hive table, it may appear that spark reads hive's field as timestamp type, and then uses hive2's parquet API to read timestamp. 
   In hive2 serd class, the type of timestamp must be `int96`, if we force parquet-avro to declare timestamp, this error will occur. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org