You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/04/23 11:29:33 UTC
[GitHub] [hudi] putaozhi123 opened a new issue #2869: [SUPPORT] java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable when I query a hudi table
putaozhi123 opened a new issue #2869:
URL: https://github.com/apache/hudi/issues/2869
The Hive tables created are as follows after hudi sync ： CREATE EXTERNAL TABLE IF NOT EXISTS `tmp`.`hud_test`( `_hoodie_commit_time` string, `_hoodie_commit_seqno` string, `_hoodie_record_key` string, `_hoodie_partition_path` string, `_hoodie_file_name` string, `name` string, `age` int, `address` string, `score` DECIMAL(10 , 4), `ts` TIMESTAMP) PARTITIONED BY (`default` String) ROW FORMAT SERDE 'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe' STORED AS INPUTFORMAT 'org.apache.hudi.hadoop.HoodieParquetInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat' LOCATION '/tmp/hudi_cow/xx'
When I run the Spark job to synchronize the Hudi table into Hive, I query Hudi table from Hive,there are the following errors:
**Failed with exception java.io.IOException:org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable**
**Environment Description**
* Hudi version : 0.8.0
* Spark version :2.4.4
* Hive version :2.3.8
* Hadoop version :2.10.1
* Storage (HDFS/S3/GCS..) :hdfs
* Running on Docker? (yes/no) :no
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar commented on issue #2869: [SUPPORT] java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable when I query a hudi table
Posted by GitBox <gi...@apache.org>.
vinothchandar commented on issue #2869:
URL: https://github.com/apache/hudi/issues/2869#issuecomment-926265872
Closing this. since there are few similar ones
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2869: [SUPPORT] java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable when I query a hudi table
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2869:
URL: https://github.com/apache/hudi/issues/2869#issuecomment-826537598
@putaozhi123 This is a known issue, a workaround has been mentioned here -> https://github.com/apache/hudi/issues/2544#issuecomment-815849870. Can you please try this and see if it works for you ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] n3nash commented on issue #2869: [SUPPORT] java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable when I query a hudi table
Posted by GitBox <gi...@apache.org>.
n3nash commented on issue #2869:
URL: https://github.com/apache/hudi/issues/2869#issuecomment-826537598
@putaozhi123 This is a known issue, a workaround has been mentioned here -> https://github.com/apache/hudi/issues/2544#issuecomment-815849870. Can you please try this and see if it works for you ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on issue #2869: [SUPPORT] java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable when I query a hudi table
Posted by GitBox <gi...@apache.org>.
codope commented on issue #2869:
URL: https://github.com/apache/hudi/issues/2869#issuecomment-905544606
@putaozhi123 Did you get a chance to try the suggested workaround?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #2869: [SUPPORT] java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable when I query a hudi table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #2869:
URL: https://github.com/apache/hudi/issues/2869#issuecomment-908884818
@putaozhi123 : We have a fix for timestamp data type read w/ hive. https://github.com/apache/hudi/pull/3391
Can you give it a try and let us know if it works for you. thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vinothchandar closed issue #2869: [SUPPORT] java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable when I query a hudi table
Posted by GitBox <gi...@apache.org>.
vinothchandar closed issue #2869:
URL: https://github.com/apache/hudi/issues/2869
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #2869: [SUPPORT] java.lang.ClassCastException: org.apache.hadoop.io.LongWritable cannot be cast to org.apache.hadoop.hive.serde2.io.TimestampWritable when I query a hudi table
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #2869:
URL: https://github.com/apache/hudi/issues/2869#issuecomment-908884818
@putaozhi123 : We have a fix for timestamp data type read w/ hive. https://github.com/apache/hudi/pull/3391
Can you give it a try and let us know if it works for you. thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org