You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Felix Kizhakkel Jose (Jira)" <ji...@apache.org> on 2020/09/09 16:06:00 UTC
[jira] [Comment Edited] (HUDI-83) Map Timestamp type in spark to
corresponding Timestamp type in Hive during Hive sync
[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193006#comment-17193006 ]
Felix Kizhakkel Jose edited comment on HUDI-83 at 9/9/20, 4:05 PM:
-------------------------------------------------------------------
[~uditme] we are using EMR 6.1.0, the very recent one. Where Spark 3.0, Hive 3.1.2. So could you please elaborate a little on your response - "Yes, in hive3 it is supported, and we can just replace timestamp column from long to timestamp.". What should be done and is it possible to make in my pyspark script or does this change should happen in HUDI code?
was (Author: felixkjose):
[~uditme] we are using EMR 6.1.0, the very recent one. Where Spark 3.0, Hive 3.1.2. So could you please elaborate a little on your response - "Yes, in hive3 it is supported, and we can just replace timestamp column from long to timestamp.". What should be done and is it possible to make in the pyspark script?
> Map Timestamp type in spark to corresponding Timestamp type in Hive during Hive sync
> ------------------------------------------------------------------------------------
>
> Key: HUDI-83
> URL: https://issues.apache.org/jira/browse/HUDI-83
> Project: Apache Hudi
> Issue Type: Bug
> Components: Hive Integration, Usability
> Reporter: Vinoth Chandar
> Assignee: cdmikechen
> Priority: Major
> Labels: bug-bash-0.6.0
> Fix For: 0.6.1
>
>
> [https://github.com/apache/incubator-hudi/issues/543] & related issues
--
This message was sent by Atlassian Jira
(v8.3.4#803005)