You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/02/04 17:20:00 UTC

[jira] [Assigned] (SPARK-34357) Map JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone

     [ https://issues.apache.org/jira/browse/SPARK-34357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wenchen Fan reassigned SPARK-34357:
-----------------------------------

    Assignee: Duc Hoa Nguyen

> Map JDBC SQL TIME type to TimestampType with time portion fixed regardless of timezone
> --------------------------------------------------------------------------------------
>
>                 Key: SPARK-34357
>                 URL: https://issues.apache.org/jira/browse/SPARK-34357
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.2.0
>            Reporter: Duc Hoa Nguyen
>            Assignee: Duc Hoa Nguyen
>            Priority: Minor
>             Fix For: 3.2.0
>
>
> Due to user-experience (confusing to Spark users - java.sql.Time using milliseconds vs Spark using microseconds; and user losing useful functions like hour(), minute(), etc on the column), we have decided to revert back to use TimestampType but this time we will enforce the hour to be consistently across system timezone (via offset manipulation)
> Full Discussion with Wenchen Fan [~cloud_fan] regarding this ticket is here https://github.com/apache/spark/pull/30902#discussion_r569186823
> Related issues: [SPARK-33888|https://issues.apache.org/jira/browse/SPARK-33888] 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org