You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2017/03/26 14:07:42 UTC

[jira] [Commented] (SPARK-14057) sql time stamps do not respect time zones

    [ https://issues.apache.org/jira/browse/SPARK-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15942285#comment-15942285 ] 

Hyukjin Kwon commented on SPARK-14057:
--------------------------------------

[~vsparmar], would {{spark.sql.session.timeZone}} solve this problem?

> sql time stamps do not respect time zones
> -----------------------------------------
>
>                 Key: SPARK-14057
>                 URL: https://issues.apache.org/jira/browse/SPARK-14057
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 1.6.0
>            Reporter: Andrew Davidson
>            Priority: Minor
>
> we have time stamp data. The time stamp data is UTC how ever when we load the data into spark data frames, the system assume the time stamps are in the local time zone. This causes problems for our data scientists. Often they pull data from our data center into their local macs. The data centers run UTC. There computers are typically in PST or EST.
> It is possible to hack around this problem
> This cause a lot of errors in their analysis
> A complete description of this issue can be found in the following mail msg
> https://www.mail-archive.com/user@spark.apache.org/msg48121.html



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org