You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Bruce Robbins (Jira)" <ji...@apache.org> on 2020/10/25 21:36:00 UTC

[jira] [Resolved] (SPARK-31342) Fail by default if Parquet DATE or TIMESTAMP data is before October 15, 1582

     [ https://issues.apache.org/jira/browse/SPARK-31342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bruce Robbins resolved SPARK-31342.
-----------------------------------
    Resolution: Duplicate

> Fail by default if Parquet DATE or TIMESTAMP data is before October 15, 1582
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-31342
>                 URL: https://issues.apache.org/jira/browse/SPARK-31342
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Bruce Robbins
>            Priority: Major
>
> Some users may not know they are creating and/or reading DATE or TIMESTAMP data from before October 15, 1582 (because of data encoding libraries, etc.). Therefore, it may not be clear whether they need to toggle the two rebaseDateTime config settings.
> By default, Spark should fail if it reads or writes data from October 15, 1582 or before.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org