[jira] [Commented] (SPARK-31342) Fail by default if Parquet DATE or TIMESTAMP data is before October 15, 1582

["Maxim Gekk (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-31342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17220274#comment-17220274 ] 

Maxim Gekk commented on SPARK-31342:
------------------------------------

[~cloud_fan] I think we can close this because it has been already implemented.

> Fail by default if Parquet DATE or TIMESTAMP data is before October 15, 1582
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-31342
>                 URL: https://issues.apache.org/jira/browse/SPARK-31342
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Bruce Robbins
>            Priority: Major
>
> Some users may not know they are creating and/or reading DATE or TIMESTAMP data from before October 15, 1582 (because of data encoding libraries, etc.). Therefore, it may not be clear whether they need to toggle the two rebaseDateTime config settings.
> By default, Spark should fail if it reads or writes data from October 15, 1582 or before.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org