You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Maxim Gekk (Jira)" <ji...@apache.org> on 2020/05/05 08:58:00 UTC

[jira] [Created] (SPARK-31641) Incorrect days conversion by JSON legacy parser

Maxim Gekk created SPARK-31641:
----------------------------------

             Summary: Incorrect days conversion by JSON legacy parser
                 Key: SPARK-31641
                 URL: https://issues.apache.org/jira/browse/SPARK-31641
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.0.0, 3.1.0
            Reporter: Maxim Gekk


Spark 2.4.5:
{code:scala}
scala> val ds = Seq("{'d': '-141704'}").toDS
ds: org.apache.spark.sql.Dataset[String] = [value: string]

scala> val json = spark.read.schema("d date").json(ds)
json: org.apache.spark.sql.DataFrame = [d: date]

scala> json.show
+----------+
|         d|
+----------+
|1582-01-01|
+----------+
{code}

Spark 3.1.0-SNAPSHOT:
{code:scala}
scala> val ds = Seq("{'d': '-141704'}").toDS
ds: org.apache.spark.sql.Dataset[String] = [value: string]

scala> val json = spark.read.schema("d date").json(ds)
json: org.apache.spark.sql.DataFrame = [d: date]

scala> json.show
+----------+
|         d|
+----------+
|1582-01-11|
+----------+
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org