You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Michel Lemay (JIRA)" <ji...@apache.org> on 2016/04/06 14:34:25 UTC

[jira] [Created] (SPARK-14428) [SQL] Allow more flexibility when parsing dates and timestamps in json datasources

Michel Lemay created SPARK-14428:
------------------------------------

             Summary: [SQL] Allow more flexibility when parsing dates and timestamps in json datasources
                 Key: SPARK-14428
                 URL: https://issues.apache.org/jira/browse/SPARK-14428
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 1.6.1
            Reporter: Michel Lemay
            Priority: Minor


Reading a json with dates and timestamps is limited to predetermined string formats or long values.

Date: Int -> number of days since epoch
Timestamps: Long -> number of nanoseconds since epoch

We should be able to set an option on json datasource to parse dates and timestamps using custom format.  Also, we should be able to change the interpretation of long values to number of milliseconds since epoch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org