You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2019/01/04 17:23:02 UTC

[jira] [Commented] (SPARK-26246) Infer timestamp types from JSON

    [ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734361#comment-16734361 ] 

Reynold Xin commented on SPARK-26246:
-------------------------------------

|Is there an option flag for this? This is a breaking change for people, and we need a way to fallback.|
 
 
 

> Infer timestamp types from JSON
> -------------------------------
>
>                 Key: SPARK-26246
>                 URL: https://issues.apache.org/jira/browse/SPARK-26246
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.4.0
>            Reporter: Maxim Gekk
>            Assignee: Maxim Gekk
>            Priority: Minor
>             Fix For: 3.0.0
>
>
> Currently, TimestampType cannot be inferred from JSON. To parse JSON string, you have to specify schema explicitly if JSON input contains timestamps. This ticket aims to extend JsonInferSchema to support such inferring.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org