You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2018/09/21 06:23:00 UTC

[jira] [Resolved] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema

     [ https://issues.apache.org/jira/browse/SPARK-25384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wenchen Fan resolved SPARK-25384.
---------------------------------
       Resolution: Fixed
    Fix Version/s: 2.4.0

Issue resolved by pull request 22509
[https://github.com/apache/spark/pull/22509]

> Removing spark.sql.fromJsonForceNullableSchema
> ----------------------------------------------
>
>                 Key: SPARK-25384
>                 URL: https://issues.apache.org/jira/browse/SPARK-25384
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.4.0
>            Reporter: Maxim Gekk
>            Priority: Trivial
>             Fix For: 2.4.0
>
>
> Disabling the spark.sql.fromJsonForceNullableSchema flag is error prone. We should not allow users to do that since it can lead to producing of corrupted output. The flag should be removed for simplicity too.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org