You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2018/09/08 19:50:00 UTC

[jira] [Commented] (SPARK-25384) Removing spark.sql.fromJsonForceNullableSchema

    [ https://issues.apache.org/jira/browse/SPARK-25384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16608187#comment-16608187 ] 

Apache Spark commented on SPARK-25384:
--------------------------------------

User 'MaxGekk' has created a pull request for this issue:
https://github.com/apache/spark/pull/22366

> Removing spark.sql.fromJsonForceNullableSchema
> ----------------------------------------------
>
>                 Key: SPARK-25384
>                 URL: https://issues.apache.org/jira/browse/SPARK-25384
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.4.0
>            Reporter: Maxim Gekk
>            Priority: Trivial
>
> Disabling the spark.sql.fromJsonForceNullableSchema flag is error prone. We should not allow users to do that since it can lead to producing of corrupted output. The flag should be removed for simplicity too.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org