You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/04/24 02:43:39 UTC

[jira] [Updated] (SPARK-6052) In JSON schema inference, we should always set containsNull of an ArrayType to true

     [ https://issues.apache.org/jira/browse/SPARK-6052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated SPARK-6052:
-----------------------------
    Assignee: Yin Huai

> In JSON schema inference, we should always set containsNull of an ArrayType to true
> -----------------------------------------------------------------------------------
>
>                 Key: SPARK-6052
>                 URL: https://issues.apache.org/jira/browse/SPARK-6052
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Yin Huai
>            Assignee: Yin Huai
>            Priority: Blocker
>             Fix For: 1.3.0
>
>
> We should not try to figure out if an array contains null or not because we may miss arrays with null if we do sampling or future data may have nulls in the array.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org