You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Yin Huai (JIRA)" <ji...@apache.org> on 2015/02/27 06:21:04 UTC

[jira] [Created] (SPARK-6052) In JSON schema inference, we should always set containsNull of an ArrayType to true

Yin Huai created SPARK-6052:
-------------------------------

             Summary: In JSON schema inference, we should always set containsNull of an ArrayType to true
                 Key: SPARK-6052
                 URL: https://issues.apache.org/jira/browse/SPARK-6052
             Project: Spark
          Issue Type: Bug
          Components: SQL
            Reporter: Yin Huai
            Priority: Blocker


We should not try to figure out if an array contains null or not because we may miss arrays with null if we do sampling or future data may have nulls in the array.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org