[jira] [Created] (SPARK-25402) Null handling in BooleanSimplification

["Xiao Li (JIRA)" <ji...@apache.org>]

Xiao Li created SPARK-25402:
-------------------------------

             Summary: Null handling in BooleanSimplification
                 Key: SPARK-25402
                 URL: https://issues.apache.org/jira/browse/SPARK-25402
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.3.1, 2.2.2
            Reporter: Xiao Li
            Assignee: Xiao Li


SPARK-20350 introduced a bug BooleanSimplification for null handling. For example, the following case returns a wrong answer. 

{code}
    val schema = StructType.fromDDL("a boolean, b int")
    val rows = Seq(Row(null, 1))

    val rdd = sparkContext.parallelize(rows)
    val df = spark.createDataFrame(rdd, schema)

    checkAnswer(df.where("(NOT a) OR a"), Seq.empty)
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org