[jira] [Created] (SPARK-22257) Reserve all non-deterministic expressions in ExpressionSet.

["Gengliang Wang (JIRA)" <ji...@apache.org>]

Gengliang Wang created SPARK-22257:
--------------------------------------

             Summary: Reserve all non-deterministic expressions in ExpressionSet.
                 Key: SPARK-22257
                 URL: https://issues.apache.org/jira/browse/SPARK-22257
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.2.0
            Reporter: Gengliang Wang
            Priority: Critical


For non-deterministic expressions, they should be considered as not contained in the [[ExpressionSet]].
 
This is consistent with how we define `semanticEquals` between two expressions.

Otherwise, combining expressions will remove non-deterministic expressions which should be reserved.
E.g
Combine filters of 
```
      testRelation.where(Rand(0) > 0.1).where(Rand(0) > 0.1)
```
should result in
```
      testRelation.where(Rand(0) > 0.1 && Rand(0) > 0.1)
```



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org