You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Holden Karau (Jira)" <ji...@apache.org> on 2024/02/13 02:17:00 UTC

[jira] [Created] (SPARK-47031) Union of with non-determinstic expression should be non-deterministic

Holden Karau created SPARK-47031:
------------------------------------

             Summary: Union of with non-determinstic expression should be non-deterministic
                 Key: SPARK-47031
                 URL: https://issues.apache.org/jira/browse/SPARK-47031
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.5.0
            Reporter: Holden Karau


We have special case handling for nullability already where any expression which is unioned with a nullable field becomes nullable, but we should do the same for deterministic.

 

I found this while I was poking around with push downs.

 

I believe the code to be updated would be output in the union case class.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org