You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2015/07/29 06:40:04 UTC

[jira] [Resolved] (SPARK-8599) Improve non-deterministic expression handling

     [ https://issues.apache.org/jira/browse/SPARK-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Reynold Xin resolved SPARK-8599.
--------------------------------
       Resolution: Fixed
         Assignee: Wenchen Fan
    Fix Version/s: 1.5.0

> Improve non-deterministic expression handling
> ---------------------------------------------
>
>                 Key: SPARK-8599
>                 URL: https://issues.apache.org/jira/browse/SPARK-8599
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 1.4.0
>            Reporter: Yin Huai
>            Assignee: Wenchen Fan
>            Priority: Critical
>             Fix For: 1.5.0
>
>
> Right now, we are using expressions for Random distribution generating expressions. But, we have to track them in lots of places in the optimizer to handle them carefully. Otherwise, these expressions will be treated as stateless expressions and have unexpected behaviors (e.g. SPARK-8023). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org