You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Burak Yavuz (JIRA)" <ji...@apache.org> on 2015/06/25 00:56:04 UTC

[jira] [Commented] (SPARK-8599) Use a Random operator to handle Random distribution generating expressions

    [ https://issues.apache.org/jira/browse/SPARK-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600315#comment-14600315 ] 

Burak Yavuz commented on SPARK-8599:
------------------------------------

cc [~marmbrus] [~rxin]

> Use a Random operator to handle Random distribution generating expressions
> --------------------------------------------------------------------------
>
>                 Key: SPARK-8599
>                 URL: https://issues.apache.org/jira/browse/SPARK-8599
>             Project: Spark
>          Issue Type: Improvement
>    Affects Versions: 1.4.0
>            Reporter: Yin Huai
>            Priority: Critical
>
> Right now, we are using expressions for Random distribution generating expressions. But, we have to track them in lots of places in the optimizer to handle them carefully. Otherwise, these expressions will be treated as stateless expressions and have unexpected behaviors (e.g. SPARK-8023). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org