You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Matei Zaharia (JIRA)" <ji...@apache.org> on 2014/11/06 08:04:34 UTC

[jira] [Commented] (SPARK-785) ClosureCleaner not invoked on most PairRDDFunctions

    [ https://issues.apache.org/jira/browse/SPARK-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199922#comment-14199922 ] 

Matei Zaharia commented on SPARK-785:
-------------------------------------

[~adav] it still seems to be, weirdly enough: for instance combineByKey doesn't do it. Unless I'm missing something.

> ClosureCleaner not invoked on most PairRDDFunctions
> ---------------------------------------------------
>
>                 Key: SPARK-785
>                 URL: https://issues.apache.org/jira/browse/SPARK-785
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>            Reporter: Matei Zaharia
>
> It's pretty weird that we've missed this so far, but it seems to be the case. Unfortunately it may not be good to fix this in 0.7.3 because it could change behavior in unexpected ways; I haven't decided yet. But we should definitely do it for 0.8, and add tests.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org