You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2014/07/31 01:21:38 UTC

[jira] [Created] (SPARK-2758) UnionRDD's UnionPartition should not reference parent RDDs

Reynold Xin created SPARK-2758:
----------------------------------

             Summary: UnionRDD's UnionPartition should not reference parent RDDs
                 Key: SPARK-2758
                 URL: https://issues.apache.org/jira/browse/SPARK-2758
             Project: Spark
          Issue Type: Improvement
    Affects Versions: 1.0.0, 1.0.1, 1.0.2
            Reporter: Reynold Xin
            Assignee: Reynold Xin


UnionPartition has a non-transient field referencing the parent RDD, to be used in compute (iterator). That causes some trouble with task size because partition objects are supposed to be small.





--
This message was sent by Atlassian JIRA
(v6.2#6252)