You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Aaron Davidson (JIRA)" <ji...@apache.org> on 2014/07/09 02:42:04 UTC

[jira] [Created] (SPARK-2412) CoalescedRDD throws exception with certain pref locs

Aaron Davidson created SPARK-2412:
-------------------------------------

             Summary: CoalescedRDD throws exception with certain pref locs
                 Key: SPARK-2412
                 URL: https://issues.apache.org/jira/browse/SPARK-2412
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 1.0.0
            Reporter: Aaron Davidson
            Assignee: Aaron Davidson


If the first pass of CoalescedRDD does not find the target number of locations AND the second pass finds new locations, an exception is thrown, as "groupHash.get(nxt_replica).get" is not valid.

The fix is just to add an ArrayBuffer to groupHash for that replica if it didn't already exist.



--
This message was sent by Atlassian JIRA
(v6.2#6252)