[jira] [Created] (SPARK-1931) Graph.partitionBy does not reconstruct routing tables

["Ankur Dave (JIRA)" <ji...@apache.org>]

Ankur Dave created SPARK-1931:
---------------------------------

             Summary: Graph.partitionBy does not reconstruct routing tables
                 Key: SPARK-1931
                 URL: https://issues.apache.org/jira/browse/SPARK-1931
             Project: Spark
          Issue Type: Bug
          Components: GraphX
    Affects Versions: 1.0.0
            Reporter: Ankur Dave


Commit 905173df57b90f90ebafb22e43f55164445330e6 introduced a bug in partitionBy where, after repartitioning the edges, it reuses the VertexRDD without updating the routing tables to reflect the new edge layout. This causes the following test to fail:

{code:scala}
      val g = Graph(
        sc.parallelize(List((0L, "a"), (1L, "b"), (2L, "c"))),
        sc.parallelize(List(Edge(0L, 1L, 1), Edge(0L, 2L, 1)), 2))
      assert(g.triplets.collect.map(_.toTuple).toSet ===
        Set(((0L, "a"), (1L, "b"), 1), ((0L, "a"), (2L, "c"), 1)))
      val gPart = g.partitionBy(EdgePartition2D)
      assert(gPart.triplets.collect.map(_.toTuple).toSet ===
        Set(((0L, "a"), (1L, "b"), 1), ((0L, "a"), (2L, "c"), 1)))
{code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)