You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "PEIYUAN SUN (Jira)" <ji...@apache.org> on 2022/06/12 13:53:00 UTC

[jira] [Created] (SPARK-39452) Extend EdgePartition1D with Destination based Strategy

PEIYUAN SUN created SPARK-39452:
-----------------------------------

             Summary: Extend EdgePartition1D with Destination based Strategy
                 Key: SPARK-39452
                 URL: https://issues.apache.org/jira/browse/SPARK-39452
             Project: Spark
          Issue Type: New Feature
          Components: GraphX
    Affects Versions: 3.2.1, 3.1.2
            Reporter: PEIYUAN SUN
             Fix For: 3.3.0, 3.3.1


Currently, the *[EdgePartition1D|https://github.com/apache/spark/blob/master/graphx/src/main/scala/org/apache/spark/graphx/PartitionStrategy.scala#L101]*  use only the source vertex ID.

If doing topological like algorithm on graph, directly partition based on destination vertex ID would improve the performance significantly.

The proposal here is either adding a new case object like *EdgePartition1DDst* or ** update the ** *EdgePartition1D* such that user can configure the src or dst.{*}{*}



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org