You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Edward Seidl (JIRA)" <ji...@apache.org> on 2015/12/18 22:57:47 UTC

[jira] [Created] (SPARK-12431) add local checkpointing to GraphX

Edward Seidl created SPARK-12431:
------------------------------------

             Summary: add local checkpointing to GraphX
                 Key: SPARK-12431
                 URL: https://issues.apache.org/jira/browse/SPARK-12431
             Project: Spark
          Issue Type: Improvement
          Components: GraphX
    Affects Versions: 1.5.2
            Reporter: Edward Seidl


local checkpointing was added to RDD to speed up iterative spark jobs, but this capability hasn't been added to GraphX.  Adding localCheckpoint to GraphImpl, EdgeRDDImpl, and VertexRDDImpl greatly improved the speed of a k-core algorithm I'm using (at the cost of fault tolerance, of course).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org