You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:35:39 UTC

[jira] [Resolved] (SPARK-12431) add local checkpointing to GraphX

     [ https://issues.apache.org/jira/browse/SPARK-12431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-12431.
----------------------------------
    Resolution: Incomplete

> add local checkpointing to GraphX
> ---------------------------------
>
>                 Key: SPARK-12431
>                 URL: https://issues.apache.org/jira/browse/SPARK-12431
>             Project: Spark
>          Issue Type: Improvement
>          Components: GraphX
>    Affects Versions: 1.5.2
>            Reporter: Edward Seidl
>            Priority: Major
>              Labels: bulk-closed
>
> local checkpointing was added to RDD to speed up iterative spark jobs, but this capability hasn't been added to GraphX.  Adding localCheckpoint to GraphImpl, EdgeRDDImpl, and VertexRDDImpl greatly improved the speed of a k-core algorithm I'm using (at the cost of fault tolerance, of course).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org