You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Eyal Farago (JIRA)" <ji...@apache.org> on 2016/10/10 06:27:20 UTC

[jira] [Commented] (SPARK-12431) add local checkpointing to GraphX

    [ https://issues.apache.org/jira/browse/SPARK-12431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15561437#comment-15561437 ] 

Eyal Farago commented on SPARK-12431:
-------------------------------------

I think this heavily relates to SPARK-14804, assuming this is an ongoing effort I think it actually depends on 14804 resolution.


> add local checkpointing to GraphX
> ---------------------------------
>
>                 Key: SPARK-12431
>                 URL: https://issues.apache.org/jira/browse/SPARK-12431
>             Project: Spark
>          Issue Type: Improvement
>          Components: GraphX
>    Affects Versions: 1.5.2
>            Reporter: Edward Seidl
>
> local checkpointing was added to RDD to speed up iterative spark jobs, but this capability hasn't been added to GraphX.  Adding localCheckpoint to GraphImpl, EdgeRDDImpl, and VertexRDDImpl greatly improved the speed of a k-core algorithm I'm using (at the cost of fault tolerance, of course).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org