[jira] [Commented] (TINKERPOP3-925) Use persisted SparkContext to persist an RDD across Spark jobs.

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TINKERPOP3-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14985398#comment-14985398 ] 

ASF GitHub Bot commented on TINKERPOP3-925:
-------------------------------------------

Github user PommeVerte commented on the pull request:

    https://github.com/apache/incubator-tinkerpop/pull/129#issuecomment-153054246
  
    Had another look at this and it looks good to me. Docs, tests and all. Ran mvn clean install without an issue and also ran verify with integration tests for some of the more relevant projects and they passed.
    
    VOTE: +1


> Use persisted SparkContext to persist an RDD across Spark jobs.
> ---------------------------------------------------------------
>
>                 Key: TINKERPOP3-925
>                 URL: https://issues.apache.org/jira/browse/TINKERPOP3-925
>             Project: TinkerPop 3
>          Issue Type: Improvement
>          Components: hadoop
>    Affects Versions: 3.0.2-incubating
>            Reporter: Marko A. Rodriguez
>            Assignee: Marko A. Rodriguez
>             Fix For: 3.1.0-incubating
>
>
> If a provider is using Spark, they are currently forced to have HDFS be used to store intermediate RDD data. However, if they plan on using that data in a {{GraphComputer}} "job chain," then they should be able to lookup a {{.cached()}} RDD by name. 
> Create a {{inputGraphRDD.name}} and {{outputGraphRDD.name}} to make it so that the configuration references {{SparkContext.getPersitedRDDs()}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)