[jira] [Commented] (TINKERPOP-1023) Add a spark variable in SparkGremlinPlugin like we do hdfs for HadoopGremlinPlugin

["Marko A. Rodriguez (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TINKERPOP-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039524#comment-15039524 ] 

Marko A. Rodriguez commented on TINKERPOP-1023:
-----------------------------------------------

Note that {{hdfs}} is possible at Gremlin Console startup cause it reads the {{core-site.xml}}. We will need something analogous for Spark. Else, someone can simply do: 

{code}
gremlin> spark = SparkContext.getOrCreate(configuration)
{code}

It would be nice if we provided that preloaded all pretty like though.

> Add a spark variable in SparkGremlinPlugin like we do hdfs for HadoopGremlinPlugin
> ----------------------------------------------------------------------------------
>
>                 Key: TINKERPOP-1023
>                 URL: https://issues.apache.org/jira/browse/TINKERPOP-1023
>             Project: TinkerPop
>          Issue Type: Improvement
>          Components: hadoop
>    Affects Versions: 3.1.0-incubating
>            Reporter: Marko A. Rodriguez
>            Assignee: Marko A. Rodriguez
>             Fix For: 3.1.1-incubating
>
>
> It would be good if from the Gremlin Console we could do things like this:
> {code}
> gremlin> spark.getRDDs()
> gremlin> spark.removeRDD("graphRDD")
> gremlin> spark.getMaster()
> gremlin> spark.isPersisted()
> {code}
> With the ability to have persisted context's, its confusing as to what is persisted and what is not. With a {{spark}} like we have with {{hdfs}} it will make it more clear.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)