You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tinkerpop.apache.org by "Marko A. Rodriguez (JIRA)" <ji...@apache.org> on 2015/12/03 15:59:10 UTC

[jira] [Created] (TINKERPOP-1017) Get InputRDDFormat to work with Multiple Splits

Marko A. Rodriguez created TINKERPOP-1017:
---------------------------------------------

             Summary: Get InputRDDFormat to work with Multiple Splits
                 Key: TINKERPOP-1017
                 URL: https://issues.apache.org/jira/browse/TINKERPOP-1017
             Project: TinkerPop
          Issue Type: Improvement
          Components: hadoop
    Affects Versions: 3.1.1-incubating
            Reporter: Marko A. Rodriguez


{{InputFormatRDD}} was recently added to enable {{HadoopGraph}} to OLTP stream in {{InputRDD}} data. It is currently single threaded. I tried to make it parallel, but ran into some {{Exceptions}} I didn't understand. For OLTP it doesn't matter, however, it would be good to make it work with multiple Hadoop {{InputSplits}} and then, Hadoop could read from Spark in OLAP too :). I don't know why that would ever be used... ? But if its easy enough to do, just do it.

[~rspitzer] --- When https://issues.apache.org/jira/browse/TINKERPOP-1011 you will see {{InputFormatRDD}}. You might have an idea on how to do this. If you care -- no worries though.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)