You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@ignite.apache.org by "Dmitriy Setrakyan (JIRA)" <ji...@apache.org> on 2015/03/03 02:35:05 UTC

[jira] [Created] (IGNITE-389) Integration with Spark: IgniteRDD

Dmitriy Setrakyan created IGNITE-389:
----------------------------------------

             Summary: Integration with Spark: IgniteRDD
                 Key: IGNITE-389
                 URL: https://issues.apache.org/jira/browse/IGNITE-389
             Project: Ignite
          Issue Type: Bug
          Components: hadoop
            Reporter: Dmitriy Setrakyan
            Assignee: Vladimir Ozerov
            Priority: Blocker
             Fix For: sprint-3


I think we should create an implementation of RDD for Ignite caches (either REPLICATED or PARTITIONED).

Please create Spark project from GIT:
https://github.com/apache/spark

In core module for Scala you can find {{org.apache.spark.rdd.RDD}} class which is extensible. We should provide our own implementation of this class. This package has plenty of other examples on how to create RDD, e.g. HadoopRDD, JdbcRDD, etc.

This integration should be done in ignite-spark module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)