You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Konstantin Boudnik (JIRA)" <ji...@apache.org> on 2015/10/23 07:43:27 UTC

[jira] [Commented] (IGNITE-389) Integration with Spark: IgniteRDD

    [ https://issues.apache.org/jira/browse/IGNITE-389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970485#comment-14970485 ] 

Konstantin Boudnik commented on IGNITE-389:
-------------------------------------------

I'd move to detach the Python issue to a standalone task and just close this integration ticket. If I don't hear anything from ppl for a couple of days I will do just that.

> Integration with Spark: IgniteRDD
> ---------------------------------
>
>                 Key: IGNITE-389
>                 URL: https://issues.apache.org/jira/browse/IGNITE-389
>             Project: Ignite
>          Issue Type: New Feature
>          Components: general
>            Reporter: Dmitriy Setrakyan
>            Assignee: Alexey Goncharuk
>            Priority: Blocker
>             Fix For: 1.5
>
>
> I think we should create an implementation of RDD for Ignite caches (either REPLICATED or PARTITIONED).
> Please create Spark project from GIT:
> https://github.com/apache/spark
> In core module for Scala you can find {{org.apache.spark.rdd.RDD}} class which is extensible. We should provide our own implementation of this class. This package has plenty of other examples on how to create RDD, e.g. HadoopRDD, JdbcRDD, etc.
> This integration should be done in ignite-spark module.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)