You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ignite.apache.org by "Denis Magda (JIRA)" <ji...@apache.org> on 2017/01/05 17:38:58 UTC

[jira] [Created] (IGNITE-4526) Add Spark Shared RDD examples

Denis Magda created IGNITE-4526:
-----------------------------------

             Summary: Add Spark Shared RDD examples
                 Key: IGNITE-4526
                 URL: https://issues.apache.org/jira/browse/IGNITE-4526
             Project: Ignite
          Issue Type: Task
            Reporter: Denis Magda


Spark Shared RDD functionality doesn't have its own examples. We need to add an example that will do the following:
- First Spark Worker: creation of a shared RDD and filling it in with data.
- First Spark Worker: performing some native spark transformation with the RDD.
- Second Spark Worker: connecting to the same shared RDD.
- Second Spark Worker: execution of SQL query using Spark API and Ignite API. Show that Ignite's query executes faster.

The reason why the example should consist of two workers is to showcase one of the main benefits of Ignite's RDDs - ability to share the state (RDD) amid different Spark workers and processes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)