Re: diferrences between IgniteRdd and SparkRdd

[Mehdi Seydali <se...@gmail.com>]

I have another question. Could we create Rdd in spark separately frim
ignite or we must create rdd from ignite and share with spark. In other
words, is it possible create spark and ignite Rdd independently?

On Wednesday, December 26, 2018, aealexsandrov <ae...@gmail.com>
wrote:

> Hi,
>
> The main difference between native Spark RDD and IgniteRDD is that Ignite
> RDD provides a shared in-memory view on data across different Spark jobs,
> workers, or applications, while native Spark RDD cannot be seen by other
> Spark jobs or applications.
>
> You can see the attached image that describes it.
>
> spark-ignite-rdd.png
> <http://apache-ignite-users.70518.x6.nabble.com/file/
> t1704/spark-ignite-rdd.png>
>
> According to your second question:
>
> The provided code do next:
>
> 1)Create Spark context
> 2)Creates Ignite context with provided configuration.
> 3)Creates an Ignite Shared RDD of Type (Int,Int)
> 4)Fill the Ignite Shared RDD in with Int pairs.
>
> To get the full example please take a look at ScalarSharedRDDExample.java
> that located in source files:
>
> https://github.com/apache/ignite/blob/master/examples/
> src/main/scala/org/apache/ignite/scalar/examples/spark/
> ScalarSharedRDDExample.scala
>
> BR,
> Andrei
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>