Integrating Spark with Ignite File System

[Dmitriy Setrakyan <ds...@apache.org>]

Hello Everyone,

I am one of the committers to Apache Ignite and have noticed some talks on
this dev list about integrating Ignite In-Memory File System (IgniteFS)
with Spark. We definitely like the idea. If you have any questions about
Apache Ignite at all, feel free to forward them to the Ignite dev list. We
are going to be monitoring this list as well.

Ignite mailing list: dev-subscribe@ignite.incubator.apache.org

Regards,
Dmitriy

Re: Integrating Spark with Ignite File System

[Devl Devel <de...@gmail.com>]

Hi Dmitriy,

Thanks for the input, I think as per my previous email it would be good to
have a bridge project that for example, creates a IgniteFS RDD, similar to
the JDBC or HDFS one in which we can extract blocks and populate RDD
partitions, I'll post this proposal on your list.

Thanks
Devl



On Sat, Apr 11, 2015 at 9:28 AM, Reynold Xin <rx...@databricks.com> wrote:

> Welcome, Dmitriy, to the Spark dev list!
>
>
> On Sat, Apr 11, 2015 at 1:14 AM, Dmitriy Setrakyan <ds...@apache.org>
> wrote:
>
> > Hello Everyone,
> >
> > I am one of the committers to Apache Ignite and have noticed some talks
> on
> > this dev list about integrating Ignite In-Memory File System (IgniteFS)
> > with Spark. We definitely like the idea. If you have any questions about
> > Apache Ignite at all, feel free to forward them to the Ignite dev list.
> We
> > are going to be monitoring this list as well.
> >
> > Ignite mailing list: dev-subscribe@ignite.incubator.apache.org
> >
> > Regards,
> > Dmitriy
> >
>

Re: Integrating Spark with Ignite File System

[Devl Devel <de...@gmail.com>]

Hi Dmitriy,

Thanks for the input, I think as per my previous email it would be good to
have a bridge project that for example, creates a IgniteFS RDD, similar to
the JDBC or HDFS one in which we can extract blocks and populate RDD
partitions, I'll post this proposal on your list.

Thanks
Devl



On Sat, Apr 11, 2015 at 9:28 AM, Reynold Xin <rx...@databricks.com> wrote:

> Welcome, Dmitriy, to the Spark dev list!
>
>
> On Sat, Apr 11, 2015 at 1:14 AM, Dmitriy Setrakyan <ds...@apache.org>
> wrote:
>
> > Hello Everyone,
> >
> > I am one of the committers to Apache Ignite and have noticed some talks
> on
> > this dev list about integrating Ignite In-Memory File System (IgniteFS)
> > with Spark. We definitely like the idea. If you have any questions about
> > Apache Ignite at all, feel free to forward them to the Ignite dev list.
> We
> > are going to be monitoring this list as well.
> >
> > Ignite mailing list: dev-subscribe@ignite.incubator.apache.org
> >
> > Regards,
> > Dmitriy
> >
>

Re: Integrating Spark with Ignite File System

[Reynold Xin <rx...@databricks.com>]

Welcome, Dmitriy, to the Spark dev list!


On Sat, Apr 11, 2015 at 1:14 AM, Dmitriy Setrakyan <ds...@apache.org>
wrote:

> Hello Everyone,
>
> I am one of the committers to Apache Ignite and have noticed some talks on
> this dev list about integrating Ignite In-Memory File System (IgniteFS)
> with Spark. We definitely like the idea. If you have any questions about
> Apache Ignite at all, feel free to forward them to the Ignite dev list. We
> are going to be monitoring this list as well.
>
> Ignite mailing list: dev-subscribe@ignite.incubator.apache.org
>
> Regards,
> Dmitriy
>

Re: Integrating Spark with Ignite File System

[Reynold Xin <rx...@databricks.com>]

Welcome, Dmitriy, to the Spark dev list!


On Sat, Apr 11, 2015 at 1:14 AM, Dmitriy Setrakyan <ds...@apache.org>
wrote:

> Hello Everyone,
>
> I am one of the committers to Apache Ignite and have noticed some talks on
> this dev list about integrating Ignite In-Memory File System (IgniteFS)
> with Spark. We definitely like the idea. If you have any questions about
> Apache Ignite at all, feel free to forward them to the Ignite dev list. We
> are going to be monitoring this list as well.
>
> Ignite mailing list: dev-subscribe@ignite.incubator.apache.org
>
> Regards,
> Dmitriy
>