Re: A question of ignite on spark streaming

[vkulichenko <va...@gmail.com>]

Hi,

Can you please properly subscribe to the mailing list so that the community
can receive email notifications? Here is the instruction:
http://apache-ignite-users.70518.x6.nabble.com/mailing_list/MailingListOptions.jtp?forum=1


F7753 wrote
> I want to use two igniteRDD to cache spark dataFrames: one is a static
> table,while the other is a stream table which the data comes from kafka or
> socket and etc.
> My question is: the IgniteContext has only two parameters so that I can
> only create one cache. How to use ignite to accelerate spark streaming in
> my use case?

Looks like type IgniteContext was parameterized by mistake, it doesn't make
much sense to me. I created a ticket to fix this:
https://issues.apache.org/jira/browse/IGNITE-2929

As a workaround you can create two contexts with different type parameters.
They will reuse the same Ignite instance and also will allow you to create
two caches.

-Val



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/A-question-of-ignite-on-spark-streaming-tp3815p3830.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.