Multiple-streaming context within a jvm

[Hafiz Mujadid <ha...@gmail.com>]

Hi,

I am trying to use multiple streaming context in one spark job. I want to
fetch users data from users topic of Kafka and purchase data from purchases
topic of Kafka using streaming. Then I want to join the data and perform
some operations on this data. But, I read that spark does not allow
multiple streaming context in a JVM. So, How can I implement this use-case?


Thanks

Re: Multiple-streaming context within a jvm

[Cody Koeninger <co...@koeninger.org>]

Maybe I'm misunderstanding, but you can have multiple kafka topics /
streams in a single streaming context.

On Wed, Oct 5, 2016 at 4:13 AM, Hafiz Mujadid <ha...@gmail.com> wrote:
> Hi,
>
> I am trying to use multiple streaming context in one spark job. I want to
> fetch users data from users topic of Kafka and purchase data from purchases
> topic of Kafka using streaming. Then I want to join the data and perform
> some operations on this data. But, I read that spark does not allow multiple
> streaming context in a JVM. So, How can I implement this use-case?
>
>
> Thanks

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org