You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Aashish Chaudhary <aa...@kitware.com> on 2017/06/26 18:58:27 UTC

ZeroMQ Streaming in Spark2.x

Hi there,

I am a beginner when it comes to Spark streaming. I was looking for some
examples related to ZeroMQ and Spark and realized that ZeroMQUtils is no
longer present in Spark 2.x.

I would appreciate if someone can shed some light on the history and what I
could do to use ZeroMQ with Spark Streaming in the current version.

Thanks,

Re: ZeroMQ Streaming in Spark2.x

Posted by Aashish Chaudhary <aa...@kitware.com>.

thanks, I was able to get it up and running.

One think I am not entirely sure if bahir provided python bindings to
ZeroMQ. Looking at the code it does not seems like but I might be wrong.

thanks,


On Mon, Jun 26, 2017 at 5:13 PM Aashish Chaudhary <
aashish.chaudhary@kitware.com> wrote:

> Thanks. I saw it earlier but did not whether this is the official way of
> doing Spark with ZeroMQ. Thanks, I will have a look.
> - Aashish
>
>
> On Mon, Jun 26, 2017 at 3:01 PM Shixiong(Ryan) Zhu <
> shixiong@databricks.com> wrote:
>
>> It's moved to http://bahir.apache.org/
>>
>> You can find document there.
>>
>> On Mon, Jun 26, 2017 at 11:58 AM, Aashish Chaudhary <
>> aashish.chaudhary@kitware.com> wrote:
>>
>>> Hi there,
>>>
>>> I am a beginner when it comes to Spark streaming. I was looking for some
>>> examples related to ZeroMQ and Spark and realized that ZeroMQUtils is no
>>> longer present in Spark 2.x.
>>>
>>> I would appreciate if someone can shed some light on the history and
>>> what I could do to use ZeroMQ with Spark Streaming in the current version.
>>>
>>> Thanks,
>>>
>>>
>>

Re: ZeroMQ Streaming in Spark2.x

Posted by Aashish Chaudhary <aa...@kitware.com>.

Thanks. I saw it earlier but did not whether this is the official way of
doing Spark with ZeroMQ. Thanks, I will have a look.
- Aashish


On Mon, Jun 26, 2017 at 3:01 PM Shixiong(Ryan) Zhu <sh...@databricks.com>
wrote:

> It's moved to http://bahir.apache.org/
>
> You can find document there.
>
> On Mon, Jun 26, 2017 at 11:58 AM, Aashish Chaudhary <
> aashish.chaudhary@kitware.com> wrote:
>
>> Hi there,
>>
>> I am a beginner when it comes to Spark streaming. I was looking for some
>> examples related to ZeroMQ and Spark and realized that ZeroMQUtils is no
>> longer present in Spark 2.x.
>>
>> I would appreciate if someone can shed some light on the history and what
>> I could do to use ZeroMQ with Spark Streaming in the current version.
>>
>> Thanks,
>>
>>
>

Re: ZeroMQ Streaming in Spark2.x

Posted by "Shixiong(Ryan) Zhu" <sh...@databricks.com>.

It's moved to http://bahir.apache.org/

You can find document there.

On Mon, Jun 26, 2017 at 11:58 AM, Aashish Chaudhary <
aashish.chaudhary@kitware.com> wrote:

> Hi there,
>
> I am a beginner when it comes to Spark streaming. I was looking for some
> examples related to ZeroMQ and Spark and realized that ZeroMQUtils is no
> longer present in Spark 2.x.
>
> I would appreciate if someone can shed some light on the history and what
> I could do to use ZeroMQ with Spark Streaming in the current version.
>
> Thanks,
>
>