You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Jeetendra Gangele <ga...@gmail.com> on 2015/07/20 14:52:43 UTC
Does Spark streaming support is there with RabbitMQ
Does Apache spark support RabbitMQ. I have messages on RabbitMQ and I want
to process them using Apache Spark streaming does it scale?
Regards
Jeetendra
Re: Does Spark streaming support is there with RabbitMQ
Posted by Abel Rincón <ga...@gmail.com>.
Hi,
We tested this receiver internally in stratio sparkta, and it works fine,
If you will try the receiver, we're open to your collaboration, your issues
will be wellcome.
Regards
A.Rincón
Stratio software architect
2015-07-22 8:15 GMT+02:00 Tathagata Das <td...@databricks.com>:
> You could contact the authors of the spark-packages.. maybe that will help?
>
> On Mon, Jul 20, 2015 at 6:41 AM, Jeetendra Gangele <ga...@gmail.com>
> wrote:
>
>> Thanks Todd,
>>
>> I m not sure whether somebody has used it or not. can somebody confirm if
>> this integrate nicely with Spark streaming?
>>
>>
>>
>> On 20 July 2015 at 18:43, Todd Nist <ts...@gmail.com> wrote:
>>
>>> There is one package available on the spark-packages site,
>>>
>>> http://spark-packages.org/package/Stratio/RabbitMQ-Receiver
>>>
>>> The source is here:
>>>
>>> https://github.com/Stratio/RabbitMQ-Receiver
>>>
>>> Not sure that meets your needs or not.
>>>
>>> -Todd
>>>
>>> On Mon, Jul 20, 2015 at 8:52 AM, Jeetendra Gangele <gangele397@gmail.com
>>> > wrote:
>>>
>>>> Does Apache spark support RabbitMQ. I have messages on RabbitMQ and I
>>>> want to process them using Apache Spark streaming does it scale?
>>>>
>>>> Regards
>>>> Jeetendra
>>>>
>>>
>>>
>>
>>
>
Re: Does Spark streaming support is there with RabbitMQ
Posted by Tathagata Das <td...@databricks.com>.
You could contact the authors of the spark-packages.. maybe that will help?
On Mon, Jul 20, 2015 at 6:41 AM, Jeetendra Gangele <ga...@gmail.com>
wrote:
> Thanks Todd,
>
> I m not sure whether somebody has used it or not. can somebody confirm if
> this integrate nicely with Spark streaming?
>
>
>
> On 20 July 2015 at 18:43, Todd Nist <ts...@gmail.com> wrote:
>
>> There is one package available on the spark-packages site,
>>
>> http://spark-packages.org/package/Stratio/RabbitMQ-Receiver
>>
>> The source is here:
>>
>> https://github.com/Stratio/RabbitMQ-Receiver
>>
>> Not sure that meets your needs or not.
>>
>> -Todd
>>
>> On Mon, Jul 20, 2015 at 8:52 AM, Jeetendra Gangele <ga...@gmail.com>
>> wrote:
>>
>>> Does Apache spark support RabbitMQ. I have messages on RabbitMQ and I
>>> want to process them using Apache Spark streaming does it scale?
>>>
>>> Regards
>>> Jeetendra
>>>
>>
>>
>
>
Re: Does Spark streaming support is there with RabbitMQ
Posted by Jeetendra Gangele <ga...@gmail.com>.
Thanks Todd,
I m not sure whether somebody has used it or not. can somebody confirm if
this integrate nicely with Spark streaming?
On 20 July 2015 at 18:43, Todd Nist <ts...@gmail.com> wrote:
> There is one package available on the spark-packages site,
>
> http://spark-packages.org/package/Stratio/RabbitMQ-Receiver
>
> The source is here:
>
> https://github.com/Stratio/RabbitMQ-Receiver
>
> Not sure that meets your needs or not.
>
> -Todd
>
> On Mon, Jul 20, 2015 at 8:52 AM, Jeetendra Gangele <ga...@gmail.com>
> wrote:
>
>> Does Apache spark support RabbitMQ. I have messages on RabbitMQ and I
>> want to process them using Apache Spark streaming does it scale?
>>
>> Regards
>> Jeetendra
>>
>
>
Re: Does Spark streaming support is there with RabbitMQ
Posted by Todd Nist <ts...@gmail.com>.
There is one package available on the spark-packages site,
http://spark-packages.org/package/Stratio/RabbitMQ-Receiver
The source is here:
https://github.com/Stratio/RabbitMQ-Receiver
Not sure that meets your needs or not.
-Todd
On Mon, Jul 20, 2015 at 8:52 AM, Jeetendra Gangele <ga...@gmail.com>
wrote:
> Does Apache spark support RabbitMQ. I have messages on RabbitMQ and I want
> to process them using Apache Spark streaming does it scale?
>
> Regards
> Jeetendra
>