spout for rabbitmq

[Yuheng Du <yu...@clemson.edu>]

Hi,

Does anyone use rabbitmq as a spout?

I just begin to use storm and I want to integrate it with rabbitmq. Can
anyone provide a sample code to implement the backtype.storm.spout.Scheme
to deserialize a RabbitMQ message payload?

A simple example would be of great help. I am confused about this part. I
am using json style message in my rabbitmq payload.

Thanks.


best,

Yuheng

Re: spout for rabbitmq

[Yuheng Du <yu...@gmail.com>]

Where can I find an implementation example of a payloadScheme, for example,
the "SimpleJSONScheme"?

Do I have to know each field name of my rabbitmq message in order to
implement this Scheme class? What if the rabbitmq data is heterogeneous?

Thanks.

On Thu, Oct 30, 2014 at 12:40 PM, Yuheng Du <yu...@gmail.com>
wrote:

> Thank you. I have been walking through the material in
> https://github.com/ppat/storm-rabbitmq and I am not sure how to implement
> the "Scheme" class. I know I need a custom scheme to use RabbitMQSpout.
>
> Can I use RabbitMQMessageScheme directly? Do I have to implement any
> functions in RabbitMQMessageScheme.java?
>
> Thanks for help.
>
> best,
>
> On Thu, Oct 30, 2014 at 11:54 AM, John Connolly <je...@gmail.com>
> wrote:
>
>> We use rabbitmq as a source for spouts pretty extensively. Have a look at
>> https://github.com/ppat/storm-rabbitmq
>>
>> On Thu, Oct 30, 2014 at 10:33 AM, Yuheng Du <yu...@clemson.edu> wrote:
>>
>>> Hi,
>>>
>>> Does anyone use rabbitmq as a spout?
>>>
>>> I just begin to use storm and I want to integrate it with rabbitmq. Can
>>> anyone provide a sample code to implement the backtype.storm.spout.Scheme
>>> to deserialize a RabbitMQ message payload?
>>>
>>> A simple example would be of great help. I am confused about this part.
>>> I am using json style message in my rabbitmq payload.
>>>
>>> Thanks.
>>>
>>>
>>> best,
>>>
>>> Yuheng
>>>
>>
>>
>>
>> --
>> John Connolly
>> Software Engineer
>> twitter.com/johnconnolly
>> foobarmustache.tumblr.com
>>
>
>

Re: spout for rabbitmq

[Yuheng Du <yu...@gmail.com>]

Thank you. I have been walking through the material in
https://github.com/ppat/storm-rabbitmq and I am not sure how to implement
the "Scheme" class. I know I need a custom scheme to use RabbitMQSpout.

Can I use RabbitMQMessageScheme directly? Do I have to implement any
functions in RabbitMQMessageScheme.java?

Thanks for help.

best,

On Thu, Oct 30, 2014 at 11:54 AM, John Connolly <je...@gmail.com> wrote:

> We use rabbitmq as a source for spouts pretty extensively. Have a look at
> https://github.com/ppat/storm-rabbitmq
>
> On Thu, Oct 30, 2014 at 10:33 AM, Yuheng Du <yu...@clemson.edu> wrote:
>
>> Hi,
>>
>> Does anyone use rabbitmq as a spout?
>>
>> I just begin to use storm and I want to integrate it with rabbitmq. Can
>> anyone provide a sample code to implement the backtype.storm.spout.Scheme
>> to deserialize a RabbitMQ message payload?
>>
>> A simple example would be of great help. I am confused about this part. I
>> am using json style message in my rabbitmq payload.
>>
>> Thanks.
>>
>>
>> best,
>>
>> Yuheng
>>
>
>
>
> --
> John Connolly
> Software Engineer
> twitter.com/johnconnolly
> foobarmustache.tumblr.com
>

Re: spout for rabbitmq

[John Connolly <je...@gmail.com>]

We use rabbitmq as a source for spouts pretty extensively. Have a look at
https://github.com/ppat/storm-rabbitmq

On Thu, Oct 30, 2014 at 10:33 AM, Yuheng Du <yu...@clemson.edu> wrote:

> Hi,
>
> Does anyone use rabbitmq as a spout?
>
> I just begin to use storm and I want to integrate it with rabbitmq. Can
> anyone provide a sample code to implement the backtype.storm.spout.Scheme
> to deserialize a RabbitMQ message payload?
>
> A simple example would be of great help. I am confused about this part. I
> am using json style message in my rabbitmq payload.
>
> Thanks.
>
>
> best,
>
> Yuheng
>



-- 
John Connolly
Software Engineer
twitter.com/johnconnolly
foobarmustache.tumblr.com