You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@rocketmq.apache.org by Xin Wang <da...@gmail.com> on 2017/03/23 07:37:44 UTC

RocketMQ Streaming Integration

Hi devs,

I have completed the work for integrating RocketMQ with Apache Storm.
We decided to put it into Storm external after talking with @vingosling.

JIRA: https://issues.apache.org/jira/browse/STORM-2349
PR: https://github.com/apache/storm/pull/2024

Current phase(fetatures included in this PR):

   - RocketMQ Bolt
   - RocketMQ Spout
   - RocketMQ Trident State
   - documents and examples

Next phase(in the plan):
RocketMQ Trident Spout.

This PR is really different from https://github.com/rocketmq/rocketmq-storm.
I completely rewrite the code. Any comments are welcome.


And I also have a plan to integrating RocketMQ with Spark-Streaming.
JIRA: https://issues.apache.org/jira/browse/ROCKETMQ-81
For its location, I think
https://github.com/apache/incubator-rocketmq-externals may be the right
place. If someone is doing the same job, let's work together.


Thanks,

Xin Wang (vesense)

Re: RocketMQ Streaming Integration

Posted by Xin Wang <xi...@apache.org>.

Thanks vongosling. BTW, Integrating with Apache Avro is also in my TODO
list. Here[1] is the Jira created just now. Anyone who is interested in
this, please join me. And let my know yours progress.

[1] https://issues.apache.org/jira/browse/ROCKETMQ-157

- Xin Wang (vesense)

2017-03-27 14:36 GMT+08:00 Von Gosling <vo...@apache.org>:

> Hi XinWang,
>
> Thanks for your great contribution,especailly for the RocketMQ and Storm
> community integration. We will help to review this PR :-)
>
> > 在 2017年3月23日，15:37，Xin Wang <da...@gmail.com> 写道：
> >
> > Hi devs,
> >
> > I have completed the work for integrating RocketMQ with Apache Storm.
> > We decided to put it into Storm external after talking with @vingosling.
> >
> > JIRA: https://issues.apache.org/jira/browse/STORM-2349
> > PR: https://github.com/apache/storm/pull/2024
> >
> > Current phase(fetatures included in this PR):
> >
> >   - RocketMQ Bolt
> >   - RocketMQ Spout
> >   - RocketMQ Trident State
> >   - documents and examples
> >
> > Next phase(in the plan):
> > RocketMQ Trident Spout.
> >
> > This PR is really different from https://github.com/rocketmq/
> rocketmq-storm.
> > I completely rewrite the code. Any comments are welcome.
> >
> >
> > And I also have a plan to integrating RocketMQ with Spark-Streaming.
> > JIRA: https://issues.apache.org/jira/browse/ROCKETMQ-81
> > For its location, I think
> > https://github.com/apache/incubator-rocketmq-externals may be the right
> > place. If someone is doing the same job, let's work together.
> >
> >
> > Thanks,
> >
> > Xin Wang (vesense)
>
>

Re: RocketMQ Streaming Integration

Posted by Von Gosling <vo...@apache.org>.

Hi XinWang,

Thanks for your great contribution,especailly for the RocketMQ and Storm community integration. We will help to review this PR :-)

> 在 2017年3月23日，15:37，Xin Wang <da...@gmail.com> 写道：
> 
> Hi devs,
> 
> I have completed the work for integrating RocketMQ with Apache Storm.
> We decided to put it into Storm external after talking with @vingosling.
> 
> JIRA: https://issues.apache.org/jira/browse/STORM-2349
> PR: https://github.com/apache/storm/pull/2024
> 
> Current phase(fetatures included in this PR):
> 
>   - RocketMQ Bolt
>   - RocketMQ Spout
>   - RocketMQ Trident State
>   - documents and examples
> 
> Next phase(in the plan):
> RocketMQ Trident Spout.
> 
> This PR is really different from https://github.com/rocketmq/rocketmq-storm.
> I completely rewrite the code. Any comments are welcome.
> 
> 
> And I also have a plan to integrating RocketMQ with Spark-Streaming.
> JIRA: https://issues.apache.org/jira/browse/ROCKETMQ-81
> For its location, I think
> https://github.com/apache/incubator-rocketmq-externals may be the right
> place. If someone is doing the same job, let's work together.
> 
> 
> Thanks,
> 
> Xin Wang (vesense)