Apache Storm integration with Spring

[Ankur Garg <an...@gmail.com>]

Hi All ,

Sometime back I was working with Apache Storm in one of our  Projects .

Basically , the need was to run a topology over a Storm Cluster which
consumes data from Rabbit Mq and does some processing over it .

Processing also involved ingesting the feed from Rabbit Mq to some
relational and Non Relation Database  among others .

Traditionally , we heavily use Spring and other Frameworks by Pivotal in
our projects . For Example :-  To make connections and ingest Data into
mySql and Mongo we used Spring Data Jpa .

Similarly to read feeds from RabbitMq ,we used Spring AMQP framework which
internally used RabbitMq Java Client .

Considering  the above , we thought of using Spring  with Storm  to
accomplish all the above things .

Unfortunately at the moment , there is no real integration of Storm and
Spring documented anywhere.

There are some examples present in github and else where (for ex
https://github.com/granthenke/storm-spring-sample) but all of them use
Spring to Create and Inject Topology Definitions where as our ask was to
create a Spring Context which holds all information about database
Connections , broker Connections and some bean injections) and is available
throughout the lifecycle of a Topology .

Finally , I found a way to create context and do integration with Spring
Framework .

I have started a short project (
https://github.com/ankurgarg1986/Spring-Storm) to pen down our integration
so that it can be useful to other developers who wish to use Apache Storm
with Spring.

Please share your thoughts and use-cases (if any) so that I can use them to
drive this short project .

Thanks
Ankur