AMQP extension for Apache Spark Streaming (messaging/IoT)

[Paolo Patierno <pp...@live.com>]

Hi all,

I'm working on an AMQP extension for Apache Spark Streaming, developing a reliable receiver for that. 

After
 MQTT support (I see it in the Apache Bahir repository), another messaging/IoT protocol 
could be very useful for the Apache Spark Streaming ecosystem. Out there a lot of broker (with "store and forward" mechanism) support AMQP as first citizen protocol other than the Apache Qpid Dispatch Router that is based on that for message routing.
Currently the source code is in my own GitHub account and it's in a early stage; the first step was just having something working end-to-end. I'm going to add feature like QoS and flow control in AMQP terms very soon. I was inspired by the spark-packages directories structure using Scala (as main language) and SBT (as build tool).

https://github.com/ppatierno/dstream-amqp

What do 
you think about that ?

Looking forward to hear from you.

Thanks,
Paolo.