[spark streaming] how to connect to rabbitmq with spark streaming.

[Joris Billen <jo...@bigindustries.be>]

Hi,
I am looking for someone who has made a spark streaming job that connects to rabbitmq.
There is a lot of documentation how to make a connection with a java api (like here: https://www.rabbitmq.com/api-guide.html#connecting) , but I am looking for a recent working example for spark streaming (which will save the incoming data in a Dstream).
Tried so far: this looks close, but throws errors: https://github.com/Stratio/spark-rabbitmq/issues ). Also tried with MQTT (we get an error that the protocal is amqp:// and not tcp:// or ssl://; also noticed that for mqtt the plugin needs to be enabled on the rabbitmq server's side, and since it is 3rd party we dont control this).


Thanks for any input!