Spark streaming communication with different versions of kafka

[Prabhu GS <pr...@thedatateam.in>]

Hi,

I would like to know if the same spark streaming job can consume from kafka
0.8.1 and write the data to kafka 0.9. Just trying to replicate the kafka
server.

Yes, Kafka's MirrorMaker can be used to replicate, but was curious to know
if that can be achieved by spark streaming.

Please share your thoughts

-- 
Prabhu

Re: Spark streaming communication with different versions of kafka

[Cody Koeninger <co...@koeninger.org>]

Kafka consumers should be backwards compatible with kafka brokers, so
at the very least you should be able to use the
streaming-spark-kafka-0-10 to do what you're talking about.

On Tue, Oct 25, 2016 at 4:30 AM, Prabhu GS <pr...@thedatateam.in> wrote:
> Hi,
>
> I would like to know if the same spark streaming job can consume from kafka
> 0.8.1 and write the data to kafka 0.9. Just trying to replicate the kafka
> server.
>
> Yes, Kafka's MirrorMaker can be used to replicate, but was curious to know
> if that can be achieved by spark streaming.
>
> Please share your thoughts
>
> --
> Prabhu
>

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org

Spark streaming communication with InfluxDB

[Gioacchino <gi...@gmail.com>]

Hi,


I wouild like to know if there is code example to write data in InfluxDB 
from Spark Streaming in Scala / Python.


Thanks in advance

Gioacchino


---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org