You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Michel Hubert <mi...@phact.nl> on 2016/05/09 09:55:21 UTC

Kafka 0.9 and spark-streaming-kafka_2.10

Hi,

I'm thinking of upgdrading our kafka cluster to 0.9.

Will this be a problem for the Spark Streaming + Kafka Direct Approach Integration using artifact spark-streaming-kafka_2.10 (1.6.1)?


groupId = org.apache.spark
artifactId = spark-streaming-kafka_2.10
version = 1.6.1


Because the documentation states:
Kafka: Spark Streaming 1.6.1 is compatible with Kafka 0.8.2.1.


Thanks.

Re: Kafka 0.9 and spark-streaming-kafka_2.10

Posted by Mich Talebzadeh <mi...@gmail.com>.

our Kafka version kafka_2.11-0.9.0.1 works fine with Spark 1.6.1

Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com



On 9 May 2016 at 10:55, Michel Hubert <mi...@phact.nl> wrote:

> Hi,
>
>
>
> I’m thinking of upgdrading our kafka cluster to 0.9.
>
>
>
> Will this be a problem for the Spark Streaming + Kafka Direct Approach
> Integration using artifact spark-streaming-kafka_2.10 (1.6.1)?
>
>
>
>
>
> groupId = org.apache.spark
>
> artifactId = spark-streaming-kafka_2.10
>
> version = 1.6.1
>
>
>
>
>
> Because the documentation states:
>
> *Kafka:* Spark Streaming 1.6.1 is compatible with Kafka *0.8.2.1.*
>
>
>
>
>
> Thanks.
>