You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Haopu Wang <HW...@qilinsoft.com> on 2016/09/26 08:40:53 UTC

Can Spark Streaming 2.0 work with Kafka 0.10?

Hi, in the official integration guide, it says "Spark Streaming 2.0.0 is
compatible with Kafka 0.8.2.1."

 

However, in maven repository, I can get
"spark-streaming-kafka-0-10_2.11" which depends on Kafka 0.10.0.0

Is this artifact stable enough? Thank you!

Re: Can Spark Streaming 2.0 work with Kafka 0.10?

Posted by Cody Koeninger <co...@koeninger.org>.

Either artifact should work with 0.10 brokers.  The 0.10 integration has
more features but is still marked experimental.

On Sep 26, 2016 3:41 AM, "Haopu Wang" <HW...@qilinsoft.com> wrote:

> Hi, in the official integration guide, it says "Spark Streaming 2.0.0 is
> compatible with Kafka 0.8.2.1."
>
>
>
> However, in maven repository, I can get "spark-streaming-kafka-0-10_2.11"
> which depends on Kafka 0.10.0.0
>
> Is this artifact stable enough? Thank you!
>
>
>
>
>