You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Rajiv Kurian <ra...@signalfx.com> on 2016/01/13 23:54:25 UTC

Kafka 0.9 client producer compatibility with Kafka 0.8.2 broker

We just upgraded one of our Kafka client producers from 0.8.2 to 0.9. Our
broker is still running 0.8.2. I knew that the new 0.9 consumer requires
the new broker and I was under the impression that the new producer would
still work with the old broker. However this doesn't seem to be the case.

I kept getting this error on my client:

 ERROR [roducer-network-thread | producer-5]
[s.o.a.k.c.producer.internals.Sender ] {}: Uncaught error in kafka producer
I/O thread:

org.apache.kafka.common.protocol.types.SchemaException: Error reading field
'throttle_time_ms': java.nio.BufferUnderflowException

        at
org.apache.kafka.common.protocol.types.Schema.read(Schema.java:71)

        at
org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:464)

        at
org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:279)

        at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:216)

        at
org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:128)

        at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66]


Is this a known problem. My 0.9 client jar is from Maven.


Thanks,

Rajiv

Re: Kafka 0.9 client producer compatibility with Kafka 0.8.2 broker

Posted by Ismael Juma <is...@juma.me.uk>.

Hi Rajiv,

This is expected. Newer broker versions support older client versions, but
newer client versions don't support older broker versions.

Ismael

On Wed, Jan 13, 2016 at 10:54 PM, Rajiv Kurian <ra...@signalfx.com> wrote:

> We just upgraded one of our Kafka client producers from 0.8.2 to 0.9. Our
> broker is still running 0.8.2. I knew that the new 0.9 consumer requires
> the new broker and I was under the impression that the new producer would
> still work with the old broker. However this doesn't seem to be the case.
>
> I kept getting this error on my client:
>
>  ERROR [roducer-network-thread | producer-5]
> [s.o.a.k.c.producer.internals.Sender ] {}: Uncaught error in kafka producer
> I/O thread:
>
> org.apache.kafka.common.protocol.types.SchemaException: Error reading field
> 'throttle_time_ms': java.nio.BufferUnderflowException
>
>         at
> org.apache.kafka.common.protocol.types.Schema.read(Schema.java:71)
>
>         at
>
> org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:464)
>
>         at
> org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:279)
>
>         at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:216)
>
>         at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:128)
>
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66]
>
>
> Is this a known problem. My 0.9 client jar is from Maven.
>
>
> Thanks,
>
> Rajiv
>