You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jeyhun Karimov <je...@gmail.com> on 2016/06/13 19:27:31 UTC
WordCount example errors
Hi Community,
I am new to kafka-streams and trying to run WordCount example.
I get this error whatever I do:
Exception in thread "StreamThread-1"
org.apache.kafka.common.protocol.types.SchemaException: Error reading field
'topic_metadata': Error reading array of size 1209204, only 46 bytes
available
at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
at org.apache.kafka.clients.NetworkClient.parseResponse(
NetworkClient.java:380)
at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(
NetworkClient.java:449)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(
ConsumerNetworkClient.java:360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
ConsumerNetworkClient.java:224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
ConsumerNetworkClient.java:192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
ConsumerNetworkClient.java:163)
at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(
AbstractCoordinator.java:179)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(
KafkaConsumer.java:973)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(
KafkaConsumer.java:937)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(
StreamThread.java:295)
at org.apache.kafka.streams.processor.internals.StreamThread.run(
StreamThread.java:218)
I am running exactly the same code WordCountDemo from github. I downloaded
all libraries, build with gradle for eclipse, imported them to eclipse and
run from there.
I initialized the zookeper and kafka-server and created kafka brooker as
described in http://docs.confluent.io/3.0.0/streams/quickstart.html.
I am using Eclipse Scala IDE 3.0 .
Cheers
Jeyhun
--
-Cheers
Jeyhun
Re: WordCount example errors
Posted by Michael Noll <mi...@confluent.io>.
Jeyhun,
just to confirm for you: Kafka Streams only works with Kafka 0.10 brokers
[1].
Best,
Michael
[1]
http://docs.confluent.io/3.0.0/streams/faq.html#can-i-use-kafka-streams-with-kafka-clusters-running-0-9-0-8-or-0-7
On Tue, Jun 14, 2016 at 3:03 PM, Jeyhun Karimov <je...@gmail.com>
wrote:
> Thanks for reply. I am using the recent version of kafka and streams
> library. I forked them from github. @Peter, yes probably this is due to
> versions.
> The problem was that, I already installed kafka on OSX with brew and when I
> tried to run, probably it linked to that library instead of the one I
> forked from github. I deleted the installed library, now it works both from
> IDE and terminal.
>
> Thanks
>
> On Tue, Jun 14, 2016 at 2:47 PM Peter Davis <da...@gmail.com> wrote:
>
> > This looks like the error that occurs when you use the 0.10 client with
> an
> > 0.9 broker. The broker needs to be upgraded first. Jeyhun, what
> versions
> > are you running?
> >
> > (I sincerely hope this error message will be improved next time there are
> > wire protocol changes!)
> >
> > -Peter
> >
> >
> > > On Jun 14, 2016, at 4:19 AM, Eno Thereska <en...@gmail.com>
> > wrote:
> > >
> > > HI Jeyhun,
> > >
> > > What version of Kafka are you using?
> > >
> > > I haven't run this using Eclipse, but could you try building and
> running
> > from the command line (instead of from within Eclipse) as described in
> that
> > quickstart document? Does that work?
> > >
> > > Thanks
> > > Eno
> > >
> > >> On 13 Jun 2016, at 20:27, Jeyhun Karimov <je...@gmail.com>
> wrote:
> > >>
> > >> Hi Community,
> > >>
> > >> I am new to kafka-streams and trying to run WordCount example.
> > >> I get this error whatever I do:
> > >>
> > >> Exception in thread "StreamThread-1"
> > >> org.apache.kafka.common.protocol.types.SchemaException: Error reading
> > field
> > >> 'topic_metadata': Error reading array of size 1209204, only 46 bytes
> > >> available
> > >>
> > >> at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
> > >>
> > >> at org.apache.kafka.clients.NetworkClient.parseResponse(
> > >> NetworkClient.java:380)
> > >>
> > >> at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(
> > >> NetworkClient.java:449)
> > >>
> > >> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
> > >>
> > >> at
> > >>
> >
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(
> > >> ConsumerNetworkClient.java:360)
> > >>
> > >> at
> > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
> > >> ConsumerNetworkClient.java:224)
> > >>
> > >> at
> > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
> > >> ConsumerNetworkClient.java:192)
> > >>
> > >> at
> > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
> > >> ConsumerNetworkClient.java:163)
> > >>
> > >> at
> > >>
> >
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(
> > >> AbstractCoordinator.java:179)
> > >>
> > >> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(
> > >> KafkaConsumer.java:973)
> > >>
> > >> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(
> > >> KafkaConsumer.java:937)
> > >>
> > >> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(
> > >> StreamThread.java:295)
> > >>
> > >> at org.apache.kafka.streams.processor.internals.StreamThread.run(
> > >> StreamThread.java:218)
> > >>
> > >>
> > >> I am running exactly the same code WordCountDemo from github. I
> > downloaded
> > >> all libraries, build with gradle for eclipse, imported them to eclipse
> > and
> > >> run from there.
> > >> I initialized the zookeper and kafka-server and created kafka brooker
> as
> > >> described in http://docs.confluent.io/3.0.0/streams/quickstart.html.
> > >>
> > >> I am using Eclipse Scala IDE 3.0 .
> > >>
> > >>
> > >> Cheers
> > >> Jeyhun
> > >> --
> > >> -Cheers
> > >>
> > >> Jeyhun
> > >
> >
> --
> -Cheers
>
> Jeyhun
>
Re: WordCount example errors
Posted by Jeyhun Karimov <je...@gmail.com>.
Thanks for reply. I am using the recent version of kafka and streams
library. I forked them from github. @Peter, yes probably this is due to
versions.
The problem was that, I already installed kafka on OSX with brew and when I
tried to run, probably it linked to that library instead of the one I
forked from github. I deleted the installed library, now it works both from
IDE and terminal.
Thanks
On Tue, Jun 14, 2016 at 2:47 PM Peter Davis <da...@gmail.com> wrote:
> This looks like the error that occurs when you use the 0.10 client with an
> 0.9 broker. The broker needs to be upgraded first. Jeyhun, what versions
> are you running?
>
> (I sincerely hope this error message will be improved next time there are
> wire protocol changes!)
>
> -Peter
>
>
> > On Jun 14, 2016, at 4:19 AM, Eno Thereska <en...@gmail.com>
> wrote:
> >
> > HI Jeyhun,
> >
> > What version of Kafka are you using?
> >
> > I haven't run this using Eclipse, but could you try building and running
> from the command line (instead of from within Eclipse) as described in that
> quickstart document? Does that work?
> >
> > Thanks
> > Eno
> >
> >> On 13 Jun 2016, at 20:27, Jeyhun Karimov <je...@gmail.com> wrote:
> >>
> >> Hi Community,
> >>
> >> I am new to kafka-streams and trying to run WordCount example.
> >> I get this error whatever I do:
> >>
> >> Exception in thread "StreamThread-1"
> >> org.apache.kafka.common.protocol.types.SchemaException: Error reading
> field
> >> 'topic_metadata': Error reading array of size 1209204, only 46 bytes
> >> available
> >>
> >> at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
> >>
> >> at org.apache.kafka.clients.NetworkClient.parseResponse(
> >> NetworkClient.java:380)
> >>
> >> at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(
> >> NetworkClient.java:449)
> >>
> >> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
> >>
> >> at
> >>
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(
> >> ConsumerNetworkClient.java:360)
> >>
> >> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
> >> ConsumerNetworkClient.java:224)
> >>
> >> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
> >> ConsumerNetworkClient.java:192)
> >>
> >> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
> >> ConsumerNetworkClient.java:163)
> >>
> >> at
> >>
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(
> >> AbstractCoordinator.java:179)
> >>
> >> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(
> >> KafkaConsumer.java:973)
> >>
> >> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(
> >> KafkaConsumer.java:937)
> >>
> >> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(
> >> StreamThread.java:295)
> >>
> >> at org.apache.kafka.streams.processor.internals.StreamThread.run(
> >> StreamThread.java:218)
> >>
> >>
> >> I am running exactly the same code WordCountDemo from github. I
> downloaded
> >> all libraries, build with gradle for eclipse, imported them to eclipse
> and
> >> run from there.
> >> I initialized the zookeper and kafka-server and created kafka brooker as
> >> described in http://docs.confluent.io/3.0.0/streams/quickstart.html.
> >>
> >> I am using Eclipse Scala IDE 3.0 .
> >>
> >>
> >> Cheers
> >> Jeyhun
> >> --
> >> -Cheers
> >>
> >> Jeyhun
> >
>
--
-Cheers
Jeyhun
Re: WordCount example errors
Posted by Peter Davis <da...@gmail.com>.
This looks like the error that occurs when you use the 0.10 client with an 0.9 broker. The broker needs to be upgraded first. Jeyhun, what versions are you running?
(I sincerely hope this error message will be improved next time there are wire protocol changes!)
-Peter
> On Jun 14, 2016, at 4:19 AM, Eno Thereska <en...@gmail.com> wrote:
>
> HI Jeyhun,
>
> What version of Kafka are you using?
>
> I haven't run this using Eclipse, but could you try building and running from the command line (instead of from within Eclipse) as described in that quickstart document? Does that work?
>
> Thanks
> Eno
>
>> On 13 Jun 2016, at 20:27, Jeyhun Karimov <je...@gmail.com> wrote:
>>
>> Hi Community,
>>
>> I am new to kafka-streams and trying to run WordCount example.
>> I get this error whatever I do:
>>
>> Exception in thread "StreamThread-1"
>> org.apache.kafka.common.protocol.types.SchemaException: Error reading field
>> 'topic_metadata': Error reading array of size 1209204, only 46 bytes
>> available
>>
>> at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
>>
>> at org.apache.kafka.clients.NetworkClient.parseResponse(
>> NetworkClient.java:380)
>>
>> at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(
>> NetworkClient.java:449)
>>
>> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
>>
>> at
>> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(
>> ConsumerNetworkClient.java:360)
>>
>> at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
>> ConsumerNetworkClient.java:224)
>>
>> at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
>> ConsumerNetworkClient.java:192)
>>
>> at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
>> ConsumerNetworkClient.java:163)
>>
>> at
>> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(
>> AbstractCoordinator.java:179)
>>
>> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(
>> KafkaConsumer.java:973)
>>
>> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(
>> KafkaConsumer.java:937)
>>
>> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(
>> StreamThread.java:295)
>>
>> at org.apache.kafka.streams.processor.internals.StreamThread.run(
>> StreamThread.java:218)
>>
>>
>> I am running exactly the same code WordCountDemo from github. I downloaded
>> all libraries, build with gradle for eclipse, imported them to eclipse and
>> run from there.
>> I initialized the zookeper and kafka-server and created kafka brooker as
>> described in http://docs.confluent.io/3.0.0/streams/quickstart.html.
>>
>> I am using Eclipse Scala IDE 3.0 .
>>
>>
>> Cheers
>> Jeyhun
>> --
>> -Cheers
>>
>> Jeyhun
>
Re: WordCount example errors
Posted by Eno Thereska <en...@gmail.com>.
HI Jeyhun,
What version of Kafka are you using?
I haven't run this using Eclipse, but could you try building and running from the command line (instead of from within Eclipse) as described in that quickstart document? Does that work?
Thanks
Eno
> On 13 Jun 2016, at 20:27, Jeyhun Karimov <je...@gmail.com> wrote:
>
> Hi Community,
>
> I am new to kafka-streams and trying to run WordCount example.
> I get this error whatever I do:
>
> Exception in thread "StreamThread-1"
> org.apache.kafka.common.protocol.types.SchemaException: Error reading field
> 'topic_metadata': Error reading array of size 1209204, only 46 bytes
> available
>
> at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
>
> at org.apache.kafka.clients.NetworkClient.parseResponse(
> NetworkClient.java:380)
>
> at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(
> NetworkClient.java:449)
>
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
>
> at
> org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(
> ConsumerNetworkClient.java:360)
>
> at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
> ConsumerNetworkClient.java:224)
>
> at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
> ConsumerNetworkClient.java:192)
>
> at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(
> ConsumerNetworkClient.java:163)
>
> at
> org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(
> AbstractCoordinator.java:179)
>
> at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(
> KafkaConsumer.java:973)
>
> at org.apache.kafka.clients.consumer.KafkaConsumer.poll(
> KafkaConsumer.java:937)
>
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(
> StreamThread.java:295)
>
> at org.apache.kafka.streams.processor.internals.StreamThread.run(
> StreamThread.java:218)
>
>
> I am running exactly the same code WordCountDemo from github. I downloaded
> all libraries, build with gradle for eclipse, imported them to eclipse and
> run from there.
> I initialized the zookeper and kafka-server and created kafka brooker as
> described in http://docs.confluent.io/3.0.0/streams/quickstart.html.
>
> I am using Eclipse Scala IDE 3.0 .
>
>
> Cheers
> Jeyhun
> --
> -Cheers
>
> Jeyhun