Exception in rebalancing | Kafka 1.0.0

[Sameer Kumar <sa...@gmail.com>]

hi all,

Faced this exception yesterday, any possible reasons for the same. At the
same time, one of the machines was restarted in my Kafka Streams cluster
and hence the job ended there.
Detailed exception trace is attached.

I am using Kafka 1.0.0.

2017-11-28 00:07:38 ERROR Kafka010Base:46 - Exception caught in thread
c-7-aq23-000647df-ff25-48de-b92f-02f43988353e-StreamThread-6
java.lang.IllegalStateException: Record's partition does not belong to this
partition-group.
at
org.apache.kafka.streams.processor.internals.PartitionGroup.numBuffered(PartitionGroup.java:156)
at
org.apache.kafka.streams.processor.internals.StreamTask.addRecords(StreamTask.java:545)
at
org.apache.kafka.streams.processor.internals.StreamThread.addRecordsToTasks(StreamThread.java:920)
at
org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:821)
at
org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:774)
at
org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:744)

Regards,
-Sameer.

Re: Exception in rebalancing | Kafka 1.0.0

[Guozhang Wang <wa...@gmail.com>]

Sameer,

Thanks for reporting, it looks similar to the ticket we have resolved some
time ago (https://issues.apache.org/jira/browse/KAFKA-5154), note that we
added some check to avoid NPE but instead throws a more meaningful
exception message, but the root cause maybe the same.

If your Kafka Streams is also using 1.0.0 version as well it may indicate
some corner cases still not fixed; so if that is the case, could you create
a JIRA and upload all logs / stack traces you have for us to investigate
into this issue?


Guozhang


On Mon, Nov 27, 2017 at 10:36 PM, Sameer Kumar <sa...@gmail.com>
wrote:

> hi all,
>
> Faced this exception yesterday, any possible reasons for the same. At the
> same time, one of the machines was restarted in my Kafka Streams cluster
> and hence the job ended there.
> Detailed exception trace is attached.
>
> I am using Kafka 1.0.0.
>
> 2017-11-28 00:07:38 ERROR Kafka010Base:46 - Exception caught in thread
> c-7-aq23-000647df-ff25-48de-b92f-02f43988353e-StreamThread-6
> java.lang.IllegalStateException: Record's partition does not belong to
> this partition-group.
> at org.apache.kafka.streams.processor.internals.
> PartitionGroup.numBuffered(PartitionGroup.java:156)
> at org.apache.kafka.streams.processor.internals.StreamTask.addRecords(
> StreamTask.java:545)
> at org.apache.kafka.streams.processor.internals.StreamThread.
> addRecordsToTasks(StreamThread.java:920)
> at org.apache.kafka.streams.processor.internals.StreamThread.runOnce(
> StreamThread.java:821)
> at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(
> StreamThread.java:774)
> at org.apache.kafka.streams.processor.internals.
> StreamThread.run(StreamThread.java:744)
>
> Regards,
> -Sameer.
>



-- 
-- Guozhang