[jira] [Created] (KAFKA-1196) java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

["Gerrit Jansen van Vuuren (JIRA)" <ji...@apache.org>]

Gerrit Jansen van Vuuren created KAFKA-1196:
-----------------------------------------------

             Summary: java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33
                 Key: KAFKA-1196
                 URL: https://issues.apache.org/jira/browse/KAFKA-1196
             Project: Kafka
          Issue Type: Bug
          Components: consumer
    Affects Versions: 0.8.0
         Environment: running java 1.7, linux and kafka compiled against scala 2.9.2
            Reporter: Gerrit Jansen van Vuuren
            Assignee: Neha Narkhede


I have 6 topics each with 8 partitions spread over 4 kafka servers.
the servers are 24 core 72 gig ram.

While consuming from the topics I get an IlegalArgumentException and all consumption stops, the error keeps on throwing.

I've tracked it down to FectchResponse.scala line 33

The error happens when the FetchResponsePartitionData object's readFrom method calls:
messageSetBuffer.limit(messageSetSize)

I put in some debug code the the messageSetSize is 671758648, while the buffer.capacity() gives 155733313, for some reason the buffer is smaller than the required message size.

I don't know the consumer code enough to debug this, but I've turned off compression on my producers and now I do not seem to get this message anymore.





--
This message was sent by Atlassian JIRA
(v6.1.5#6160)