[jira] [Commented] (KAFKA-12431) Fetch Request/Response without Topic information

["Peter Sinoros-Szabo (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-12431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17297428#comment-17297428 ] 

Peter Sinoros-Szabo commented on KAFKA-12431:
---------------------------------------------

We did further research and found that those Fetch Request and Responses occasionally contain the topic/partition/offset data.
 # It seems that the client sends out a Fetch Request that contains the proper partition/offset data
 # but in response it gets a response that doesn't contain any topic/partition/offset information.
 # Then the client starts to send those messages that I described above, so there's not topic/partition/offset mentioned.
 # This continues for awhile, both requests and responses are without the topic/partition/offset data.
 # A lot more messages later there is a Fetch Response that does contain the requested topic/partition/offset/message-payload data.
 # And than the whole thing start from the beginning again.

> Fetch Request/Response without Topic information
> ------------------------------------------------
>
>                 Key: KAFKA-12431
>                 URL: https://issues.apache.org/jira/browse/KAFKA-12431
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 2.6.1
>            Reporter: Peter Sinoros-Szabo
>            Priority: Major
>         Attachments: fetch-on-2.4.1.png, fetch-on-2.6.1.png
>
>
> I was running a 6 node Kafka 2.4.1 cluster with protocol and message format version set to 2.4. I wanted to upgrade the cluster to 2.6.1 and after I upgraded the 1st broker to 2.6.1 without any configuration change, I noticed much higher CPU usage on that broker (instead of 25% CPU usage it was  ~350%) and about 3-4x higher network traffic. So I dumped the traffic between the Kafka client and broker and compared it with the traffic of the same broker downgraded to 2.4.1.
> It seems to me that after I upgraded to 2.6.1, the Fetch requests and responses are not complete, it is missing the topics part of the Fetch Request, I don't know for what reason. I guess there should be always a topics part.
> I'll attache a screenshot from these messages.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)