[jira] [Created] (KAFKA-15603) kafka-dump-log --offsets-decoder should handle parsing errors

["David Jacot (Jira)" <ji...@apache.org>]

David Jacot created KAFKA-15603:
-----------------------------------

             Summary: kafka-dump-log --offsets-decoder should handle parsing errors
                 Key: KAFKA-15603
                 URL: https://issues.apache.org/jira/browse/KAFKA-15603
             Project: Kafka
          Issue Type: Bug
            Reporter: David Jacot


I needed to dump an __consumer_offset partition so I used `kafka-dump-log --offsets-decoder --files <path>` to do it but I got the following error:

 
Exception in thread "main" org.apache.kafka.common.protocol.types.SchemaException: Buffer underflow while parsing consumer protocol's header
	at org.apache.kafka.clients.consumer.internals.ConsumerProtocol.deserializeVersion(ConsumerProtocol.java:72)
	at org.apache.kafka.clients.consumer.internals.ConsumerProtocol.deserializeAssignment(ConsumerProtocol.java:179)
	at kafka.coordinator.group.GroupMetadataManager$.$anonfun$parseGroupMetadata$2(GroupMetadataManager.scala:1562)
	at kafka.coordinator.group.GroupMetadataManager$.parseGroupMetadata(GroupMetadataManager.scala:1560)
	at kafka.coordinator.group.GroupMetadataManager$.formatRecordKeyAndValue(GroupMetadataManager.scala:1526)
	at kafka.tools.DumpLogSegments$OffsetsMessageParser.parse(DumpLogSegments.scala:416)
	at kafka.tools.DumpLogSegments$.$anonfun$dumpLog$2(DumpLogSegments.scala:327)
	at kafka.tools.DumpLogSegments$.$anonfun$dumpLog$2$adapted(DumpLogSegments.scala:285)
	at scala.collection.IterableOnceOps.foreach(IterableOnce.scala:575)
	at scala.collection.IterableOnceOps.foreach$(IterableOnce.scala:573)
	at scala.collection.AbstractIterable.foreach(Iterable.scala:933)
	at kafka.tools.DumpLogSegments$.$anonfun$dumpLog$1(DumpLogSegments.scala:285)
	at kafka.tools.DumpLogSegments$.$anonfun$dumpLog$1$adapted(DumpLogSegments.scala:282)
	at scala.collection.IterableOnceOps.foreach(IterableOnce.scala:575)
	at scala.collection.IterableOnceOps.foreach$(IterableOnce.scala:573)
	at scala.collection.AbstractIterable.foreach(Iterable.scala:933)
	at kafka.tools.DumpLogSegments$.dumpLog(DumpLogSegments.scala:282)
	at kafka.tools.DumpLogSegments$.$anonfun$main$1(DumpLogSegments.scala:70)
	at kafka.tools.DumpLogSegments$.main(DumpLogSegments.scala:61)
	at kafka.tools.DumpLogSegments.main(DumpLogSegments.scala)
Caused by: java.nio.BufferUnderflowException
	at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:707)
	at java.base/java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:383)
	at org.apache.kafka.clients.consumer.internals.ConsumerProtocol.deserializeVersion(ConsumerProtocol.java:70)
	... 19 more
The issue is that it is never guaranteed that the metadata associated with each member in a consumer group really follow the format used by the official Apache Kafka Consumer. They may have another format and use the same protocol type.

I think that it would be better to handle those errors. No being able to dump a segment is really annoying.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)