You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "lifa (Jira)" <ji...@apache.org> on 2022/07/11 14:41:00 UTC

[jira] [Updated] (KAFKA-14065) kafka-clients version 2.3.0 can not process lz4 compression type

     [ https://issues.apache.org/jira/browse/KAFKA-14065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

lifa updated KAFKA-14065:
-------------------------
    Description: 
kafka-clients version 2.3.0 can not  process message with  lz4 compression type

*1.set message compression type :lz4*

*2.when consume messages exception happened:*

org.apache.kafka.common.KafkaException: Received exception when fetching the next record from xxx-2-0(your topic and partition). If needed, please seek past the record to continue consumption.
Caused by: org.apache.kafka.common.KafkaException: java.io.IOException: Stream frame descriptor corrupted
Caused by: java.io.IOException: Stream frame descriptor corrupted
    at org.apache.kafka.common.record.KafkaLZ4BlockInputStream.readHeader(KafkaLZ4BlockInputStream.java:132)
    at org.apache.kafka.common.record.KafkaLZ4BlockInputStream.<init>(KafkaLZ4BlockInputStream.java:78)
    at org.apache.kafka.common.record.CompressionType$4.wrapForInput(CompressionType.java:110)
    ... 34 more

  was:
kafka-clients version 2.3.0 can not  process message with  lz4 compression type

set message compression type :lz4
exception :
org.apache.kafka.common.KafkaException: Received exception when fetching the next record from xxx-2-0. If needed, please seek past the record to continue consumption.
Caused by: org.apache.kafka.common.KafkaException: java.io.IOException: Stream frame descriptor corrupted
Caused by: java.io.IOException: Stream frame descriptor corrupted
    at org.apache.kafka.common.record.KafkaLZ4BlockInputStream.readHeader(KafkaLZ4BlockInputStream.java:132)
    at org.apache.kafka.common.record.KafkaLZ4BlockInputStream.<init>(KafkaLZ4BlockInputStream.java:78)
    at org.apache.kafka.common.record.CompressionType$4.wrapForInput(CompressionType.java:110)
    ... 34 more


> kafka-clients version 2.3.0 can not  process lz4 compression type
> -----------------------------------------------------------------
>
>                 Key: KAFKA-14065
>                 URL: https://issues.apache.org/jira/browse/KAFKA-14065
>             Project: Kafka
>          Issue Type: Bug
>          Components: clients
>    Affects Versions: 2.3.0
>            Reporter: lifa
>            Priority: Critical
>
> kafka-clients version 2.3.0 can not  process message with  lz4 compression type
> *1.set message compression type :lz4*
> *2.when consume messages exception happened:*
> org.apache.kafka.common.KafkaException: Received exception when fetching the next record from xxx-2-0(your topic and partition). If needed, please seek past the record to continue consumption.
> Caused by: org.apache.kafka.common.KafkaException: java.io.IOException: Stream frame descriptor corrupted
> Caused by: java.io.IOException: Stream frame descriptor corrupted
>     at org.apache.kafka.common.record.KafkaLZ4BlockInputStream.readHeader(KafkaLZ4BlockInputStream.java:132)
>     at org.apache.kafka.common.record.KafkaLZ4BlockInputStream.<init>(KafkaLZ4BlockInputStream.java:78)
>     at org.apache.kafka.common.record.CompressionType$4.wrapForInput(CompressionType.java:110)
>     ... 34 more



--
This message was sent by Atlassian Jira
(v8.20.10#820010)