You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "ChenLin (JIRA)" <ji...@apache.org> on 2019/07/27 06:38:00 UTC

[jira] [Created] (KAFKA-8722) In some cases, the crc check does not cause dirty data to be written.

ChenLin created KAFKA-8722:
------------------------------

             Summary: In some cases, the crc check does not cause dirty data to be written.
                 Key: KAFKA-8722
                 URL: https://issues.apache.org/jira/browse/KAFKA-8722
             Project: Kafka
          Issue Type: Improvement
          Components: log
    Affects Versions: 0.10.2.2
            Reporter: ChenLin
             Fix For: 0.10.2.2


In our production environment, when we consume kafka's topic data in an operating program, we found an error:
org.apache.kafka.common.KafkaException: Record for partition rl_dqn_debug_example-49 at offset 2911287689 is invalid, cause: Record is corrupt (stored crc = 3580880396, computed crc = 1701403171)
By looking at the code, I found that in some cases kafka would not verify the data and write it to disk, so we fixed it.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)