You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "PoAn Yang (Jira)" <ji...@apache.org> on 2025/11/28 05:24:00 UTC

[jira] [Created] (KAFKA-19936) ReplicaManager counts duplicated records to BytesInPerSec and MessagesInPerSec metric

PoAn Yang created KAFKA-19936:
---------------------------------

             Summary: ReplicaManager counts duplicated records to BytesInPerSec and MessagesInPerSec metric
                 Key: KAFKA-19936
                 URL: https://issues.apache.org/jira/browse/KAFKA-19936
             Project: Kafka
          Issue Type: Bug
            Reporter: PoAn Yang
            Assignee: PoAn Yang


For an idempotent producer, duplicated records are not written to disk; however, they still contribute to the {{BytesInPerSec}} and {{MessagesInPerSec}} metrics.

1. If the records are duplicated, UnifiedLog skips these messages.

[https://github.com/apache/kafka/blob/d27d90ccb3b2b98e02de42afd50910fbbbc162d0/storage/src/main/java/org/apache/kafka/storage/internals/log/UnifiedLog.java#L1221-L1234]

2. ReplicaManager counts result from Partition#appendRecordsToLeader to metrics.

[https://github.com/apache/kafka/blob/d27d90ccb3b2b98e02de42afd50910fbbbc162d0/core/src/main/scala/kafka/server/ReplicaManager.scala#L1429-L1437]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)