You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Damien Gasparina (Jira)" <ji...@apache.org> on 2021/07/01 16:35:00 UTC

[jira] [Created] (KAFKA-13024) Kafka Streams is dropping messages with null key during repartition

Damien Gasparina created KAFKA-13024:
----------------------------------------

             Summary: Kafka Streams is dropping messages with null key during repartition
                 Key: KAFKA-13024
                 URL: https://issues.apache.org/jira/browse/KAFKA-13024
             Project: Kafka
          Issue Type: Bug
          Components: streams
    Affects Versions: 2.7.1, 2.8.0
            Reporter: Damien Gasparina


{{KStream.repartition}} is silently filtering messages with null keys. A single topology like {{.stream().repartition().to()}} would filter all messages with null key.

We are adding a filtering before the repartition ([https://github.com/apache/kafka/blob/2.8/streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamImpl.java#L1060-L1064]). It looks like we are doing that because this method is also used for building KTable.

Null key messages are valid for a KStream, it looks like a regression, the previous {{.through()}} was not filtering null key messages.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)