You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Rajini Sivaram (Jira)" <ji...@apache.org> on 2020/03/05 10:58:00 UTC

[jira] [Created] (KAFKA-9662) Throttling system test fails when messages are produced before consumer starts up

Rajini Sivaram created KAFKA-9662:
-------------------------------------

             Summary: Throttling system test fails when messages are produced before consumer starts up
                 Key: KAFKA-9662
                 URL: https://issues.apache.org/jira/browse/KAFKA-9662
             Project: Kafka
          Issue Type: Bug
          Components: system tests
            Reporter: Rajini Sivaram
            Assignee: Rajini Sivaram
             Fix For: 2.5.0


The tests produces large records using producer performance tool and then starts another validating produce/consume loop for integer records. Consumer starts consuming from the latest offset to avoid consuming the large records produced earlier by the first producer. If the second producer starts producing records before the consumer has reset its offset to latest offset, then the consumer misses some records produced and the test fails:

{quote}

AssertionError: 762 acked message did not make it to the Consumer. They are: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19...plus 742 more. Total Acked: 174330, Total Consumed: 173568. We validated that the first 762 of these missing messages correctly made it into Kafka's data files. This suggests they were lost on their way to the consumer.

{quote}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)