You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Fabian Paul (Jira)" <ji...@apache.org> on 2022/03/07 08:31:00 UTC

[jira] [Closed] (FLINK-26126) Sink V2 will cause error numRecordsOut metric

     [ https://issues.apache.org/jira/browse/FLINK-26126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Fabian Paul closed FLINK-26126.
-------------------------------

> Sink V2 will cause error numRecordsOut metric
> ---------------------------------------------
>
>                 Key: FLINK-26126
>                 URL: https://issues.apache.org/jira/browse/FLINK-26126
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / Common, Connectors / Kafka
>    Affects Versions: 1.15.0
>            Reporter: Hang Ruan
>            Assignee: Jing Ge
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 1.15.0
>
>
> We found that the new sink v2 interface will have a wrong numRecordsOut metric for the sink writers. We send a fixed number of records to the source, but the numRecordsOut of the sink continues to increase by the time.
> The problem lies in the method `emitCommittables` in the class `SinkWriterOperator`.  The field `output` in its parent class `AbstractStreamOperator` uses the same counter object as the `KafkaWriter`. It will cause the numRecordsOut increasing when doing the checkpoint. 
> I found this problem when we implement the metric test in the testframe, now I disable this metric test in the [PR|https://github.com/apache/flink/pull/18496] We could reopen this test case after the fix.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)