[jira] [Commented] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI

["Zhanghao Chen (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800174#comment-17800174 ] 

Zhanghao Chen commented on FLINK-33681:
---------------------------------------

After further investigation, it turned out that it is a bug introduced by [FLINK-30536|https://issues.apache.org/jira/browse/FLINK-30536], which changed the way to count task-level I/O metrics and accidentally stopped reusing source/sink-writer operator I/O metrics for task I/O metrics. Converting the issue to a bug.

> Display source/sink numRecordsIn/Out & numBytesIn/Out on UI
> -----------------------------------------------------------
>
>                 Key: FLINK-33681
>                 URL: https://issues.apache.org/jira/browse/FLINK-33681
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Metrics
>            Reporter: Zhanghao Chen
>            Priority: Major
>         Attachments: image-2023-11-29-13-26-15-176.png
>
>
> Currently, the numRecordsIn & numBytesIn metrics for sources and the numRecordsOut & numBytesOut metrics for sinks are always 0 on the Flink web dashboard.
> [FLINK-11576|https://issues.apache.org/jira/browse/FLINK-11576] brings us these metrics on the opeartor level, but it does not integrate them on the task level. On the other hand, the summay metrics on the job overview page is based on the task level I/O metrics. As a result, even though new connectors supporting FLIP-33 metrics will report operator-level I/O metrics, we still cannot see the metrics on dashboard.
> This ticket serves as an umbrella issue to integrate standard source/sink I/O metrics with the corresponding task I/O metrics. 
> !image-2023-11-29-13-26-15-176.png|width=590,height=252!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)