You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Zhanghao Chen (Jira)" <ji...@apache.org> on 2023/12/24 12:25:00 UTC
[jira] [Comment Edited] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17800174#comment-17800174 ]
Zhanghao Chen edited comment on FLINK-33681 at 12/24/23 12:24 PM:
------------------------------------------------------------------
After further investigation, it turned out to be a bug introduced by FLINK-30536, which changed the way to count task-level I/O metrics and accidentally stopped reusing source/sink-writer operator I/O metrics for task I/O metrics. Converting the issue to a bug.
was (Author: zhanghao chen):
After further investigation, it turned out that it is a bug introduced by [FLINK-30536|https://issues.apache.org/jira/browse/FLINK-30536], which changed the way to count task-level I/O metrics and accidentally stopped reusing source/sink-writer operator I/O metrics for task I/O metrics. Converting the issue to a bug.
> Display source/sink numRecordsIn/Out & numBytesIn/Out on UI
> -----------------------------------------------------------
>
> Key: FLINK-33681
> URL: https://issues.apache.org/jira/browse/FLINK-33681
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Metrics
> Affects Versions: 1.18.0, 1.17.2
> Reporter: Zhanghao Chen
> Priority: Major
> Attachments: image-2023-11-29-13-26-15-176.png
>
>
> Currently, the numRecordsIn & numBytesIn metrics for sources and the numRecordsOut & numBytesOut metrics for sinks are always 0 on the Flink web dashboard.
> [FLINK-11576|https://issues.apache.org/jira/browse/FLINK-11576] brings us these metrics on the opeartor level, but it does not integrate them on the task level. On the other hand, the summay metrics on the job overview page is based on the task level I/O metrics. As a result, even though new connectors supporting FLIP-33 metrics will report operator-level I/O metrics, we still cannot see the metrics on dashboard.
> This ticket serves as an umbrella issue to integrate standard source/sink I/O metrics with the corresponding task I/O metrics.
> !image-2023-11-29-13-26-15-176.png|width=590,height=252!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)