You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jiangjie Qin (Jira)" <ji...@apache.org> on 2024/05/28 21:05:00 UTC
[jira] [Commented] (FLINK-33681) Display source/sink numRecordsIn/Out & numBytesIn/Out on UI
[ https://issues.apache.org/jira/browse/FLINK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17850176#comment-17850176 ]
Jiangjie Qin commented on FLINK-33681:
--------------------------------------
[~Zhanghao Chen] Thanks for firing the ticket. The solution sounds good to me. Are you interested in authoring the patch? I am happy to review.
BTW, technically speaking this is a user sensible behavior change. So a FLIP would be required. It is probably going to be a quick FLIP, though.
> Display source/sink numRecordsIn/Out & numBytesIn/Out on UI
> -----------------------------------------------------------
>
> Key: FLINK-33681
> URL: https://issues.apache.org/jira/browse/FLINK-33681
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Metrics
> Affects Versions: 1.18.0, 1.17.2
> Reporter: Zhanghao Chen
> Priority: Major
> Labels: pull-request-available
> Attachments: screenshot-20231224-195605-1.png, screenshot-20231225-120421.png
>
>
> Currently, the numRecordsIn & numBytesIn metrics for sources and the numRecordsOut & numBytesOut metrics for sinks are always 0 on the Flink web dashboard.
> FLINK-11576 brings us these metrics on the opeartor level, but it does not integrate them on the task level. On the other hand, the summay metrics on the job overview page is based on the task level I/O metrics. As a result, even though new connectors supporting FLIP-33 metrics will report operator-level I/O metrics, we still cannot see the metrics on dashboard.
> This ticket serves as an umbrella issue to integrate standard source/sink I/O metrics with the corresponding task I/O metrics.
> !screenshot-20231224-195605-1.png|width=608,height=333!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)