You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Julien Tournay (Jira)" <ji...@apache.org> on 2021/10/18 13:00:00 UTC
[jira] [Commented] (BEAM-13074) Metrics are not reported by the
Flink runner
[ https://issues.apache.org/jira/browse/BEAM-13074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17430002#comment-17430002 ]
Julien Tournay commented on BEAM-13074:
---------------------------------------
I think the issue comes from `FlinkMetricContainer`. You can see [here|https://github.com/apache/beam/blob/master/runners/flink/src/main/java/org/apache/beam/runners/flink/metrics/FlinkMetricContainer.java#L64] that `FlinkMetricContainer` has a `private final MetricsContainerStepMap metricsContainer` that is supposed to hold the metrics (`updateMetrics` starts by getting the metrics from `metricsContainer`).
Unless I'm missing something, I don’t see anything actually appending values to `metricsContainer` so no metric can actually be "cached".
Assuming that's indeed the issue, it was introduced by [https://github.com/apache/beam/pull/10415], over 2 years ago.
> Metrics are not reported by the Flink runner
> --------------------------------------------
>
> Key: BEAM-13074
> URL: https://issues.apache.org/jira/browse/BEAM-13074
> Project: Beam
> Issue Type: Improvement
> Components: runner-flink
> Affects Versions: 2.33.0
> Reporter: Julien Tournay
> Priority: P1
>
> When running a job using the Flink runner, metrics are not reported.
> See [https://github.com/jto/beam-flink-broken-metrics] for a minimal example.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)