You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Janek Bevendorff (Jira)" <ji...@apache.org> on 2022/01/17 14:39:00 UTC

[jira] [Commented] (BEAM-6165) Send metrics to Flink in portable Flink runner

    [ https://issues.apache.org/jira/browse/BEAM-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477255#comment-17477255 ] 

Janek Bevendorff commented on BEAM-6165:
----------------------------------------

I am confused. This is supposed to be fixed, but I cannot get metrics from a Python job to show up in the Flink Web UI. Is there something I'm missing? I retrieve a counter like this:
{code:java}
self.counter = Metrics.counter(self.__class__, 'my_counter'){code}
in my DoFn's {{__init__()}} and then increment it in {{{}process(){}}}:
{code:java}
self.counter.inc()
{code}
It doesn't show up in Flink's Metrics tab.

> Send metrics to Flink in portable Flink runner
> ----------------------------------------------
>
>                 Key: BEAM-6165
>                 URL: https://issues.apache.org/jira/browse/BEAM-6165
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>    Affects Versions: 2.8.0
>            Reporter: Ryan Williams
>            Assignee: Ryan Williams
>            Priority: P2
>              Labels: metrics, portability, portability-flink
>             Fix For: 2.10.0
>
>          Time Spent: 10h
>  Remaining Estimate: 0h
>
> Metrics are sent from the fn harness to runnerĀ in the Python SDK (and likely Java soon), but the portable Flink runner doesn't pass them on to Flink, which it should, so that users can see them in e.g. the Flink UI or via any Flink metrics reporters.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)