You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Tobias Kaymak (JIRA)" <ji...@apache.org> on 2019/03/26 15:01:00 UTC
[jira] [Comment Edited] (BEAM-6648) Metrics not shown in Flink
1.7.1
[ https://issues.apache.org/jira/browse/BEAM-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16801823#comment-16801823 ]
Tobias Kaymak edited comment on BEAM-6648 at 3/26/19 3:00 PM:
--------------------------------------------------------------
The issue is related to the way the Jobmanager fetches the metrics from the Taskmanagers in K8s (Kubernetes) and how that changed in Flink 1.7:
The Flink documentation has an example for a Kubernetes deployment that shows how to launch the Taskmanager so that it's aware of it's address.
[https://ci.apache.org/projects/flink/flink-docs-release-1.7/ops/deployment/kubernetes.html#session-cluster-resource-definitions]
The environment variable on the taskmanager has to be set:
{{name: K8S_POD_IP}}
{{ valueFrom:}}
{{ fieldRef:}}
{{ fieldPath: status.podIP}}
And the taskmanager pod has to be launched with the following argument:
{{ args:}}
{{ - taskmanager}}
{{ - "-Dtaskmanager.host=$(K8S_POD_IP)"}}
was (Author: james-woods):
The issue is related to the way the Jobmanager fetches the metrics from the Taskmanagers in K8s (Kubernetes) and how that changed in Flink 1.7:
The Flink documentation has an example for a Kubernetes deployment that shows how to launch the Taskmanager so that it's aware of it's address.
[https://ci.apache.org/projects/flink/flink-docs-release-1.7/ops/deployment/kubernetes.html#session-cluster-resource-definitions]
The environment variable on the taskmanager has to be set:
{{name: K8S_POD_IP}}
{{ valueFrom:}}
{{ fieldRef:}}
{{ fieldPath: status.podIP}}
And the taskmanager pod has to be launched with the following argument:
{{ args:}}
{{ - taskmanager}}
{{ - "-Dtaskmanager.host=$(K8S_POD_IP)" !image-2019-03-26-15-59-26-725.png!}}
> Metrics not shown in Flink 1.7.1
> --------------------------------
>
> Key: BEAM-6648
> URL: https://issues.apache.org/jira/browse/BEAM-6648
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Affects Versions: 2.10.0
> Reporter: Tobias Kaymak
> Assignee: Maximilian Michels
> Priority: Major
> Fix For: 2.10.0
>
> Attachments: 1.7.2.mov
>
>
> Version 2.10 does not show metrics when a pipeline is running on a Flink 1.7.1, but it works for Flink 1.6.2
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)