You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/02/21 14:39:44 UTC
[jira] [Commented] (FLINK-5645) IOMetrics transfer through
ExecGraph does not work for failed jobs
[ https://issues.apache.org/jira/browse/FLINK-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876068#comment-15876068 ]
ASF GitHub Bot commented on FLINK-5645:
---------------------------------------
GitHub user zentol opened a pull request:
https://github.com/apache/flink/pull/3377
[FLINK-5645] Store accumulators/metrics for canceled/failed tasks
This PR modified the Execution/ExecutionGraph to store transmitted io-metrics/accumulators for canceled/failed tasks. Previously these were only stored for finished tasks. For other tasks they were simply discarded.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zentol/flink 5645_metrics_failed
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/3377.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3377
----
commit 1a68ee62a86de283a1a0210dc637ac65d3860bef
Author: zentol <ch...@apache.org>
Date: 2017-02-21T11:36:17Z
[FLINK-5645] Store accumulators/metrics for canceled/failed tasks
----
> IOMetrics transfer through ExecGraph does not work for failed jobs
> ------------------------------------------------------------------
>
> Key: FLINK-5645
> URL: https://issues.apache.org/jira/browse/FLINK-5645
> Project: Flink
> Issue Type: Bug
> Components: Metrics, Webfrontend
> Affects Versions: 1.2.0, 1.3.0
> Reporter: Chesnay Schepler
> Assignee: Chesnay Schepler
> Priority: Blocker
>
> While a job is running the web-interface polls IO metrics using the MetricFetcher/MetricQueryService. For finished jobs these metrics are stored in the ExecutionGraph; each vertex has an IOMetrics object; basically a snapshot taken when the task was finished.
> For completed jobs this mechanism is working. However, for failed jobs it doesn't; in this case last fetched metrics are displayed.
> This isn't intended behavior and should be fixed.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)