[jira] [Commented] (FLINK-3263) Log task statistics on TaskManager

["Stephan Ewen (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-3263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108258#comment-15108258 ] 

Stephan Ewen commented on FLINK-3263:
-------------------------------------

What approach would you use to get these stats per thread?

> Log task statistics on TaskManager
> ----------------------------------
>
>                 Key: FLINK-3263
>                 URL: https://issues.apache.org/jira/browse/FLINK-3263
>             Project: Flink
>          Issue Type: Improvement
>          Components: TaskManager
>    Affects Versions: 1.0.0
>            Reporter: Greg Hogan
>            Assignee: Greg Hogan
>            Priority: Minor
>
> Similar to how memory statistics can be written to the TaskMangers' log files by configuring {{taskmanager.debug.memory.startLogThread}} and {{taskmanager.debug.memory.logIntervalMs}}, it would be useful to have statistics written for each task within a job.
> One use case is to reconstruct progress to analyze why TaskManagers take different amounts of time to process the same quantity of data.
> I envision this being the same statistics which are displayed on the web frontend.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)