You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "vinoyang (JIRA)" <ji...@apache.org> on 2019/05/15 07:12:00 UTC
[jira] [Commented] (FLINK-11782) Enhance TaskManager log
visualization by listing all log files for Flink web UI
[ https://issues.apache.org/jira/browse/FLINK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840111#comment-16840111 ]
vinoyang commented on FLINK-11782:
----------------------------------
Still want to know your opinions about this feature, listing the log files for TaskManager on Flink web UI.
For the rolling logging strategy, it is very helpful. cc [~Zentol] [~till.rohrmann]
> Enhance TaskManager log visualization by listing all log files for Flink web UI
> -------------------------------------------------------------------------------
>
> Key: FLINK-11782
> URL: https://issues.apache.org/jira/browse/FLINK-11782
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Web Frontend
> Reporter: vinoyang
> Assignee: vinoyang
> Priority: Major
> Attachments: flink-web-ui-taskmanager-log-files-2.png, flink-web-ui-taskmanager-log-files.png, yarn-container-log-files.png
>
>
> Currently, there are some features to be enhanced when Flink web UI displays TaskManager logs:
> 1) Flink web UI can only display the log of task manager and stdout;
> 2) Flink web UI can only display the latest one log file;
> In the log folder of a Task Manager, we usually have more files, including GC log files, multiple files generated based on the rolling rules of the logging framework (time or log file size), user's business log files (We internally implemented the separation of Flink from the user log). For these files, the current Flink web UI cannot be displayed.
> I personally suggest that we can refer to the way YARN displays the container's log (see attachment 1), first list all the log files (see attachment 2), and then click to display the files of these logs.
>
> This feature can be independent or part of the log separation (see FLINK-11202).
> It has now been added to the design documentation for Log separation: https://docs.google.com/document/d/1TTYAtFoTWaGCveKDZH394FYdRyNyQFnVoW5AYFvnr5I/edit?usp=sharing
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)