[jira] [Created] (FLINK-11782) Enhance TaskManager log visualization by listing all log files for Flink web UI

["vinoyang (JIRA)" <ji...@apache.org>]

vinoyang created FLINK-11782:
--------------------------------

             Summary: Enhance TaskManager log visualization by listing all log files for Flink web UI
                 Key: FLINK-11782
                 URL: https://issues.apache.org/jira/browse/FLINK-11782
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Web Frontend
            Reporter: vinoyang
            Assignee: vinoyang
         Attachments: flink-web-ui-taskmanager-log-files.png, yarn-container-log-files.png

Currently, there are some features to be enhanced when Flink web UI displays TaskManager logs:

1) Flink web UI can only display the log of task manager and stdout;
2) Flink web UI can only display the latest one log file;

In the log folder of a Task Manager, we usually have more files, including GC log files, multiple files generated based on the rolling rules of the logging framework (time or log file size), user's business log files (We internally implemented the separation of Flink from the user log). For these files, the current Flink web UI cannot be displayed.

I personally suggest that we can refer to the way YARN displays the container's log (see attachment 1), first list all the log files (see attachment 2), and then click to display the files of these logs.

 

This feature can be independent or part of the log separation (see FLINK-11202).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)