[jira] [Created] (YARN-7265) Hadoop Server Log Correlation

["Tanping Wang (JIRA)" <ji...@apache.org>]

Tanping Wang created YARN-7265:
----------------------------------

             Summary: Hadoop Server Log Correlation  
                 Key: YARN-7265
                 URL: https://issues.apache.org/jira/browse/YARN-7265
             Project: Hadoop YARN
          Issue Type: Wish
          Components: log-aggregation
            Reporter: Tanping Wang


Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs..   There are also a lot of different ways can be used to expose the logs, build relationship horizontally to correlate the logs or search the logs by keyword. There is a need for a default and yet convenient  logging analytics mechanism in Hadoop itself that at least covers all the server logs of Hadoop.  This log analytics system can correlate the Hadoop server logs by grouping them by various dimensions including task number, job number or node number etc.   The raw logs with correlation can be easily accessed by the application developer or cluster administrator.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org