You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Adam Antal (JIRA)" <ji...@apache.org> on 2019/07/15 10:12:00 UTC

[jira] [Created] (YARN-9676) Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes

Adam Antal created YARN-9676:
--------------------------------

             Summary: Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes
                 Key: YARN-9676
                 URL: https://issues.apache.org/jira/browse/YARN-9676
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Adam Antal


During the development of the last items of YARN-6875, it was typically difficult to extract information about the internal state of some log aggregation related classes (e.g. {{AppLogAggregatiorImpl}} and {{LogAggregationFileController}}). 

On my fork I added a few more messages to those classes like:
- displaying the number of log aggregation cycles
- displaying the names of the files currently considered for log aggregation by containers
- immediately displaying any exception caught (and sent to the RM in the diagnostic messages) during the log aggregation process.

Those messages were quite useful for debugging if any issue occurs, but otherwise it flooded the NM log file with these messages that are usually not needed. I suggest to add (some of) these messages in DEBUG or TRACE level.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org