[jira] [Created] (YARN-8328) NonAggregatingLogHandler needlessly waits upon shutdown if delayed deletion is scheduled

["Jonathan Eagles (JIRA)" <ji...@apache.org>]

Jonathan Eagles created YARN-8328:
-------------------------------------

             Summary: NonAggregatingLogHandler needlessly waits upon shutdown if delayed deletion is scheduled
                 Key: YARN-8328
                 URL: https://issues.apache.org/jira/browse/YARN-8328
             Project: Hadoop YARN
          Issue Type: Bug
            Reporter: Jonathan Eagles


This happens frequently in the MiniYarnCluster setup where a job completes and then the cluster is shutdown. Often the jobs are scheduled to delay deletion of the log files so that container logs are available for debugging. A scheduled log deletion has a default value of 3 hours. When the NonAggregating LogHandler is stopped it waits 10 seconds for all delayed scheduled log deletions to occur and then shuts down.

A test developer has to make a trade of to either 1) set the log deletion to 0 to have the tests quickly shutdown but get no container logs to debug or 2) keep the log deletion at 3 hours and incur the 10 second timeout for each test suit.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org