[jira] [Created] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

["Jason Lowe (JIRA)" <ji...@apache.org>]

Jason Lowe created YARN-8703:
--------------------------------

             Summary: Localized resource may leak on disk if container is killed while localizing
                 Key: YARN-8703
                 URL: https://issues.apache.org/jira/browse/YARN-8703
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
            Reporter: Jason Lowe


If a container is killed while localizing then it releases all of its resources.  If the resource count goes to zero and it is in the DOWNLOADING state then the resource bookkeeping is removed in the resource tracker.  Shortly afterwards the localizer could heartbeat in and report the successful localization of the resource that was just removed.  When the LocalResourcesTrackerImpl receives the LOCALIZED event but does not find the corresponding LocalResource for the event then it simply logs a "localized without a location" warning.  At that point I think the localized resource has been leaked on the disk since the NM has removed bookkeeping for the resource without removing it on disk.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org