[jira] [Created] (YARN-5939) Disabling the cache of FileSystem leads to case that never close the FileSystem

["liuxiangwei (JIRA)" <ji...@apache.org>]

liuxiangwei created YARN-5939:
---------------------------------

             Summary: Disabling the cache of FileSystem leads to case that never close the FileSystem
                 Key: YARN-5939
                 URL: https://issues.apache.org/jira/browse/YARN-5939
             Project: Hadoop YARN
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 2.7.3, 2.5.1
            Reporter: liuxiangwei


To use our self-defined FileSystem class, the item of configuration "fs.%s.impl.disable.cache" should set to true.

In YARN's source code, the class named "org.apache.hadoop.yarn.util.FSDownload" use getFileSystem but never close, which leading to file descriptor leak because our self-defined FileSystem class close the file descriptor when the close function is invoked.

My Question below:
1. whether invoking "getFileSystem" but never close is YARN's expected behavior 
2. what should we do in our self-defined FileSystem resolve it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org