You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Brandon Li (JIRA)" <ji...@apache.org> on 2013/10/15 07:46:43 UTC

[jira] [Created] (HDFS-5364) Add OpenFileCtx cache

Brandon Li created HDFS-5364:
--------------------------------

             Summary: Add OpenFileCtx cache
                 Key: HDFS-5364
                 URL: https://issues.apache.org/jira/browse/HDFS-5364
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Brandon Li
            Assignee: Brandon Li


NFS gateway can run out of memory when the stream timeout is set to a relatively long period(e.g., >1 minute) and user uploads thousands of files in parallel.  Each stream DFSClient creates a DataStreamer thread, and will eventually run out of memory by creating too many threads.

NFS gateway should have a OpenFileCtx cache to limit the total opened files. 



--
This message was sent by Atlassian JIRA
(v6.1#6144)