[jira] [Resolved] (HDFS-4161) HDFS keeps a thread open for every file writer

["Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE resolved HDFS-4161.
------------------------------------------

       Resolution: Fixed
    Fix Version/s: 1.1.1
     Hadoop Flags: Reviewed

I have committed this.
                
> HDFS keeps a thread open for every file writer
> ----------------------------------------------
>
>                 Key: HDFS-4161
>                 URL: https://issues.apache.org/jira/browse/HDFS-4161
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: hdfs client
>    Affects Versions: 1.0.0
>            Reporter: Suresh Srinivas
>            Assignee: Tsz Wo (Nicholas), SZE
>             Fix For: 1.1.1
>
>         Attachments: h4161_20121108_b-1.patch
>
>
> In 1.0 release DFSClient uses a thread per file writer. In some use cases (dynamic partions in hive) that use a large number of file writers a large number of threads are created. The file writer thread has the following stack:
> {noformat}
> at java.lang.Thread.sleep(Native Method)
> at org.apache.hadoop.hdfs.DFSClient$LeaseChecker.run(DFSClient.java:1462)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> This problem has been fixed in later releases. This jira will post a consolidated patch from various jiras that addresses the issue.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira