You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Daryn Sharp (JIRA)" <ji...@apache.org> on 2018/09/20 15:36:00 UTC

[jira] [Created] (HDFS-13929) DFSClient leaks data streamer sockets

Daryn Sharp created HDFS-13929:
----------------------------------

             Summary: DFSClient leaks data streamer sockets
                 Key: HDFS-13929
                 URL: https://issues.apache.org/jira/browse/HDFS-13929
             Project: Hadoop HDFS
          Issue Type: Bug
    Affects Versions: 2.8.0
            Reporter: Daryn Sharp


Sockets to DNs may linger in the CLOSE_WAIT state which means the remote peer (DN) closed the socket but the local client has not.  The socket does not transition to TIME_WAIT until the java process exits which is indicative of a leaked file descriptor.  Interestingly there is always 1 byte remaining to be read.

{noformat}
$ netstat -tnn|fgrep :1004|fgrep -v EST
tcp        1      0 THISHOST:57158         RANDOMHOST:1004         CLOSE_WAIT  
tcp        1      0 THISHOST:40346         RANDOMHOST:1004         CLOSE_WAIT  
tcp        1      0 THISHOST:45504         RANDOMHOST:1004         CLOSE_WAIT  
tcp        1      0 THISHOST:58958         RANDOMHOST:1004         CLOSE_WAIT  
tcp        1      0 THISHOST:45570         RANDOMHOST:1004         CLOSE_WAIT  
tcp        1      0 THISHOST:46496         RANDOMHOST:1004         CLOSE_WAIT  
tcp        1      0 THISHOST:58944         RANDOMHOST:1004         CLOSE_WAIT  
tcp        1      0 THISHOST:55540         RANDOMHOST:1004         CLOSE_WAIT  
{noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org