[jira] Updated: (HADOOP-3071) DFSOutputStream does not close all the sockets

["Raghu Angadi (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raghu Angadi updated HADOOP-3071:
---------------------------------

    Attachment: HADOOP-3071.patch

Attached patch adds {{closeBlockStreams()}}. 

Without this patch there around 200 sockets to DataNodes in CLOSE_WAIT at the end of TestCrcCorruption unit test. With the patch there are no sockets open to DataNodes.

> DFSOutputStream does not close all the sockets
> ----------------------------------------------
>
>                 Key: HADOOP-3071
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3071
>             Project: Hadoop Core
>          Issue Type: Bug
>    Affects Versions: 0.16.0
>            Reporter: Raghu Angadi
>            Assignee: Raghu Angadi
>            Priority: Blocker
>             Fix For: 0.16.2
>
>         Attachments: HADOOP-3071.patch
>
>
> When DFSOutputStream writes to multiple blocks, it closes only the socket opened for the last block. When it is done with writing to one block it should close the socket.
> I noticed this when I was fixing HADOOP-3067. After fixing HADOOP-3067, there were still a lot of sockets open (but not enough to fail the tests). These sockets were used to write to blocks.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.