You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2015/05/06 05:37:42 UTC

[jira] [Updated] (HDFS-7265) Use a throttler for replica write in datanode

     [ https://issues.apache.org/jira/browse/HDFS-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Allen Wittenauer updated HDFS-7265:
-----------------------------------
    Labels: BB2015-05-TBR  (was: )

> Use a throttler for replica write in datanode
> ---------------------------------------------
>
>                 Key: HDFS-7265
>                 URL: https://issues.apache.org/jira/browse/HDFS-7265
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Tsz Wo Nicholas Sze
>              Labels: BB2015-05-TBR
>         Attachments: h7265_20141018.patch
>
>
> BlockReceiver process packets in BlockReceiver.receivePacket() as follows
> # read from socket
> # enqueue the ack
> # write to downstream
> # write to disk
> The above steps is repeated for each packet in a single thread.  When there are a lot of concurrent writes in a datanode, the write time in #4 becomes very long.  As a result, it leads to SocketTimeoutException since it cannot read from the socket for a long time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)