You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Haohui Mai (JIRA)" <ji...@apache.org> on 2014/11/14 02:31:34 UTC

[jira] [Updated] (HDFS-7270) Implementing congestion control in writing pipeline

     [ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Haohui Mai updated HDFS-7270:
-----------------------------
    Attachment: HDFS-7270.000.patch

> Implementing congestion control in writing pipeline
> ---------------------------------------------------
>
>                 Key: HDFS-7270
>                 URL: https://issues.apache.org/jira/browse/HDFS-7270
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: datanode
>            Reporter: Haohui Mai
>            Assignee: Haohui Mai
>         Attachments: HDFS-7270.000.patch
>
>
> When a client writes to HDFS faster than the disk bandwidth of the DNs, it  saturates the disk bandwidth and put the DNs unresponsive. The client only backs off by aborting / recovering the pipeline, which leads to failed writes and unnecessary pipeline recovery.
> This jira proposes to add explicit congestion control mechanisms in the writing pipeline. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)