You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Haohui Mai (JIRA)" <ji...@apache.org> on 2014/10/20 23:53:33 UTC

[jira] [Created] (HDFS-7270) Implementing congestion control in writing pipeline

Haohui Mai created HDFS-7270:
--------------------------------

             Summary: Implementing congestion control in writing pipeline
                 Key: HDFS-7270
                 URL: https://issues.apache.org/jira/browse/HDFS-7270
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Haohui Mai
            Assignee: Haohui Mai


When a client writes to HDFS faster than the disk bandwidth of the DNs, it  saturates the disk bandwidth and put the DNs unresponsive. The client only backs off by aborting / recovering the pipeline, which leads to failed writes and unnecessary pipeline recovery.

This jira proposes to add explicit congestion control mechanisms in the writing pipeline. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)