You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Kihwal Lee (JIRA)" <ji...@apache.org> on 2015/08/06 19:32:05 UTC

[jira] [Created] (HDFS-8863) The remiaing space check in BlockPlacementPolicyDefault is flawed

Kihwal Lee created HDFS-8863:
--------------------------------

             Summary: The remiaing space check in BlockPlacementPolicyDefault is flawed
                 Key: HDFS-8863
                 URL: https://issues.apache.org/jira/browse/HDFS-8863
             Project: Hadoop HDFS
          Issue Type: Bug
    Affects Versions: 2.6.0
            Reporter: Kihwal Lee
            Priority: Critical


The block placement policy calls {{DatanodeDescriptor#getRemaining(StorageType}}}} to check whether the block is going to fit. Since the method is adding up all remaining spaces, namenode can allocate a new block on a full node. This causes pipeline construction failure and {{abandonBlock}}. If the cluster is nearly full, the client might hit this multiple times and the write can fail permanently.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)