You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Konstantin Shvachko (JIRA)" <ji...@apache.org> on 2014/05/12 02:56:17 UTC

[jira] [Commented] (HDFS-6325) Append should fail if the last block has insufficient number of replicas

    [ https://issues.apache.org/jira/browse/HDFS-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994738#comment-13994738 ] 

Konstantin Shvachko commented on HDFS-6325:
-------------------------------------------

Patch review comments:
# Need to change full-replication to min-replication.
# You should not check sufficient replication if the last block is already under construction.
# JavaDoc comment for isSufficientlyReplicated() is not clear and the comment in the body is redundant.
# The test looks good. I see a few long lines though.

> Append should fail if the last block has insufficient number of replicas
> ------------------------------------------------------------------------
>
>                 Key: HDFS-6325
>                 URL: https://issues.apache.org/jira/browse/HDFS-6325
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: namenode
>    Affects Versions: 2.2.0
>            Reporter: Konstantin Shvachko
>            Assignee: Keith Pak
>         Attachments: HDFS-6325.patch, HDFS-6325_test.patch, appendTest.patch
>
>
> Currently append() succeeds on a file with the last block that has no replicas. But the subsequent updatePipeline() fails as there are no replicas with the exception "Unable to retrieve blocks locations for last block". This leaves the file unclosed, and others can not do anything with it until its lease expires.
> The solution is to check replicas of the last block on the NameNode and fail during append() rather than during updatePipeline().
> How many replicas should be present before NN allows to append? I see two options:
> # min-replication: allow append if the last block is minimally replicated (1 by default)
> # full-replication: allow append if the last block is fully replicated (3 by default)



--
This message was sent by Atlassian JIRA
(v6.2#6252)