You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Todd Lipcon (Created) (JIRA)" <ji...@apache.org> on 2012/01/17 20:29:44 UTC

[jira] [Created] (HDFS-2804) SBN should not mark blocks under-replicated when exiting safemode

SBN should not mark blocks under-replicated when exiting safemode
-----------------------------------------------------------------

                 Key: HDFS-2804
                 URL: https://issues.apache.org/jira/browse/HDFS-2804
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ha, name-node
    Affects Versions: HA branch (HDFS-1623)
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon


In testing on a cluster, I restarted with one fewer datanodes than previously. This caused a few thousand blocks to be under-replicated. Similar to HDFS-2795, I saw the under-replicated blocks on the SBN, slowly decreasing as the replication thread ran. This seems to be because we process the replication queue when exiting safemode, even if in standby mode. It also reports many "missing blocks" in the NN UI which are slowly decreasing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (HDFS-2804) SBN should not mark blocks under-replicated when exiting safemode

Posted by "Todd Lipcon (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon resolved HDFS-2804.
-------------------------------

       Resolution: Fixed
    Fix Version/s: HA branch (HDFS-1623)
     Hadoop Flags: Reviewed

I ran the HA tests with this patch applied and they all passed. Committed to branch, thanks Eli.
                
> SBN should not mark blocks under-replicated when exiting safemode
> -----------------------------------------------------------------
>
>                 Key: HDFS-2804
>                 URL: https://issues.apache.org/jira/browse/HDFS-2804
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha, name-node
>    Affects Versions: HA branch (HDFS-1623)
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: HA branch (HDFS-1623)
>
>         Attachments: hdfs-2804.txt, hdfs-2804.txt
>
>
> In testing on a cluster, I restarted with one fewer datanodes than previously. This caused a few thousand blocks to be under-replicated. Similar to HDFS-2795, I saw the under-replicated blocks on the SBN, slowly decreasing as the replication thread ran. This seems to be because we process the replication queue when exiting safemode, even if in standby mode. It also reports many "missing blocks" in the NN UI which are slowly decreasing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira