You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Nigel Daley (JIRA)" <ji...@apache.org> on 2007/03/10 00:10:09 UTC

[jira] Created: (HADOOP-1106) Number of DataNodes less than target replication causes NameNode WARN message every millisecond

Number of DataNodes less than target replication causes NameNode WARN message every millisecond
-----------------------------------------------------------------------------------------------

                 Key: HADOOP-1106
                 URL: https://issues.apache.org/jira/browse/HADOOP-1106
             Project: Hadoop
          Issue Type: Bug
          Components: dfs
    Affects Versions: 0.12.0
            Reporter: Nigel Daley
             Fix For: 0.13.0


When I startup a 4 DataNode cluster that already contains files with a target replication of 3, but 2 of the DataNodes fail to come online (ie. there are fewer DataNodes then the target replication), I get the following output in the NameNode log every millisecond or less, continued forever:

2007-03-09 22:45:22,848 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
2007-03-09 22:45:22,849 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
2007-03-09 22:45:22,850 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
2007-03-09 22:45:22,851 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
2007-03-09 22:45:22,852 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
2007-03-09 22:45:22,852 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
2007-03-09 22:45:22,853 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
2007-03-09 22:45:22,853 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
2007-03-09 22:45:22,854 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1106) Number of DataNodes less than target replication causes NameNode WARN message every millisecond

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley updated HADOOP-1106:
----------------------------------

    Priority: Blocker  (was: Major)

> Number of DataNodes less than target replication causes NameNode WARN message every millisecond
> -----------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1106
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1106
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>            Priority: Blocker
>             Fix For: 0.13.0
>
>
> When I startup a 4 DataNode cluster that already contains files with a target replication of 3, but 2 of the DataNodes fail to come online (ie. there are fewer DataNodes then the target replication), I get the following output in the NameNode log every millisecond or less, continued forever:
> 2007-03-09 22:45:22,848 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,849 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,850 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,851 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,852 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,852 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,853 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,853 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,854 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-1106) Number of DataNodes less than target replication causes NameNode WARN message every millisecond

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12495686 ] 

Hairong Kuang commented on HADOOP-1106:
---------------------------------------

I created a file with a replication factor of 3 on a 2-node dfs cluster, but was not able to reproduce the error. Nigel, could you please check if I miss anything?

> Number of DataNodes less than target replication causes NameNode WARN message every millisecond
> -----------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1106
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1106
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Assigned To: Hairong Kuang
>            Priority: Blocker
>             Fix For: 0.13.0
>
>
> When I startup a 4 DataNode cluster that already contains files with a target replication of 3, but 2 of the DataNodes fail to come online (ie. there are fewer DataNodes then the target replication), I get the following output in the NameNode log every millisecond or less, continued forever:
> 2007-03-09 22:45:22,848 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,849 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,850 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,851 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,852 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,852 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,853 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,853 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,854 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HADOOP-1106) Number of DataNodes less than target replication causes NameNode WARN message every millisecond

Posted by "Hairong Kuang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hairong Kuang reassigned HADOOP-1106:
-------------------------------------

    Assignee: Hairong Kuang

> Number of DataNodes less than target replication causes NameNode WARN message every millisecond
> -----------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1106
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1106
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Assigned To: Hairong Kuang
>            Priority: Blocker
>             Fix For: 0.13.0
>
>
> When I startup a 4 DataNode cluster that already contains files with a target replication of 3, but 2 of the DataNodes fail to come online (ie. there are fewer DataNodes then the target replication), I get the following output in the NameNode log every millisecond or less, continued forever:
> 2007-03-09 22:45:22,848 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,849 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,850 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,851 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,852 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,852 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,853 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,853 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,854 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-1106) Number of DataNodes less than target replication causes NameNode WARN message every millisecond

Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nigel Daley resolved HADOOP-1106.
---------------------------------

    Resolution: Cannot Reproduce

I can't reproduce this anymore either.

> Number of DataNodes less than target replication causes NameNode WARN message every millisecond
> -----------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-1106
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1106
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.12.0
>            Reporter: Nigel Daley
>         Assigned To: Hairong Kuang
>            Priority: Blocker
>             Fix For: 0.13.0
>
>
> When I startup a 4 DataNode cluster that already contains files with a target replication of 3, but 2 of the DataNodes fail to come online (ie. there are fewer DataNodes then the target replication), I get the following output in the NameNode log every millisecond or less, continued forever:
> 2007-03-09 22:45:22,848 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,849 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,850 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,851 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,852 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,852 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,853 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,853 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2
> 2007-03-09 22:45:22,854 WARN org.apache.hadoop.fs.FSNamesystem: Not able to place enough replicas, still in need of 2

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.