You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Suman Sehgal (JIRA)" <ji...@apache.org> on 2009/03/31 13:07:52 UTC

[jira] Created: (HADOOP-5597) create_write operation of nnbench is failing.

create_write operation of nnbench is failing.
---------------------------------------------

                 Key: HADOOP-5597
                 URL: https://issues.apache.org/jira/browse/HADOOP-5597
             Project: Hadoop Core
          Issue Type: Bug
          Components: test
    Affects Versions: 0.20.0
            Reporter: Suman Sehgal


create_write operation of nnbench (org.apache.hadoop.hdfs.NNBench) is not able to create control file. It is failing and displaying following error message:

Exception in thread "main" java.io.IOException: Mkdirs failed to create /<specified-path>/output/control
        at org.apache.hadoop.hdfs.NNBench.createControlFiles(NNBench.java:154)
        at org.apache.hadoop.hdfs.NNBench.main(NNBench.java:577)


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HADOOP-5597) create_write operation of nnbench is failing.

Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jakob Homan reassigned HADOOP-5597:
-----------------------------------

    Assignee: Jakob Homan

> create_write operation of nnbench is failing.
> ---------------------------------------------
>
>                 Key: HADOOP-5597
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5597
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.20.0
>            Reporter: Suman Sehgal
>            Assignee: Jakob Homan
>
> create_write operation of nnbench (org.apache.hadoop.hdfs.NNBench) is not able to create control file. It is failing and displaying following error message:
> Exception in thread "main" java.io.IOException: Mkdirs failed to create /<specified-path>/output/control
>         at org.apache.hadoop.hdfs.NNBench.createControlFiles(NNBench.java:154)
>         at org.apache.hadoop.hdfs.NNBench.main(NNBench.java:577)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5597) create_write operation of nnbench is failing.

Posted by "Suman Sehgal (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694668#action_12694668 ] 

Suman Sehgal commented on HADOOP-5597:
--------------------------------------


This issue poped up while executing following command 

java  -cp <classpath> org.apache.hadoop.hdfs.NNBench  -operation create_write  -maps <no. of maps> -startTime <current time>+120 (in seconds) -numberOfFiles <no of files> -blockSize <blocks per file>  -bytesToWrite <bytes per block> -bytesPerChecksum <blocks per file>

where no. of maps= 1.5 times of cluster size
      bytesToWrite=20
      numberOfFiles=cluster size
and default values are being used for blockSize and bytesPerChecksum (which is 1).


Environment:
==========
20 Nodes Cluster
500 Nodes Cluster
Hadoop Version : 0.20.0 (with fairshare Scheduler)

> create_write operation of nnbench is failing.
> ---------------------------------------------
>
>                 Key: HADOOP-5597
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5597
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.20.0
>            Reporter: Suman Sehgal
>
> create_write operation of nnbench (org.apache.hadoop.hdfs.NNBench) is not able to create control file. It is failing and displaying following error message:
> Exception in thread "main" java.io.IOException: Mkdirs failed to create /<specified-path>/output/control
>         at org.apache.hadoop.hdfs.NNBench.createControlFiles(NNBench.java:154)
>         at org.apache.hadoop.hdfs.NNBench.main(NNBench.java:577)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HADOOP-5597) create_write operation of nnbench is failing.

Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Boris Shkolnik resolved HADOOP-5597.
------------------------------------

    Resolution: Cannot Reproduce

> create_write operation of nnbench is failing.
> ---------------------------------------------
>
>                 Key: HADOOP-5597
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5597
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.20.0
>            Reporter: Suman Sehgal
>            Assignee: Ravi Phulari
>
> create_write operation of nnbench (org.apache.hadoop.hdfs.NNBench) is not able to create control file. It is failing and displaying following error message:
> Exception in thread "main" java.io.IOException: Mkdirs failed to create /<specified-path>/output/control
>         at org.apache.hadoop.hdfs.NNBench.createControlFiles(NNBench.java:154)
>         at org.apache.hadoop.hdfs.NNBench.main(NNBench.java:577)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HADOOP-5597) create_write operation of nnbench is failing.

Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Boris Shkolnik reassigned HADOOP-5597:
--------------------------------------

    Assignee: Boris Shkolnik  (was: Ravi Phulari)

> create_write operation of nnbench is failing.
> ---------------------------------------------
>
>                 Key: HADOOP-5597
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5597
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.20.0
>            Reporter: Suman Sehgal
>            Assignee: Boris Shkolnik
>
> create_write operation of nnbench (org.apache.hadoop.hdfs.NNBench) is not able to create control file. It is failing and displaying following error message:
> Exception in thread "main" java.io.IOException: Mkdirs failed to create /<specified-path>/output/control
>         at org.apache.hadoop.hdfs.NNBench.createControlFiles(NNBench.java:154)
>         at org.apache.hadoop.hdfs.NNBench.main(NNBench.java:577)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-5597) create_write operation of nnbench is failing.

Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715313#action_12715313 ] 

Boris Shkolnik commented on HADOOP-5597:
----------------------------------------

Tried to run it on 5 nodes and 20 nodes cluster. The only time when it failed - was when I specified a wrong config. Since creating control files is the first access to HDFS it would fail there if it was trying to access a wrong NameNode (for example default, because config points to a wrong place).
My conclusion - it is possible that the failure was result of running with wrong config. 
If you run into this again - please attache NameNode logs and specify exact configuration.

Meanwhile closing the bug.

> create_write operation of nnbench is failing.
> ---------------------------------------------
>
>                 Key: HADOOP-5597
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5597
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.20.0
>            Reporter: Suman Sehgal
>            Assignee: Ravi Phulari
>
> create_write operation of nnbench (org.apache.hadoop.hdfs.NNBench) is not able to create control file. It is failing and displaying following error message:
> Exception in thread "main" java.io.IOException: Mkdirs failed to create /<specified-path>/output/control
>         at org.apache.hadoop.hdfs.NNBench.createControlFiles(NNBench.java:154)
>         at org.apache.hadoop.hdfs.NNBench.main(NNBench.java:577)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HADOOP-5597) create_write operation of nnbench is failing.

Posted by "Jakob Homan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jakob Homan reassigned HADOOP-5597:
-----------------------------------

    Assignee: Ravi Phulari  (was: Jakob Homan)

> create_write operation of nnbench is failing.
> ---------------------------------------------
>
>                 Key: HADOOP-5597
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5597
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.20.0
>            Reporter: Suman Sehgal
>            Assignee: Ravi Phulari
>
> create_write operation of nnbench (org.apache.hadoop.hdfs.NNBench) is not able to create control file. It is failing and displaying following error message:
> Exception in thread "main" java.io.IOException: Mkdirs failed to create /<specified-path>/output/control
>         at org.apache.hadoop.hdfs.NNBench.createControlFiles(NNBench.java:154)
>         at org.apache.hadoop.hdfs.NNBench.main(NNBench.java:577)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-5597) create_write operation of nnbench is failing.

Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nigel Daley updated HADOOP-5597:
--------------------------------

    Tags: ygridqa

> create_write operation of nnbench is failing.
> ---------------------------------------------
>
>                 Key: HADOOP-5597
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5597
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 0.20.0
>            Reporter: Suman Sehgal
>            Assignee: Ravi Phulari
>
> create_write operation of nnbench (org.apache.hadoop.hdfs.NNBench) is not able to create control file. It is failing and displaying following error message:
> Exception in thread "main" java.io.IOException: Mkdirs failed to create /<specified-path>/output/control
>         at org.apache.hadoop.hdfs.NNBench.createControlFiles(NNBench.java:154)
>         at org.apache.hadoop.hdfs.NNBench.main(NNBench.java:577)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.