You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Eli Collins (JIRA)" <ji...@apache.org> on 2011/08/10 20:26:27 UTC
[jira] [Created] (HDFS-2242)
TestHDFSServerPorts#testSecondaryNodePorts is failing
TestHDFSServerPorts#testSecondaryNodePorts is failing
-----------------------------------------------------
Key: HDFS-2242
URL: https://issues.apache.org/jira/browse/HDFS-2242
Project: Hadoop HDFS
Issue Type: Bug
Components: name-node
Reporter: Eli Collins
This test fails on my host on trunk.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-2242) HDFS tests are failing due to storage
directory issues
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved HDFS-2242.
-------------------------------
Resolution: Fixed
These sets of tests seem to be fixed now.
> HDFS tests are failing due to storage directory issues
> ------------------------------------------------------
>
> Key: HDFS-2242
> URL: https://issues.apache.org/jira/browse/HDFS-2242
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Reporter: Eli Collins
> Assignee: Todd Lipcon
>
> This test fails on my host on trunk.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HDFS-2242) HDFS tests are failing due to storage
directory issues
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon reassigned HDFS-2242:
---------------------------------
Assignee: Todd Lipcon (was: Alejandro Abdelnur)
> HDFS tests are failing due to storage directory issues
> ------------------------------------------------------
>
> Key: HDFS-2242
> URL: https://issues.apache.org/jira/browse/HDFS-2242
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Reporter: Eli Collins
> Assignee: Todd Lipcon
>
> This test fails on my host on trunk.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2242) HDFS tests are failing due to storage
directory issues
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated HDFS-2242:
------------------------------
Summary: HDFS tests are failing due to storage directory issues (was: TestHDFSServerPorts#testSecondaryNodePorts is failing)
The following tests are all failing on due to IOExceptions creating storage dirs:
[junit] Test org.apache.hadoop.hdfs.TestHDFSServerPorts FAILED
[junit] Test org.apache.hadoop.hdfs.server.blockmanagement.TestReplicationPolicy FAILED
[junit] Test org.apache.hadoop.hdfs.server.namenode.TestCheckpoint FAILED
[junit] Test org.apache.hadoop.hdfs.server.namenode.TestNNThroughputBenchmark FAILED
[junit] Test org.apache.hadoop.hdfs.server.namenode.TestValidateConfigurationSettings FAILED
> HDFS tests are failing due to storage directory issues
> ------------------------------------------------------
>
> Key: HDFS-2242
> URL: https://issues.apache.org/jira/browse/HDFS-2242
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Reporter: Eli Collins
>
> This test fails on my host on trunk.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HDFS-2242) HDFS tests are failing due to storage
directory issues
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins reassigned HDFS-2242:
---------------------------------
Assignee: Alejandro Abdelnur
Todd mentioned test.build.dir isn't getting set so MinIDFSCluster.getBaseDirectory is coming back as /test, triggered by switching common to maven. Alejandro is investigating. Thanks Alejandro!
> HDFS tests are failing due to storage directory issues
> ------------------------------------------------------
>
> Key: HDFS-2242
> URL: https://issues.apache.org/jira/browse/HDFS-2242
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Reporter: Eli Collins
> Assignee: Alejandro Abdelnur
>
> This test fails on my host on trunk.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2242) HDFS tests are failing due to
storage directory issues
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13085370#comment-13085370 ]
Todd Lipcon commented on HDFS-2242:
-----------------------------------
I think the issue is that the "tests" jar didn't used to include the core-site.xml.
What's happening is:
common's core-site.xml has set:
{code}
<property>
<name>hadoop.tmp.dir</name>
<value>build/test</value>
<final>true</final>
</property>
{code}
but then hdfs-default.xml sets:
{code}
<property>
<name>dfs.namenode.name.dir</name>
<value>file://${hadoop.tmp.dir}/dfs/name</value>
</property>
{code}
so, we're getting {{file://build/test/dfs/name}} there. Then, URI.getPath() on that returns /test/dfs/name.
I think the fix is to exclude core-site.xml from the -test jar assembly for common.
> HDFS tests are failing due to storage directory issues
> ------------------------------------------------------
>
> Key: HDFS-2242
> URL: https://issues.apache.org/jira/browse/HDFS-2242
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Reporter: Eli Collins
> Assignee: Alejandro Abdelnur
>
> This test fails on my host on trunk.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2242)
TestHDFSServerPorts#testSecondaryNodePorts is failing
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082533#comment-13082533 ]
Eli Collins commented on HDFS-2242:
-----------------------------------
Testcase: testSecondaryNodePorts took 0.258 sec
Caused an ERROR
Directory /test/dfs/namesecondary is in an inconsistent state: checkpoint directory does not exist or is not accessible.
org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /test/dfs/namesecondary is in an inconsistent state: checkpoint directory does not exist or is not accessible.
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.recoverCreate(SecondaryNameNode.java:801)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.initialize(SecondaryNameNode.java:222)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.<init>(SecondaryNameNode.java:175)
at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.<init>(SecondaryNameNode.java:168)
at org.apache.hadoop.hdfs.TestHDFSServerPorts.canStartSecondaryNode(TestHDFSServerPorts.java:224)
at org.apache.hadoop.hdfs.TestHDFSServerPorts.testSecondaryNodePorts(TestHDFSServerPorts.java:350)
> TestHDFSServerPorts#testSecondaryNodePorts is failing
> -----------------------------------------------------
>
> Key: HDFS-2242
> URL: https://issues.apache.org/jira/browse/HDFS-2242
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Reporter: Eli Collins
>
> This test fails on my host on trunk.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2242) HDFS tests are failing due to
storage directory issues
Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13084130#comment-13084130 ]
Alejandro Abdelnur commented on HDFS-2242:
------------------------------------------
The issue is that the 'hadoop.tmp.dir' sys prop was not being set up for testcases, thus the checkpoint dir was being resolved to '/test/...' instead '$BUILD_TEST_DIR/test/..'.
Still not sure how Mavenization affected this as HDFS is another build.xml or is some other change that came along at the same time.
Regardless, I've just fixed this in the HDFS-2096 'AH' patch.
Do we want to fix this pre-maven as well? (given that HDFS-2096 has been already +1)
Thanks.
> HDFS tests are failing due to storage directory issues
> ------------------------------------------------------
>
> Key: HDFS-2242
> URL: https://issues.apache.org/jira/browse/HDFS-2242
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Reporter: Eli Collins
> Assignee: Alejandro Abdelnur
>
> This test fails on my host on trunk.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2242) HDFS tests are failing due to
storage directory issues
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13084209#comment-13084209 ]
Eli Collins commented on HDFS-2242:
-----------------------------------
If HDFS-2096 is good to go and fixes this then let's commit it.
> HDFS tests are failing due to storage directory issues
> ------------------------------------------------------
>
> Key: HDFS-2242
> URL: https://issues.apache.org/jira/browse/HDFS-2242
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Reporter: Eli Collins
> Assignee: Alejandro Abdelnur
>
> This test fails on my host on trunk.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2242) HDFS tests are failing due to
storage directory issues
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083975#comment-13083975 ]
Tsz Wo (Nicholas), SZE commented on HDFS-2242:
----------------------------------------------
See [this comment|https://issues.apache.org/jira/browse/HDFS-2240?focusedCommentId=13081475&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13081475] for more details.
> HDFS tests are failing due to storage directory issues
> ------------------------------------------------------
>
> Key: HDFS-2242
> URL: https://issues.apache.org/jira/browse/HDFS-2242
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: name-node
> Reporter: Eli Collins
> Assignee: Alejandro Abdelnur
>
> This test fails on my host on trunk.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira