You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Suresh Srinivas (JIRA)" <ji...@apache.org> on 2011/05/31 22:08:47 UTC
[jira] [Created] (HDFS-2020) TestDFSUpgradeFromImage fails
TestDFSUpgradeFromImage fails
-----------------------------
Key: HDFS-2020
URL: https://issues.apache.org/jira/browse/HDFS-2020
Project: Hadoop HDFS
Issue Type: Bug
Components: data-node, test
Affects Versions: 0.23.0
Reporter: Suresh Srinivas
Assignee: Suresh Srinivas
Datanode has a singleton datanodeObject. When running MiniDFSCluster with multiple datanodes, the singleton can point to only one of the datanodes. TestDFSUpgradeFromImage fails related to initialization of this singleton.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2020) TestDFSUpgradeFromImage fails
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HDFS-2020:
------------------------------
Attachment: log.txt
Got it to fail. Here's the trace
> TestDFSUpgradeFromImage fails
> -----------------------------
>
> Key: HDFS-2020
> URL: https://issues.apache.org/jira/browse/HDFS-2020
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node, test
> Affects Versions: 0.23.0
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Attachments: log.txt
>
>
> Datanode has a singleton datanodeObject. When running MiniDFSCluster with multiple datanodes, the singleton can point to only one of the datanodes. TestDFSUpgradeFromImage fails related to initialization of this singleton.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2020) TestDFSUpgradeFromImage fails
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042920#comment-13042920 ]
Hudson commented on HDFS-2020:
------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #704 (See [https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/704/])
> TestDFSUpgradeFromImage fails
> -----------------------------
>
> Key: HDFS-2020
> URL: https://issues.apache.org/jira/browse/HDFS-2020
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node, test
> Affects Versions: 0.23.0
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Fix For: 0.23.0
>
> Attachments: HDFS-2020.patch, log.txt
>
>
> Datanode has a singleton datanodeObject. When running MiniDFSCluster with multiple datanodes, the singleton can point to only one of the datanodes. TestDFSUpgradeFromImage fails related to initialization of this singleton.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2020) TestDFSUpgradeFromImage fails
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HDFS-2020:
------------------------------
Resolution: Fixed
Fix Version/s: 0.23.0
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
After looping for 15 minutes I saw no failures, where I could get it to fail regularly without the patch.
Committed to trunk. Thanks, Suresh!
> TestDFSUpgradeFromImage fails
> -----------------------------
>
> Key: HDFS-2020
> URL: https://issues.apache.org/jira/browse/HDFS-2020
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node, test
> Affects Versions: 0.23.0
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Fix For: 0.23.0
>
> Attachments: HDFS-2020.patch, log.txt
>
>
> Datanode has a singleton datanodeObject. When running MiniDFSCluster with multiple datanodes, the singleton can point to only one of the datanodes. TestDFSUpgradeFromImage fails related to initialization of this singleton.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2020) TestDFSUpgradeFromImage fails
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas updated HDFS-2020:
----------------------------------
Status: Patch Available (was: Open)
> TestDFSUpgradeFromImage fails
> -----------------------------
>
> Key: HDFS-2020
> URL: https://issues.apache.org/jira/browse/HDFS-2020
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node, test
> Affects Versions: 0.23.0
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Attachments: HDFS-2020.patch, log.txt
>
>
> Datanode has a singleton datanodeObject. When running MiniDFSCluster with multiple datanodes, the singleton can point to only one of the datanodes. TestDFSUpgradeFromImage fails related to initialization of this singleton.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2020) TestDFSUpgradeFromImage fails
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042523#comment-13042523 ]
Hadoop QA commented on HDFS-2020:
---------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12481163/HDFS-2020.patch
against trunk revision 1130339.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
+1 system test framework. The patch passed system test framework compile.
Test results: https://builds.apache.org/hudson/job/PreCommit-HDFS-Build/678//testReport/
Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-HDFS-Build/678//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/hudson/job/PreCommit-HDFS-Build/678//console
This message is automatically generated.
> TestDFSUpgradeFromImage fails
> -----------------------------
>
> Key: HDFS-2020
> URL: https://issues.apache.org/jira/browse/HDFS-2020
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node, test
> Affects Versions: 0.23.0
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Attachments: HDFS-2020.patch, log.txt
>
>
> Datanode has a singleton datanodeObject. When running MiniDFSCluster with multiple datanodes, the singleton can point to only one of the datanodes. TestDFSUpgradeFromImage fails related to initialization of this singleton.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2020) TestDFSUpgradeFromImage fails
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042539#comment-13042539 ]
Todd Lipcon commented on HDFS-2020:
-----------------------------------
patch looks pretty good. Let's see what Hudson thinks.
> TestDFSUpgradeFromImage fails
> -----------------------------
>
> Key: HDFS-2020
> URL: https://issues.apache.org/jira/browse/HDFS-2020
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node, test
> Affects Versions: 0.23.0
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Attachments: HDFS-2020.patch, log.txt
>
>
> Datanode has a singleton datanodeObject. When running MiniDFSCluster with multiple datanodes, the singleton can point to only one of the datanodes. TestDFSUpgradeFromImage fails related to initialization of this singleton.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2020) TestDFSUpgradeFromImage fails
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042742#comment-13042742 ]
Hudson commented on HDFS-2020:
------------------------------
Integrated in Hadoop-Hdfs-trunk #685 (See [https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/685/])
HDFS-2020. Fix TestDFSUpgradeFromImage by removing the use of DataNode as a singleton. Contributed by Suresh Srinivas.
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1130368
Files :
* /hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/datanode/DirectoryScanner.java
* /hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/datanode/FSDataset.java
* /hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/datanode/UpgradeObjectDatanode.java
* /hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
* /hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/namenode/FileChecksumServlets.java
* /hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/datanode/DataBlockScanner.java
* /hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/namenode/StreamFile.java
* /hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/datanode/BlockPoolSliceStorage.java
* /hadoop/hdfs/trunk/src/java/org/apache/hadoop/hdfs/server/datanode/DataStorage.java
* /hadoop/hdfs/trunk/src/test/hdfs/org/apache/hadoop/hdfs/server/datanode/TestDirectoryScanner.java
* /hadoop/hdfs/trunk/CHANGES.txt
> TestDFSUpgradeFromImage fails
> -----------------------------
>
> Key: HDFS-2020
> URL: https://issues.apache.org/jira/browse/HDFS-2020
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node, test
> Affects Versions: 0.23.0
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Fix For: 0.23.0
>
> Attachments: HDFS-2020.patch, log.txt
>
>
> Datanode has a singleton datanodeObject. When running MiniDFSCluster with multiple datanodes, the singleton can point to only one of the datanodes. TestDFSUpgradeFromImage fails related to initialization of this singleton.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2020) TestDFSUpgradeFromImage fails
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042541#comment-13042541 ]
Todd Lipcon commented on HDFS-2020:
-----------------------------------
oh.. I was looking at an old tab where Hudson hadn't commented yet :) Hudson says +1, so I agree. Let me loop the test that was failing for a few minutes, then we'll commit if it all looks good.
> TestDFSUpgradeFromImage fails
> -----------------------------
>
> Key: HDFS-2020
> URL: https://issues.apache.org/jira/browse/HDFS-2020
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node, test
> Affects Versions: 0.23.0
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Attachments: HDFS-2020.patch, log.txt
>
>
> Datanode has a singleton datanodeObject. When running MiniDFSCluster with multiple datanodes, the singleton can point to only one of the datanodes. TestDFSUpgradeFromImage fails related to initialization of this singleton.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2020) TestDFSUpgradeFromImage fails
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas updated HDFS-2020:
----------------------------------
Attachment: HDFS-2020.patch
Early version of the patch - gets rid of static DataNode#datanodeObject.
> TestDFSUpgradeFromImage fails
> -----------------------------
>
> Key: HDFS-2020
> URL: https://issues.apache.org/jira/browse/HDFS-2020
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node, test
> Affects Versions: 0.23.0
> Reporter: Suresh Srinivas
> Assignee: Suresh Srinivas
> Attachments: HDFS-2020.patch, log.txt
>
>
> Datanode has a singleton datanodeObject. When running MiniDFSCluster with multiple datanodes, the singleton can point to only one of the datanodes. TestDFSUpgradeFromImage fails related to initialization of this singleton.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira