You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Nigel Daley (JIRA)" <ji...@apache.org> on 2007/04/04 19:39:32 UTC
[jira] Created: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
-------------------------------------------------------------------------------
Key: HADOOP-1203
URL: https://issues.apache.org/jira/browse/HADOOP-1203
Project: Hadoop
Issue Type: Bug
Components: test
Affects Versions: 0.13.0
Reporter: Nigel Daley
Fix For: 0.13.0
UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-1203:
--------------------------------
Assignee: Nigel Daley
Status: Patch Available (was: Open)
All tests pass on Windows, Linux, and Solaris.
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch, 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-1203:
--------------------------------
Attachment: 1203.patch
Smaller patch that doesn't change all the tests to throw Exception.
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-1203:
--------------------------------
Status: Open (was: Patch Available)
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-1203:
--------------------------------
Attachment: 1203.patch
Here is a preliminary patch for review. I still need to finish documenting MiniDFSCluster. Here are the main changes in this patch:
MiniDFSCluster:
- use new static create methods on DataNode and NameNode
- remove Runner threads
- remove deprecated constructors
- add new constructor, options, and methods needed by DFS upgrade tests
All Tests:
- MiniDFSCluster constructor now throws Exception so tests that use it now do too
DataNode and Storage:
- removed deprecated methods that were only used by MiniDFSCluster
- removed static method/fields that were created for MiniDFSCluster and are no longer needed
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487314 ]
Hadoop QA commented on HADOOP-1203:
-----------------------------------
+1, because http://issues.apache.org/jira/secure/attachment/12355086/1203.patch applied and successfully tested against trunk revision http://svn.apache.org/repos/asf/lucene/hadoop/trunk/526215. Results are at http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch, 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-1203:
------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've just committed this. Thanks Nigel!
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch, 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487288 ]
Hadoop QA commented on HADOOP-1203:
-----------------------------------
-1, because 1 attempts failed to build and test the latest attachment http://issues.apache.org/jira/secure/attachment/12355086/1203.patch against trunk revision http://svn.apache.org/repos/asf/lucene/hadoop/trunk/526215. Please note that this message is automatically generated and may represent a problem with the automation system and not the patch. Results are at http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch, 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-1203:
--------------------------------
Attachment: 1203.patch
Attaching correct patch.
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch, 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-1203:
--------------------------------
Status: Patch Available (was: Open)
This makes HADOOP-1206 obsolete. The latest patch address Konstantin's concerns. Thanks Konstantin!
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487159 ]
Hadoop QA commented on HADOOP-1203:
-----------------------------------
+1, because http://issues.apache.org/jira/secure/attachment/12355057/1203.patch applied and successfully tested against trunk revision http://svn.apache.org/repos/asf/lucene/hadoop/trunk/525596. Results are at http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487132 ]
Konstantin Shvachko commented on HADOOP-1203:
---------------------------------------------
MiniDFSCluster( ... ) constructor should throw IOException rather than Exception.
This will require changing NameNode.createNameNode() to throw IOException instead of Exception.
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487281 ]
Konstantin Shvachko commented on HADOOP-1203:
---------------------------------------------
+1
This makes MiniDFSCluster simple and clear.
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch, 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nigel Daley updated HADOOP-1203:
--------------------------------
Attachment: 1203.patch
Added missing comments.
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487400 ]
Hadoop QA commented on HADOOP-1203:
-----------------------------------
Integrated in Hadoop-Nightly #50 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/50/)
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Assigned To: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch, 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1203) UpgradeUtilities should use
MiniDFSCluster to start and stop NameNode/DataNodes
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487183 ]
Tom White commented on HADOOP-1203:
-----------------------------------
Nigel,
Do you want to finish the documentation before this is committed? (I noticed some of the javadoc says "PENDING".)
> UpgradeUtilities should use MiniDFSCluster to start and stop NameNode/DataNodes
> -------------------------------------------------------------------------------
>
> Key: HADOOP-1203
> URL: https://issues.apache.org/jira/browse/HADOOP-1203
> Project: Hadoop
> Issue Type: Bug
> Components: test
> Affects Versions: 0.13.0
> Reporter: Nigel Daley
> Fix For: 0.13.0
>
> Attachments: 1203.patch, 1203.patch
>
>
> UpgradeUtilities used by DFS tests should use MiniDFSCluster to start and stop NameNode/DataNodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.