You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Henry Robinson (Created) (JIRA)" <ji...@apache.org> on 2012/03/30 23:25:27 UTC
[jira] [Created] (HDFS-3167) CLI-based driver for MiniDFSCluster
CLI-based driver for MiniDFSCluster
-----------------------------------
Key: HDFS-3167
URL: https://issues.apache.org/jira/browse/HDFS-3167
Project: Hadoop HDFS
Issue Type: New Feature
Components: test
Reporter: Henry Robinson
Assignee: Henry Robinson
Priority: Minor
Fix For: 0.24.0
Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Aaron T. Myers (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243788#comment-13243788 ]
Aaron T. Myers commented on HDFS-3167:
--------------------------------------
+1, the patch looks good to me. I'm going to commit this momentarily.
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Attachments: HDFS-3167.1.patch, HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Aaron T. Myers (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HDFS-3167:
---------------------------------
Fix Version/s: (was: 0.24.0)
Target Version/s: 2.0.0
Affects Version/s: 2.0.0
Status: Patch Available (was: Open)
Marking patch available for Henry so that test-patch runs.
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Attachments: HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243792#comment-13243792 ]
Hudson commented on HDFS-3167:
------------------------------
Integrated in Hadoop-Common-trunk-Commit #1962 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1962/])
HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson. (Revision 1308159)
Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308159
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/test/HdfsTestDriver.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/test/MiniDFSClusterManager.java
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HDFS-3167.1.patch, HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Aaron T. Myers (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13242898#comment-13242898 ]
Aaron T. Myers commented on HDFS-3167:
--------------------------------------
Hey Henry, patch looks pretty good after a quick look. I haven't actually run it, though. Can you comment on what testing you've done?
A few little things I noticed:
# Why do you initialize nameNodePort to 20500? I don't think it will actually get used, since you later specify "0" as the default.
# It's not obvious to me why you output some error messages using LOG.info(...), and others using System.err.println(...). Unless there's some good reason, I'd suggest you either be consistent or add a comment explaining what the distinction for using one vs. the other is.
# I don't see how stop(...) will ever be called.
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Attachments: HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243791#comment-13243791 ]
Hudson commented on HDFS-3167:
------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2037 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2037/])
HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson. (Revision 1308159)
Result = SUCCESS
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308159
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/test/HdfsTestDriver.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/test/MiniDFSClusterManager.java
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HDFS-3167.1.patch, HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Henry Robinson (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Henry Robinson updated HDFS-3167:
---------------------------------
Attachment: HDFS-3167.1.patch
Removed unused 'stop', and unused default for nn port, also moved all System.*.println to LOG.
Regarding testing: informally I've been using it internally for a couple of months, and I've worked through the command line options to verify that they behave as expected before creating this patch.
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Attachments: HDFS-3167.1.patch, HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Aaron T. Myers (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aaron T. Myers updated HDFS-3167:
---------------------------------
Resolution: Fixed
Fix Version/s: 2.0.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I've just committed this to trunk and branch-2. Thanks a lot for the contribution, Hank.
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HDFS-3167.1.patch, HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243816#comment-13243816 ]
Hudson commented on HDFS-3167:
------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1975 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1975/])
HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson. (Revision 1308159)
Result = ABORTED
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308159
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/test/HdfsTestDriver.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/test/MiniDFSClusterManager.java
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HDFS-3167.1.patch, HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244168#comment-13244168 ]
Hudson commented on HDFS-3167:
------------------------------
Integrated in Hadoop-Hdfs-trunk #1003 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1003/])
HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson. (Revision 1308159)
Result = FAILURE
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308159
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/test/HdfsTestDriver.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/test/MiniDFSClusterManager.java
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HDFS-3167.1.patch, HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Henry Robinson (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Henry Robinson updated HDFS-3167:
---------------------------------
Attachment: HDFS-3167.patch
Patch for trunk. Example invocation instructions in the class Javadoc.
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Fix For: 0.24.0
>
> Attachments: HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13243072#comment-13243072 ]
Hadoop QA commented on HDFS-3167:
---------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12520769/HDFS-3167.1.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 5 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2138//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2138//console
This message is automatically generated.
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Attachments: HDFS-3167.1.patch, HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13242832#comment-13242832 ]
Hadoop QA commented on HDFS-3167:
---------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12520674/HDFS-3167.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 5 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2131//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2131//console
This message is automatically generated.
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Attachments: HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-3167) CLI-based driver for MiniDFSCluster
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13244212#comment-13244212 ]
Hudson commented on HDFS-3167:
------------------------------
Integrated in Hadoop-Mapreduce-trunk #1038 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1038/])
HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson. (Revision 1308159)
Result = FAILURE
atm : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1308159
Files :
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/test/HdfsTestDriver.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/test/MiniDFSClusterManager.java
> CLI-based driver for MiniDFSCluster
> -----------------------------------
>
> Key: HDFS-3167
> URL: https://issues.apache.org/jira/browse/HDFS-3167
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: test
> Affects Versions: 2.0.0
> Reporter: Henry Robinson
> Assignee: Henry Robinson
> Priority: Minor
> Fix For: 2.0.0
>
> Attachments: HDFS-3167.1.patch, HDFS-3167.patch
>
>
> Picking up a thread again from MAPREDUCE-987, I've found it very useful to have a CLI driver for running a single-process DFS cluster, particularly when developing features in HDFS clients. For example, being able to spin up a local cluster easily was tremendously useful for correctness testing of HDFS-2834.
> I'd like to contribute a class based on the patch for MAPREDUCE-987 we've been using fairly extensively. Only for DFS, not MR since much has changed MR-side since the original patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira