You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Stephen Chu (JIRA)" <ji...@apache.org> on 2012/11/02 06:42:14 UTC
[jira] [Created] (HADOOP-9004) Allow security unit tests to use
external KDC
Stephen Chu created HADOOP-9004:
-----------------------------------
Summary: Allow security unit tests to use external KDC
Key: HADOOP-9004
URL: https://issues.apache.org/jira/browse/HADOOP-9004
Project: Hadoop Common
Issue Type: Improvement
Components: security, test
Affects Versions: 2.0.0-alpha
Reporter: Stephen Chu
Fix For: 3.0.0
I want to add the option of allowing security-related unit tests to use an external KDC.
In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas updated HADOOP-9004:
------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I committed the patch to trunk. Thank you Stephen.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephen Chu updated HADOOP-9004:
--------------------------------
Status: Patch Available (was: Open)
Submitting new patch.
Added _isExternalKdcRunning()_ to SecurityUtilTestHelper.java to detect if user running test has specified to use an external KDC.
TestUGIWithExternalKdc and TestSecureNameNodeWithExternalKdc are the counterparts to TestUGIWithSecurityOn and TestSecureNameNode, except the new tests use the external KDC. I don't think it'll be clean to merge these into one test, so I think separating them is fine for now.
I refactored SecureDataNodeStarter so that we can get the SecureResources within our unit tests.
I modified MiniDFSCluster so that it now actually checks to see if checkDataNodeAddrConfig was set to true (so that we can change the DataNodes to use low ports because secure DNs require ports < 1023). Also, while bringing up the DataNodes, if kerberos authentication is enabled, MiniDFSCluster will now get the SecureResources necessary to start the DN.
TestStartSecureDataNode brings up a 1 NameNode 1 DataNode MiniDFSCluster. However, the test will fail if not run as root because bringing up the secure DN requires root. This is a problem, and it won't work to give away root access in some jenkins env. I guess there has been past discussion on whether or not to have this requirement for starting the DN in dev environments. For now, I think it's still useful to have this test, even if it can't be run in most setups.
My plan is to continue to write more unit tests against a secure MiniDFSCluster, as we are missing a lot of unit test coverage against secure setups.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon updated HADOOP-9004:
--------------------------------
Attachment: hadoop-9004-branch-2.txt
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: hadoop-9004-branch-2.txt, HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephen Chu updated HADOOP-9004:
--------------------------------
Attachment: HADOOP-9004.patch.008
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephen Chu updated HADOOP-9004:
--------------------------------
Attachment: HADOOP-9004.patch
I have attached a patch with two tests, TestUGIWithExternalKdc and TestSecureNameNodeWithExternalKdc. These tests are based on TestUGIWithSecurityOn (HADOOP-8078) and TestSecureNameNode (HDFS-3016).
The difference is that the new tests make use of user-specified KDC, principals, and keytabs.
TestUGIWithExternalKdc verifies keytab login.
TestSecureNameNodeWithExternalKdc brings up a MiniDFSCluster with kerberos authentication enabled.
In future JIRAs, I plan to add more security-related unit tests to cover pain points and stuff that's broken in the past (e.g. hdfs fsck and groups have once been broken with security enabled).
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489870#comment-13489870 ]
Hadoop QA commented on HADOOP-9004:
-----------------------------------
{color:green}+1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12551935/HADOOP-9004.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:green}+1 tests included{color}. The patch appears to include 2 new or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1699//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1699//console
This message is automatically generated.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492256#comment-13492256 ]
Hudson commented on HADOOP-9004:
--------------------------------
Integrated in Hadoop-Yarn-trunk #29 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/29/])
HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. (Revision 1406413)
HADOOP-9004. Reverting the commit r1406202 to address patch issue (Revision 1406379)
HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. (Revision 1406202)
Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406413
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406379
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406202
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491135#comment-13491135 ]
Stephen Chu commented on HADOOP-9004:
-------------------------------------
Thanks for reviewing, Jitendra.
bq. Do you plan to write tests that work with Apache DS kerberos as well. The advantage is that developers will not have to bother about setting up a kdc. Ideal would be that these test cases could be integrated with commit builds.
Yeah, I do plan to keep in mind that it's a pain to set up your own KDC just to run these test cases. I'll take a look into Apache DS (not very familiar with it right now). I'll put effort into whatever way we discover is best to get these integrated into commit builds.
I uploaded a new patch addressing your comment.
Thanks!
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Jitendra Nath Pandey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491299#comment-13491299 ]
Jitendra Nath Pandey commented on HADOOP-9004:
----------------------------------------------
+1 for the patch.
For Apache DS, you might want to look at startKdc profile in hadoop-common-project/hadoop-common/pom.xml.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon reopened HADOOP-9004:
---------------------------------
I'd like to commit this to branch-2 as well. Reopening
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: hadoop-9004-branch-2.txt, HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492359#comment-13492359 ]
Hudson commented on HADOOP-9004:
--------------------------------
Integrated in Hadoop-Mapreduce-trunk #1249 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1249/])
HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. (Revision 1406413)
HADOOP-9004. Reverting the commit r1406202 to address patch issue (Revision 1406379)
HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. (Revision 1406202)
Result = FAILURE
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406413
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406379
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406202
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492017#comment-13492017 ]
Hudson commented on HADOOP-9004:
--------------------------------
Integrated in Hadoop-trunk-Commit #2968 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/2968/])
HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. (Revision 1406413)
Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406413
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephen Chu updated HADOOP-9004:
--------------------------------
Status: Open (was: Patch Available)
Cancelling the patch, as I would like to make some edits to the tests as well as add a way to start a secure DataNode from the MiniDFSCluster.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492317#comment-13492317 ]
Hudson commented on HADOOP-9004:
--------------------------------
Integrated in Hadoop-Hdfs-trunk #1219 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1219/])
HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. (Revision 1406413)
HADOOP-9004. Reverting the commit r1406202 to address patch issue (Revision 1406379)
HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. (Revision 1406202)
Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406413
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406379
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406202
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas reopened HADOOP-9004:
-------------------------------------
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491886#comment-13491886 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-9004:
------------------------------------------------
The patch has some problem: TestStartSecureDataNode is in org/apache/hadoop/hdfs/server/datanode but the package declaration is org.apache.hadoop.hdfs.server.namenode.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas updated HADOOP-9004:
------------------------------------
Assignee: Stephen Chu
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491588#comment-13491588 ]
Hudson commented on HADOOP-9004:
--------------------------------
Integrated in Hadoop-trunk-Commit #2961 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/2961/])
HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. (Revision 1406202)
Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406202
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas updated HADOOP-9004:
------------------------------------
Status: Patch Available (was: Reopened)
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephen Chu updated HADOOP-9004:
--------------------------------
Attachment: HADOOP-9004.patch.007
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491984#comment-13491984 ]
Hadoop QA commented on HADOOP-9004:
-----------------------------------
{color:green}+1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12552348/HADOOP-9004.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:green}+1 tests included{color}. The patch appears to include 5 new or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1715//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1715//console
This message is automatically generated.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491903#comment-13491903 ]
Stephen Chu commented on HADOOP-9004:
-------------------------------------
Ouch, sorry about that. Thanks for catching that and fixing the patch, Nicholas and Suresh.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491899#comment-13491899 ]
Hudson commented on HADOOP-9004:
--------------------------------
Integrated in Hadoop-trunk-Commit #2966 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/2966/])
HADOOP-9004. Reverting the commit r1406202 to address patch issue (Revision 1406379)
Result = SUCCESS
suresh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1406379
Files :
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/SecurityUtilTestHelper.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithExternalKdc.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/MiniDFSCluster.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestStartSecureDataNode.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNodeWithExternalKdc.java
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489273#comment-13489273 ]
Suresh Srinivas commented on HADOOP-9004:
-----------------------------------------
Stephen, I added you as a contributor to Hadoop Common and assigned the jira.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491037#comment-13491037 ]
Hadoop QA commented on HADOOP-9004:
-----------------------------------
{color:green}+1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12552164/HADOOP-9004.patch.007
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:green}+1 tests included{color}. The patch appears to include 5 new or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1706//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1706//console
This message is automatically generated.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489271#comment-13489271 ]
Stephen Chu commented on HADOOP-9004:
-------------------------------------
I'd like to work on this, but can't self-assign JIRAs. Can someone assign this JIRA to me? Thanks.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Fix For: 3.0.0
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489274#comment-13489274 ]
Stephen Chu commented on HADOOP-9004:
-------------------------------------
Thanks!
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Stephen Chu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephen Chu updated HADOOP-9004:
--------------------------------
Status: Patch Available (was: Open)
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas updated HADOOP-9004:
------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I committed the new patch to trunk.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Jitendra Nath Pandey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491098#comment-13491098 ]
Jitendra Nath Pandey commented on HADOOP-9004:
----------------------------------------------
bq. In future JIRAs, I plan to add more security-related unit tests to cover pain points and stuff that's broken in the past (e.g. hdfs fsck and groups have once been broken with security enabled).
That will be very helpful. Thanks Stephen!
Do you plan to write tests that work with Apache DS kerberos as well. The advantage is that developers will not have to bother about setting up a kdc. Ideal would be that these test cases could be integrated with commit builds.
The patch looks good to me. +1
Minor: You don't have to assertTrue in the finally clause in testSecureNameNode.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491195#comment-13491195 ]
Hadoop QA commented on HADOOP-9004:
-----------------------------------
{color:green}+1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12552200/HADOOP-9004.patch.008
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:green}+1 tests included{color}. The patch appears to include 5 new or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/1709//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/1709//console
This message is automatically generated.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HADOOP-9004) Allow security unit tests to use
external KDC
Posted by "Suresh Srinivas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suresh Srinivas updated HADOOP-9004:
------------------------------------
Attachment: HADOOP-9004.patch
I reverted the previous commit. Updated patch with comment from Nicholas addressed.
> Allow security unit tests to use external KDC
> ---------------------------------------------
>
> Key: HADOOP-9004
> URL: https://issues.apache.org/jira/browse/HADOOP-9004
> Project: Hadoop Common
> Issue Type: Improvement
> Components: security, test
> Affects Versions: 2.0.0-alpha
> Reporter: Stephen Chu
> Assignee: Stephen Chu
> Fix For: 3.0.0
>
> Attachments: HADOOP-9004.patch, HADOOP-9004.patch, HADOOP-9004.patch.007, HADOOP-9004.patch.008
>
>
> I want to add the option of allowing security-related unit tests to use an external KDC.
> In HADOOP-8078, we add the ability to start and use an ApacheDS KDC for security-related unit tests. It would be good to allow users to validate the use of their own KDC, keytabs, and principals and to test different KDCs and not rely on the ApacheDS KDC.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira