You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Jitendra Nath Pandey (Created) (JIRA)" <ji...@apache.org> on 2012/02/15 22:24:59 UTC

[jira] [Created] (HADOOP-8078) Add capability to turn on security in unit tests.

Add capability to turn on security in unit tests.
-------------------------------------------------

                 Key: HADOOP-8078
                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Jitendra Nath Pandey
            Assignee: Jaimin D Jetly


We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Jaimin D Jetly (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jaimin D Jetly updated HADOOP-8078:
-----------------------------------

    Status: Open  (was: Patch Available)
    
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217948#comment-13217948 ] 

Hudson commented on HADOOP-8078:
--------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1867 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1867/])
    HADOOP-8078. Add capability to turn on security in unit tests. Contributed by Jaimin Jetly. (Revision 1294478)

     Result = SUCCESS
jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1294478
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithSecurityOn.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/authorize/TestAccessControlList.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/dn1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/nn1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/user1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/killKdc.sh
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/ldif
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/ldif/users.ldif
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/server.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/krb5.conf

                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Jaimin D Jetly (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jaimin D Jetly updated HADOOP-8078:
-----------------------------------

    Status: Patch Available  (was: Open)
    
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Jaimin D Jetly (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jaimin D Jetly updated HADOOP-8078:
-----------------------------------

    Attachment: HADOOP-8078.patch

Updated patch has the Realm changed in TestAccessControlList.java to fix the test.
                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Jaimin D Jetly (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jaimin D Jetly updated HADOOP-8078:
-----------------------------------

    Attachment: dn1.keytab
                user1.keytab
                nn1.keytab

To try the patch please download and add these patches in hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/ directory. It is this directory where these keytabs should be committed.
 To run the test just give -DstartKdc=true for example:
 mvn clean test -Dtest=TestUGIWithSecurityOn -DstartKdc=true
                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Jitendra Nath Pandey (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13214154#comment-13214154 ] 

Jitendra Nath Pandey commented on HADOOP-8078:
----------------------------------------------

# It might be better to add Assume statement in @Before, so that not every test in the file has to check for it.
# Indentation at some places in pom.xml can be fixed.
# Please don't catch and ignore the exception in TestSecureNameNode. If we don't catch it the stack trace will be available in test output anyway. 

                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217786#comment-13217786 ] 

Hadoop QA commented on HADOOP-8078:
-----------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12516247/HADOOP-8078.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 30 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/636//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/636//console

This message is automatically generated.
                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Jitendra Nath Pandey (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jitendra Nath Pandey updated HADOOP-8078:
-----------------------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

I have committed this. Thanks to Jaimin Jetly.
                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Aaron T. Myers (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron T. Myers updated HADOOP-8078:
-----------------------------------

          Component/s: test
     Target Version/s: 0.24.0
    Affects Version/s: 0.24.0
        Fix Version/s: 0.24.0
    
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: test
>    Affects Versions: 0.24.0
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217626#comment-13217626 ] 

Hadoop QA commented on HADOOP-8078:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12516214/HADOOP-8078.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 27 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed these unit tests:
                  org.apache.hadoop.fs.viewfs.TestViewFsTrash
                  org.apache.hadoop.security.authorize.TestAccessControlList

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/633//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/633//console

This message is automatically generated.
                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Daryn Sharp (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13209769#comment-13209769 ] 

Daryn Sharp commented on HADOOP-8078:
-------------------------------------

As an aside, it would be nice if it was possible to configure {{LoginContext}} to use some lightweight auth/authz for testing.  However I think there's too much higher level code that breaks the abstraction by exposing/expecting kerberos.  Is that true?  Or is it already possible to swap in a stub auth/authz module that would allow tokens to be tested w/o kerberos?
                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218206#comment-13218206 ] 

Hudson commented on HADOOP-8078:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk #1004 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1004/])
    HADOOP-8078. Add capability to turn on security in unit tests. Contributed by Jaimin Jetly. (Revision 1294478)

     Result = SUCCESS
jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1294478
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithSecurityOn.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/authorize/TestAccessControlList.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/dn1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/nn1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/user1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/killKdc.sh
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/ldif
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/ldif/users.ldif
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/server.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/krb5.conf

                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: test
>    Affects Versions: 0.24.0
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Jaimin D Jetly (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jaimin D Jetly updated HADOOP-8078:
-----------------------------------

    Attachment: HADOOP-8078.patch

This is the first patch. The basic idea is to download apacheDS tar and start kerberos server if -DstartKdc=true option is given. 
The patch depends on some keytabs, which I will upload separately because they are binary files.
                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Giridharan Kesavan (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217882#comment-13217882 ] 

Giridharan Kesavan commented on HADOOP-8078:
--------------------------------------------

+1 verified by applying the patch.
                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Jaimin D Jetly (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jaimin D Jetly updated HADOOP-8078:
-----------------------------------

    Attachment: HADOOP-8078.patch

This patch skips the unit test if option -DstartKdc is not specified or not set to "true". 
                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218117#comment-13218117 ] 

Hudson commented on HADOOP-8078:
--------------------------------

Integrated in Hadoop-Hdfs-trunk #969 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/969/])
    HADOOP-8078. Add capability to turn on security in unit tests. Contributed by Jaimin Jetly. (Revision 1294478)

     Result = UNSTABLE
jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1294478
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithSecurityOn.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/authorize/TestAccessControlList.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/dn1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/nn1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/user1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/killKdc.sh
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/ldif
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/ldif/users.ldif
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/server.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/krb5.conf

                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: test
>    Affects Versions: 0.24.0
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>             Fix For: 0.24.0
>
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Jaimin D Jetly (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jaimin D Jetly updated HADOOP-8078:
-----------------------------------

    Attachment: HADOOP-8078.patch

The updated patch has the Assume statement in @Before. So all tests under the Junit class are skipped if -DstartKdc is not set to be true. 
Patch has fixed indentation.
Also exceptions are no more caught within the test.
                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Jaimin D Jetly (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jaimin D Jetly updated HADOOP-8078:
-----------------------------------

    Status: Patch Available  (was: Open)
    
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217969#comment-13217969 ] 

Hudson commented on HADOOP-8078:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1803 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1803/])
    HADOOP-8078. Add capability to turn on security in unit tests. Contributed by Jaimin Jetly. (Revision 1294478)

     Result = ABORTED
jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1294478
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithSecurityOn.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/authorize/TestAccessControlList.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/dn1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/nn1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/user1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/killKdc.sh
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/ldif
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/ldif/users.ldif
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/server.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/krb5.conf

                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8078) Add capability to turn on security in unit tests.

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217949#comment-13217949 ] 

Hudson commented on HADOOP-8078:
--------------------------------

Integrated in Hadoop-Common-trunk-Commit #1793 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1793/])
    HADOOP-8078. Add capability to turn on security in unit tests. Contributed by Jaimin Jetly. (Revision 1294478)

     Result = SUCCESS
jitendra : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1294478
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/pom.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/TestUGIWithSecurityOn.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/authorize/TestAccessControlList.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/dn1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/nn1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/keytabs/user1.keytab
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/killKdc.sh
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/ldif
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/ldif/users.ldif
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/kdc/server.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/resources/krb5.conf

                
> Add capability to turn on security in unit tests.
> -------------------------------------------------
>
>                 Key: HADOOP-8078
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8078
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Jitendra Nath Pandey
>            Assignee: Jaimin D Jetly
>         Attachments: HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, HADOOP-8078.patch, dn1.keytab, nn1.keytab, user1.keytab
>
>
> We should be able to start a kdc server for unit tests, so that security could be turned on. This will greatly improve the coverage of unit tests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira