[jira] [Updated] (OOZIE-1830) Change hadoop-1 profile to use 1.2.1

["Azrael (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/OOZIE-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Azrael updated OOZIE-1830:
--------------------------

    Attachment: OOZIE-1830.2.patch

Sorry for creating duplicated issue.

The new patch adds oozie-hadoop-auth modules to specify hadoop-auth dependency.
* oozie-hadoop-auth-0.23 : hadoop-auth-0.23
* oozie-hadoop-auth-1 : hadoop-core-1.2.1
* oozie-hadoop-auth-2 : hadoop-auth-2.3.0
I could be better way to specify hadoop-auth in the oozie-client using maven profile stuff but I create in each moudle. Maybe login module need it too.

bq. We can stop excluding TestMapReduceActionExecutorUberJar from the unit tests; it should work with 1.2.1; you simply need to delete a line or two from the root pom and verify that this test passes
TestMapReduceActionExecutorUberJar passed
{code}
umask 022 && mvn test -Dtest=TestMapReduceActionExecutorUberJar
{code}

bq. Here's the tricky thing: Hadoop 1.1.x does not include the hadoop-auth classes (the security stuff) in hadoop-core. So, we use hadoop-auth from Hadoop 2.0.2-alpha in the Oozie client and Oozie core. However, Hadoop 1.2.x does include the hadoop-auth classes in hadoop-core, which may be a problem if the hadoop-auth 2.0.2-alpha used by Oozie client is not 100% compatible with the classes in hadoop-core; plus if Oozie core include hadoop-core with the security classes and hadoop-auth, there could be classpath issues. 
oozie-hadoop-auth-1 use only hadoop-core-1.2.1 and not load hadoop-auth-2.0.2-alpha.

bq. Have you verified that Kerberos works?
I test the simple shell workflow on kerberos environment and works well.
Here are some logs.
{code}
2014-06-02 14:03:01,228  INFO KerberosAuthenticationHandler:160 - Login using keytab /etc/security/keytabs/oozie.keytab, for principal HTTP/az0@AZ.COM
2014-06-02 14:03:01,237  INFO KerberosAuthenticationHandler:176 - Initialized, principal [HTTP/az0@AZ.COM] from keytab [/etc/security/keytabs/oozie.keytab]
2014-06-02 14:02:58,393  INFO HadoopAccessorService:539 - USER[-] GROUP[-] Got Kerberos ticket, keytab [/etc/security/keytabs/oozie.keytab], Oozie principal principal [oozie/az0@AZ.COM]
{code}

> Change hadoop-1 profile to use 1.2.1
> ------------------------------------
>
>                 Key: OOZIE-1830
>                 URL: https://issues.apache.org/jira/browse/OOZIE-1830
>             Project: Oozie
>          Issue Type: Improvement
>    Affects Versions: trunk, 4.0.1
>            Reporter: Azrael
>            Priority: Minor
>         Attachments: OOZIE-1830.1.patch, OOZIE-1830.2.patch
>
>
> We should change the hadoop-1 profile to use 1.2.1 instead of 1.1.1.



--
This message was sent by Atlassian JIRA
(v6.2#6252)