You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Robert Kanter (JIRA)" <ji...@apache.org> on 2014/03/05 00:29:42 UTC
[jira] [Updated] (OOZIE-1613) Update Hadoop to 1.2.1
[ https://issues.apache.org/jira/browse/OOZIE-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Kanter updated OOZIE-1613:
---------------------------------
Description:
We should update Hadoop 1.1.1 to the latest version, 1.2.1.
I think we'd be able to get rid of some custom stuff, including:
- -Hadoop 1.2.1 has {{hadoop-auth}} stuff, so we could get rid of the special {{<hadoop.auth.version>}} handling in the root pom, which is currently set to {{2.0.2-alpha}} (which is an old alpha version)-
- We could stop excluding {{TestMapReduceActionExecutorUberJar.java}} from the unit tests
- We can get rid of our copy of {{AltKerberosAuthenticationHandler.java}} in the {{login}} module (see OOZIE-1104)
- We can use DistCp v2 in each version of Hadoop, which helps with OOZIE-1728
In Hadoop 1.2.x, {{hadoop-core}} contains the stuff in {{hadoop-auth}}, and we need the {{hadoop-auth}} stuff for Oozie client, which would mean that we'd have to put {{hadoop-core}} into the Oozie client. And in the server, its likely that {{hadoop-core}} 1.2.x isn't 100% compatible with {{hadoop-auth}}. So handling this would be quite tricky and risky; its working now with Hadoop 1.1.1 and {{hadoop-auth}} 2.0.2-alpha, so I'm reluctant to change it without someone doing extensive testing.
was:
We should update Hadoop 1.1.1 to the latest version, 1.2.1.
I think we'd be able to get rid of some custom stuff, including:
- -Hadoop 1.2.1 has {{hadoop-auth}} stuff, so we could get rid of the special {{<hadoop.auth.version>}} handling in the root pom, which is currently set to {{2.0.2-alpha}} (which is an old alpha version)-
- We could stop excluding {{TestMapReduceActionExecutorUberJar.java}} from the unit tests
- We can get rid of our copy of {{AltKerberosAuthenticationHandler.java}} in the {{login}} module (see OOZIE-1104)
In Hadoop 1.2.x, {{hadoop-core}} contains the stuff in {{hadoop-auth}}, and we need the {{hadoop-auth}} stuff for Oozie client, which would mean that we'd have to put {{hadoop-core}} into the Oozie client. And in the server, its likely that {{hadoop-core}} 1.2.x isn't 100% compatible with {{hadoop-auth}}. So handling this would be quite tricky and risky; its working now with Hadoop 1.1.1 and {{hadoop-auth}} 2.0.2-alpha, so I'm reluctant to change it without someone doing extensive testing.
> Update Hadoop to 1.2.1
> ----------------------
>
> Key: OOZIE-1613
> URL: https://issues.apache.org/jira/browse/OOZIE-1613
> Project: Oozie
> Issue Type: Improvement
> Components: core
> Affects Versions: trunk
> Reporter: Robert Kanter
> Priority: Minor
>
> We should update Hadoop 1.1.1 to the latest version, 1.2.1.
> I think we'd be able to get rid of some custom stuff, including:
> - -Hadoop 1.2.1 has {{hadoop-auth}} stuff, so we could get rid of the special {{<hadoop.auth.version>}} handling in the root pom, which is currently set to {{2.0.2-alpha}} (which is an old alpha version)-
> - We could stop excluding {{TestMapReduceActionExecutorUberJar.java}} from the unit tests
> - We can get rid of our copy of {{AltKerberosAuthenticationHandler.java}} in the {{login}} module (see OOZIE-1104)
> - We can use DistCp v2 in each version of Hadoop, which helps with OOZIE-1728
> In Hadoop 1.2.x, {{hadoop-core}} contains the stuff in {{hadoop-auth}}, and we need the {{hadoop-auth}} stuff for Oozie client, which would mean that we'd have to put {{hadoop-core}} into the Oozie client. And in the server, its likely that {{hadoop-core}} 1.2.x isn't 100% compatible with {{hadoop-auth}}. So handling this would be quite tricky and risky; its working now with Hadoop 1.1.1 and {{hadoop-auth}} 2.0.2-alpha, so I'm reluctant to change it without someone doing extensive testing.
--
This message was sent by Atlassian JIRA
(v6.2#6252)