You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Nate Cole <nc...@hortonworks.com> on 2017/11/15 01:57:00 UTC
Review Request 63822: Oozie Jobs on Hive Fail With Missing Tarball
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63822/
-----------------------------------------------------------
Review request for Ambari and Jonathan Hurley.
Repository: ambari
Description
-------
STR:
- Install an HDP 2.6.3.0 cluster with Oozie, HIve, MapR, Yarn, ZK, HDFS
- Patch only Oozie to a new version, such as 2.6.3.1-1
- Attempt to run an Oozie job on Hive
The workflow job will fail with:
{code}
org.apache.oozie.action.ActionExecutorException: JA008: File does not exist: hdfs://jhurley-pu-1.openstacklocal:8020/hdp/apps/2.6.3.1-1/mapreduce/mapreduce.tar.gz
at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:457)
at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:441)
at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1211)
at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1382)
at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
at org.apache.oozie.command.XCommand.call(XCommand.java:287)
at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:331)
at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:260)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{code}
This is because Oozie appears to be trying to use a version of the MapReduce tarball which matches its version. However, since it does not ship its version, it cannot find it.
Diffs
-----
ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_packages.json 68e6bf806c
Diff: https://reviews.apache.org/r/63822/diff/1/
Testing
-------
Manual. Follow STR, then ran an oozie-on-hive job to confirm results.
No automated tests, as they exist already.
Thanks,
Nate Cole
Re: Review Request 63822: Oozie Jobs on Hive Fail With Missing Tarball
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63822/#review191059
-----------------------------------------------------------
Ship it!
Ship It!
- Jonathan Hurley
On Nov. 14, 2017, 8:57 p.m., Nate Cole wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63822/
> -----------------------------------------------------------
>
> (Updated Nov. 14, 2017, 8:57 p.m.)
>
>
> Review request for Ambari and Jonathan Hurley.
>
>
> Repository: ambari
>
>
> Description
> -------
>
> STR:
> - Install an HDP 2.6.3.0 cluster with Oozie, HIve, MapR, Yarn, ZK, HDFS
> - Patch only Oozie to a new version, such as 2.6.3.1-1
> - Attempt to run an Oozie job on Hive
>
> The workflow job will fail with:
> {code}
> org.apache.oozie.action.ActionExecutorException: JA008: File does not exist: hdfs://jhurley-pu-1.openstacklocal:8020/hdp/apps/2.6.3.1-1/mapreduce/mapreduce.tar.gz
> at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:457)
> at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:441)
> at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1211)
> at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1382)
> at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
> at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
> at org.apache.oozie.command.XCommand.call(XCommand.java:287)
> at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:331)
> at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:260)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {code}
>
> This is because Oozie appears to be trying to use a version of the MapReduce tarball which matches its version. However, since it does not ship its version, it cannot find it.
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_packages.json 68e6bf806c
>
>
> Diff: https://reviews.apache.org/r/63822/diff/1/
>
>
> Testing
> -------
>
> Manual. Follow STR, then ran an oozie-on-hive job to confirm results.
>
>
> No automated tests, as they exist already.
>
>
> Thanks,
>
> Nate Cole
>
>