[jira] [Commented] (TEZ-2611) HIVE: Tez job fails / MR succeeds

["Hitesh Shah (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622497#comment-14622497 ] 

Hitesh Shah commented on TEZ-2611:
----------------------------------

Issues such as this are better asked/reported first on the mailing list. 

In any case, the information above is insufficient to diagnose what the error is. Please attach the application logs obtained from YARN for appId application_1436522494179_0001 



> HIVE: Tez job fails / MR succeeds
> ---------------------------------
>
>                 Key: TEZ-2611
>                 URL: https://issues.apache.org/jira/browse/TEZ-2611
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.5.2
>         Environment: Hortonworks cluster 2.2 with hive 0.14 and tez 0.5.2
>            Reporter: Ricardo Pinto
>            Priority: Blocker
>
> I try to execute a simple query in hive with tez:
> insert into table ctrl_batch select batchnumber from ext.ctrl_batch;
> ext.ctrl_batch has 100 rows.
> The tez job fails with the following errors:
> 2015-07-10 11:12:47,622 INFO  SessionState (SessionState.java:printInfo(824)) - Map 1: 0(+0,-1)/1	
> 2015-07-10 11:12:47,622 INFO  SessionState (SessionState.java:printInfo(824)) - Map 1: 0(+0,-2)/1	
> 2015-07-10 11:12:47,622 INFO  SessionState (SessionState.java:printInfo(824)) - Map 1: 0(+0,-3)/1	
> 2015-07-10 11:12:47,622 INFO [AMRM Callback Handler Thread] rm.YarnTaskSchedulerService: Allocated container completed:container_1436522494179_0001_01_000036 last allocated to task: attempt_1436522494179_0001_3_00_000000_0
> 2015-07-10 11:12:47,622 DEBUG [AMRM Callback Handler Thread] rm.YarnTaskSchedulerService: Allocated resource memory: 207872 cpu:29 delayedContainers: 0 heartbeats: 1268 lastPreemptionHeartbeat: 0
> 2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler] event.AsyncDispatcher: Dispatching the event org.apache.tez.dag.app.rm.container.AMContainerEventCompleted.EventType: C_COMPLETED
> 2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler] container.AMContainerImpl: Processing AMContainerEvent container_1436522494179_0001_01_000036 of type C_COMPLETED while in state: IDLE. Event: EventType: C_COMPLETED
> 2015-07-10 11:12:47,622 WARN [AsyncDispatcher event handler] container.AMContainerImpl: Container container_1436522494179_0001_01_000036 finished with diagnostics set to [Container failed. Exception from container-launch.
> Container id: container_1436522494179_0001_01_000036
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1: 
> 	at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> 	at org.apache.hadoop.util.Shell.run(Shell.java:455)
> 	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
> 	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> Shell output:         1 file(s) moved.
> Container exited with a non-zero exit code 1
> ]
> 2015-07-10 11:12:47,622 DEBUG [AsyncDispatcher event handler] app.TaskAttemptListenerImpTezDag: Unregistering Container from TaskAttemptListener: container_1436522494179_0001_01_000036
> 2015-07-10 11:12:47,622 INFO [AsyncDispatcher event handler] container.AMContainerImpl: Container container_1436522494179_0001_01_000036 exited with diagnostics set to Container failed. Exception from container-launch.
> However if I set hive.execution.engine=mr; the query executes perfectly.
> Can anyone help?
> Thank you.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)