You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Xiaobing Zhou (JIRA)" <ji...@apache.org> on 2015/02/24 02:04:12 UTC
[jira] [Updated] (HIVE-9760) Killed job is not displayed correctly
by failure hook
[ https://issues.apache.org/jira/browse/HIVE-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiaobing Zhou updated HIVE-9760:
--------------------------------
Attachment: HIVE-9760.1.patch
Made patch V1. Can any have it reviewed? Thanks.
> Killed job is not displayed correctly by failure hook
> -----------------------------------------------------
>
> Key: HIVE-9760
> URL: https://issues.apache.org/jira/browse/HIVE-9760
> Project: Hive
> Issue Type: Bug
> Affects Versions: 1.0.0
> Environment: CentOS
> Reporter: Xiaobing Zhou
> Assignee: Xiaobing Zhou
> Attachments: HIVE-9760.1.patch
>
>
> PROBLEM: After killing the job throug CLI by crtl+c, we are seeing the following exception. Also the job is shown as running with timer still counting on the UI
> Interrupting... Be patient, this might take some time.
> Press Ctrl+C again to kill JVM
> Map 1: 20/40 Reducer 2: 0/3 Reducer 3: 0/1
> Map 1: 22/40 Reducer 2: 0/3 Reducer 3: 0/1
> Map 1: 25/40 Reducer 2: 0/3 Reducer 3: 0/1
> Map 1: 26/40 Reducer 2: 0/3 Reducer 3: 0/1
> Exiting the JVM
> Trying to shutdown DAG
> Shutting down tez session.
> Status: Killed
> Job received Kill while in RUNNING state.
> Vertex killed, vertexName=Reducer 3, vertexId=vertex_1421602925091_3868_2_00, diagnostics=Vertex received Kill while in RUNNING state., Vertex killed due to user-initiated job kill. failedTasks:0
> Vertex killed, vertexName=Map 1, vertexId=vertex_1421602925091_3868_2_02, diagnostics=Vertex received Kill while in RUNNING state., Vertex killed due to user-initiated job kill. failedTasks:0
> Vertex killed, vertexName=Reducer 2, vertexId=vertex_1421602925091_3868_2_01, diagnostics=Vertex received Kill while in RUNNING state., Vertex killed due to user-initiated job kill. failedTasks:0
> DAG killed due to user-initiated kill. failedVertices:0 killedVertices:3
> FAILED: Hive Internal Error: java.lang.IllegalStateException(Shutdown in progress)
> java.lang.IllegalStateException: Shutdown in progress
> at java.lang.ApplicationShutdownHooks.add(ApplicationShutdownHooks.java:66)
> at java.lang.Runtime.addShutdownHook(Runtime.java:211)
> at org.apache.hadoop.hive.ql.hooks.ATSHook.<init>(ATSHook.java:71)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at java.lang.Class.newInstance(Class.java:374)
> at org.apache.hadoop.hive.ql.hooks.HookUtils.getHooks(HookUtils.java:59)
> at org.apache.hadoop.hive.ql.Driver.getHooks(Driver.java:1177)
> at org.apache.hadoop.hive.ql.Driver.getHooks(Driver.java:1161)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1316)
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1093)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
> at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
> at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:793)
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> hive> EL Info: 2015-01-21 16:20:51.483-ServerSession(1006268460)-EclipseLink, version: Eclipse Persistence Services - 2.5.1.v20130918-f2b9fc5
> EL Info: connection: 2015-01-21 16:20:52.025-ServerSession(1006268460)-file:/usr/lib/hive/lib/xasecure-audit.jar_xa_server_url=jdbc:mysql://bkcttplpd036.verizon.com/xasecure_user=xalogger login successful
> EL Info: connection: 2015-01-21 16:20:52.082-ServerSession(1006268460)-file:/usr/lib/hive/lib/xasecure-audit.jar_xa_server_url=jdbc:mysql://bkcttplpd036.verizon.com/xasecure_user=xalogger logout successful
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)