You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Nilesh Maheshwari (JIRA)" <ji...@apache.org> on 2016/06/07 21:29:21 UTC
[jira] [Commented] (HIVE-12454) in tez model when i use add jar xxx
query will fail
[ https://issues.apache.org/jira/browse/HIVE-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319469#comment-15319469 ]
Nilesh Maheshwari commented on HIVE-12454:
------------------------------------------
What was the issue and how it got resolved?
> in tez model when i use add jar xxx query will fail
> ---------------------------------------------------
>
> Key: HIVE-12454
> URL: https://issues.apache.org/jira/browse/HIVE-12454
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 0.14.0
> Reporter: Feng Yuan
> Fix For: 1.3.0
>
>
> whatever hql only if i use add jar udf.jar hql will throws out these:
> Status: Running (Executing on YARN cluster with App id application_1447448264041_0723)
> --------------------------------------------------------------------------------
> VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
> --------------------------------------------------------------------------------
> Map 1 FAILED -1 0 0 -1 0 0
> Map 2 FAILED -1 0 0 -1 0 0
> --------------------------------------------------------------------------------
> VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 0.27 s
> --------------------------------------------------------------------------------
> Status: Failed
> Vertex failed, vertexName=Map 2, vertexId=vertex_1447448264041_0723_1_00, diagnostics=[Vertex vertex_1447448264041_0723_1_00 [Map 2] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: mid_bdi_customer_online initializer failed, vertex=vertex_1447448264041_0723_1_00 [Map 2], java.lang.NoSuchMethodError: org.apache.hadoop.hive.shims.HadoopShims.getMergedCredentials(Lorg/apache/hadoop/mapred/JobConf;)V
> at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:104)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:245)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:239)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:239)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:226)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> ]
> Vertex failed, vertexName=Map 1, vertexId=vertex_1447448264041_0723_1_01, diagnostics=[Vertex vertex_1447448264041_0723_1_01 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: raw_kafka_event_pageview_dt0 initializer failed, vertex=vertex_1447448264041_0723_1_01 [Map 1], java.lang.NoSuchMethodError: org.apache.hadoop.hive.shims.HadoopShims.getMergedCredentials(Lorg/apache/hadoop/mapred/JobConf;)V
> at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:104)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:245)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:239)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:239)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:226)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> ]
> DAG failed due to vertex failure. failedVertices:2 killedVertices:0
> FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask
> sometime is NoSuchMethodError other package such as org.apache.hadoop.hive.ql.log.PerfLogger.PerfLogBegin(Ljava/lang/String;Ljava/lang/String;)V
> or something.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)