You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Amit Kumar <de...@gmail.com> on 2017/08/02 03:40:13 UTC

LLAP Query Failed with no such method exception

Hi,

I have configured hadoop 2.7.3 and hive 2.1.1 with LLAP.

tez quiries are running fine, but after LLAP daemon is launched using
slider, any insert or count(*) llap queries is throwing exception:

java.lang.Exception: java.util.concurrent.ExecutionException:
java.lang.NoSuchMethodError:
org.apache.hadoop.tracing.SpanReceiverHost.getInstance(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/tracing/SpanReceiverHost;
        at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:271)
        at
org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:69)
        at
org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
        at
org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
        at
org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
        at
org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.ExecutionException:
java.lang.NoSuchMethodError:
org.apache.hadoop.tracing.SpanReceiverHost.getInstance(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/tracing/SpanReceiverHost;
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:265)
        ... 12 more

I suppose, might be because of missing htrace configuration, but after
configuring the below configuration in core-site.xml, It is still throwing
same exception.


<property>
        <name>hadoop.htrace.spanreceiver.classes</name>
        <value>org.apache.htrace.impl.LocalFileSpanReceiver</value>
</property>
<property>
        <name>hadoop.htrace.local-file-span-receiver.path</name>
        <value>/usr/local/hadoop/logs/htrace.out</value>
</property>

Thanks & Regards,

Amit Kumar,
Scientist B,
Mob: 9910611621

Re: LLAP Query Failed with no such method exception

Posted by Gopal Vijayaraghavan <go...@apache.org>.
Hi,

> java.lang.Exception: java.util.concurrent.ExecutionException: java.lang.NoSuchMethodError: org.apache.hadoop.tracing.SpanReceiverHost.getInstance(Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/tracing/SpanReceiverHost;

There's a good possibility that you've built hive-2.1.1 against Hadoop-2.6 without changing the pom.xml?

> hadoop 2.7.3

https://github.com/apache/hadoop/commit/472fd563e4110adcb5e90bf2cb325a9fa4c8c440

-  public static SpanReceiverHost getInstance(Configuration conf) {
+  public static SpanReceiverHost get(Configuration conf, String confPrefix) {


-    this.spanReceiverHost = SpanReceiverHost.getInstance(conf);
 +    this.spanReceiverHost =
 +      SpanReceiverHost.get(conf, DFSConfigKeys.DFS_SERVER_HTRACE_PREFIX);

So, there's definitely a mismatch between the version inside LLAP tarball and the version inside the cluster.

Cheers,
Gopal