You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/09/14 05:21:20 UTC
[jira] [Commented] (TRAFODION-2222) YarnConfiguration class not
found with Trafodion on HortonWorks HDP
[ https://issues.apache.org/jira/browse/TRAFODION-2222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15489457#comment-15489457 ]
ASF GitHub Bot commented on TRAFODION-2222:
-------------------------------------------
GitHub user zellerh opened a pull request:
https://github.com/apache/incubator-trafodion/pull/701
[TRAFODION-2222] Trafodion on HDP 2.3 needs yarn client in class path
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zellerh/incubator-trafodion bug/fix
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-trafodion/pull/701.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #701
----
commit 92bba1f112edc89a80a3a32ee2afadf708f4148b
Author: Hans Zeller <hz...@apache.org>
Date: 2016-09-14T05:16:06Z
[TRAFODION-2222] Trafodion on HDP 2.3 needs yarn client in class path
----
> YarnConfiguration class not found with Trafodion on HortonWorks HDP
> -------------------------------------------------------------------
>
> Key: TRAFODION-2222
> URL: https://issues.apache.org/jira/browse/TRAFODION-2222
> Project: Apache Trafodion
> Issue Type: Bug
> Components: sql-general
> Affects Versions: 2.0-incubating, 2.1-incubating
> Environment: We saw this with Trafodion 2.0.1 on HortonWorks HDP 2.3.6.
> Reporter: Hans Zeller
> Assignee: Hans Zeller
> Fix For: 2.1-incubating
>
>
> There are a few places in Trafodion where we use a JNI call to execute a HiveQL statement. On HDP 2.3.6, such operations now hang with the following error occurring repeatedly (recorded in $MY_SQROOT/logs/trafodion.hdfs.log):
> 2016-09-13 22:45:15,439 WARN cli.CLIService: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=1348cb58-6f70-4bfe-9a81-b887ae4862cc]: The background operation was aborted
> java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/conf/YarnConfiguration
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:206)
> at org.apache.hive.service.cli.CLIService.getOperationStatus(CLIService.java:387)
> at org.apache.hive.service.cli.thrift.ThriftCLIService.GetOperationStatus(ThriftCLIService.java:610)
> at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.hive.jdbc.HiveConnection$SynchronizedHandler.invoke(HiveConnection.java:1372)
> at com.sun.proxy.$Proxy17.GetOperationStatus(Unknown Source)
> at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:269)
> at org.trafodion.sql.HiveClient.executeHiveSQL(HiveClient.java:295)
> Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/conf/YarnConfiguration
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:348)
> at org.apache.hadoop.hive.ql.hooks.HookUtils.getHooks(HookUtils.java:60)
> at org.apache.hadoop.hive.ql.Driver.getHooks(Driver.java:1368)
> at org.apache.hadoop.hive.ql.Driver.getHooks(Driver.java:1352)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1412)
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1254)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1118)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1113)
> at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:154)
> at org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:71)
> at org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:206)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
> at org.apache.hive.service.cli.operation.SQLOperation$1.run(SQLOperation.java:218)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.yarn.conf.YarnConfiguration
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 21 more
> My good friend Google tells me that this is likely a CLASSPATH issue. The Trafodion CLASSPATH currently does not have the jar files in /usr/hdp/current/hadoop-yarn-client/ in it. Adding those manually to the CLASSPATH (in $MY_SQROOT/etc/ms.env) fixed the issue in our server.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)