You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Vinayakumar B (Jira)" <ji...@apache.org> on 2020/06/15 09:29:00 UTC
[jira] [Commented] (YARN-10314) YarnClient throws
NoClassDefFoundError for WebSocketException with only shaded client jars
[ https://issues.apache.org/jira/browse/YARN-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17135669#comment-17135669 ]
Vinayakumar B commented on YARN-10314:
--------------------------------------
Simple wordcount example to confirm
{noformat}
export CLASSPATH=$HADOOP_HOME/share/hadoop/common/lib/*.jar:$HADOOP_HOME/share/hadoop/client/*.jar:$HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples*.jar;
java org.apache.hadoop.examples.WordCount /in /out
{noformat}
> YarnClient throws NoClassDefFoundError for WebSocketException with only shaded client jars
> ------------------------------------------------------------------------------------------
>
> Key: YARN-10314
> URL: https://issues.apache.org/jira/browse/YARN-10314
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
> Affects Versions: 3.3.0
> Reporter: Vinayakumar B
> Assignee: Vinayakumar B
> Priority: Blocker
>
> After YARN-8778, with only shaded hadoop client jars in classpath Unable to submit job.
> CC: [~ayushtkn] confirmed the same. Hive 4.0 doesnot work due to this, shaded client is necessary there to avoid guava jar's conflicts.
> {noformat}
> Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/org/eclipse/jetty/websocket/api/WebSocketException
> at org.apache.hadoop.yarn.client.api.YarnClient.createYarnClient(YarnClient.java:92)
> at org.apache.hadoop.mapred.ResourceMgrDelegate.<init>(ResourceMgrDelegate.java:109)
> at org.apache.hadoop.mapred.YARNRunner.<init>(YARNRunner.java:153)
> at org.apache.hadoop.mapred.YarnClientProtocolProvider.create(YarnClientProtocolProvider.java:34)
> at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:130)
> at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:109)
> at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:102)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1545)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1541)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
> at org.apache.hadoop.mapreduce.Job.connect(Job.java:1541)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1570)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1594)
> at org.apache.hadoop.examples.WordCount.main(WordCount.java:87)
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.shaded.org.eclipse.jetty.websocket.api.WebSocketException
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
> ... 16 more
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org