You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2019/10/13 12:44:00 UTC
[jira] [Comment Edited] (TEZ-3860) JDK9: ReflectionUtils may not
use URLClassLoader
[ https://issues.apache.org/jira/browse/TEZ-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16950309#comment-16950309 ]
László Bodor edited comment on TEZ-3860 at 10/13/19 12:43 PM:
--------------------------------------------------------------
[~jeagles]: could you please take a look at my WIP patch?
https://github.com/abstractdog/tez/commit/6d92f125180738afd6592043e6fdf524228ff221
with this I got tez working on a JDK11 cluster
was (Author: abstractdog):
[~jeagles]: could you please take a look at my WIP patch?
https://github.com/abstractdog/tez/commit/cf500eefd2dafb323ac667d95024bf9d011b7953
with this I got tez working on a JDK11 cluster
> JDK9: ReflectionUtils may not use URLClassLoader
> ------------------------------------------------
>
> Key: TEZ-3860
> URL: https://issues.apache.org/jira/browse/TEZ-3860
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Zoltan Haindrich
> Priority: Major
>
> The following code
> https://github.com/apache/tez/blob/master/tez-api/src/main/java/org/apache/tez/common/ReflectionUtils.java#L125
> is not compatible with JDK9 since the classloader is an AppClassLoader
> causes exceptions like this:
> {code}
> java.lang.ClassCastException: java.base/jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to java.base/java.net.URLClassLoader
> at org.apache.tez.common.ReflectionUtils.addResourcesToSystemClassLoader(ReflectionUtils.java:125) ~[tez-api-0.9.0.jar:0.9.0]
> at org.apache.tez.dag.utils.RelocalizationUtils.addUrlsToClassPath(RelocalizationUtils.java:57) ~[tez-common-0.9.0.jar:0.9.0]
> at org.apache.tez.dag.app.dag.impl.DAGImpl$StartTransition.transition(DAGImpl.java:1793) ~[tez-dag-0.9.0.jar:0.9.0]
> at org.apache.tez.dag.app.dag.impl.DAGImpl$StartTransition.transition(DAGImpl.java:1776) ~[tez-dag-0.9.0.jar:0.9.0]
> at org.apache.hadoop.yarn.state.StateMachineFactory$SingleInternalArc.doTransition(StateMachineFactory.java:362) ~[hadoop-yarn-common-2.8.1.jar:?]
> at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302) ~[hadoop-yarn-common-2.8.1.jar:?]
> at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46) ~[hadoop-yarn-common-2.8.1.jar:?]
> at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448) ~[hadoop-yarn-common-2.8.1.jar:?]
> at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:59) ~[tez-dag-0.9.0.jar:0.9.0]
> at org.apache.tez.dag.app.dag.impl.DAGImpl.handle(DAGImpl.java:1156) [tez-dag-0.9.0.jar:0.9.0]
> at org.apache.tez.dag.app.dag.impl.DAGImpl.handle(DAGImpl.java:147) [tez-dag-0.9.0.jar:0.9.0]
> at org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher.handle(DAGAppMaster.java:2251) [tez-dag-0.9.0.jar:0.9.0]
> at org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher.handle(DAGAppMaster.java:2242) [tez-dag-0.9.0.jar:0.9.0]
> at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:180) [tez-common-0.9.0.jar:0.9.0]
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:115) [tez-common-0.9.0.jar:0.9.0]
> at java.base/java.lang.Thread.run(Thread.java:844) [?:?]
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)