You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Yangze Guo (Jira)" <ji...@apache.org> on 2020/02/23 00:27:00 UTC
[jira] [Comment Edited] (FLINK-16228) test_mesos_wordcount.sh fails
[ https://issues.apache.org/jira/browse/FLINK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042591#comment-17042591 ]
Yangze Guo edited comment on FLINK-16228 at 2/23/20 12:26 AM:
--------------------------------------------------------------
Currently, the Flink's Mesos integration is not hadoop-free, see FLINK-8247. The error message shows there is something wrong with hadoop classpath.
My gut feeling is that this is related to FLINK-15785.
{code:java}
env: PROFILE="-Dinclude-hadoop -Dhadoop.version=2.8.3 -Dscala-2.12 -Pe2e-travis1,e2e-hadoop""{code}
The double-quote at the end of this line seems to be redundant. I'm not sure whether it is the root cause at the moment. However, I'll verify it and give a PR asap.
Update: Travis gives green light to this test after removing the redundant double-quote. [https://travis-ci.org/KarmaGYZ/flink/builds/653943626]
[~rmetzger] Could you assign this to me?
was (Author: karmagyz):
Currently, the Flink's Mesos integration is not hadoop-free, see FLINK-8247. The error message shows there is something wrong with hadoop classpath.
My gut feeling is that this is related to FLINK-15785.
{code:java}
env: PROFILE="-Dinclude-hadoop -Dhadoop.version=2.8.3 -Dscala-2.12 -Pe2e-travis1,e2e-hadoop""{code}
The double-quote at the end of this line seems to be redundant. I'm not sure whether it is the root cause at the moment. However, I'll verify it and give a PR asap.
> test_mesos_wordcount.sh fails
> -----------------------------
>
> Key: FLINK-16228
> URL: https://issues.apache.org/jira/browse/FLINK-16228
> Project: Flink
> Issue Type: Bug
> Components: Deployment / Mesos, Tests
> Affects Versions: 1.11.0
> Reporter: Robert Metzger
> Priority: Major
> Labels: test-stability
>
> In a recent cron build, the mesos wordcount test failed: https://travis-ci.org/apache/flink/jobs/653454544
> {code}
> 2020-02-21 20:37:44,334 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Shutting MesosSessionClusterEntrypoint down with application status FAILED. Diagnostics java.lang.NoClassDefFoundError: org/apache/hadoop/security/UserGroupInformation
> at org.apache.flink.runtime.clusterframework.overlays.HadoopUserOverlay$Builder.fromEnvironment(HadoopUserOverlay.java:74)
> at org.apache.flink.mesos.util.MesosUtils.applyOverlays(MesosUtils.java:152)
> at org.apache.flink.mesos.util.MesosUtils.createContainerSpec(MesosUtils.java:131)
> at org.apache.flink.mesos.runtime.clusterframework.MesosResourceManagerFactory.createActiveResourceManager(MesosResourceManagerFactory.java:81)
> at org.apache.flink.runtime.resourcemanager.ActiveResourceManagerFactory.createResourceManager(ActiveResourceManagerFactory.java:57)
> at org.apache.flink.runtime.entrypoint.component.DefaultDispatcherResourceManagerComponentFactory.create(DefaultDispatcherResourceManagerComponentFactory.java:170)
> at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:215)
> at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:169)
> at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
> at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:168)
> at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:518)
> at org.apache.flink.mesos.entrypoint.MesosSessionClusterEntrypoint.main(MesosSessionClusterEntrypoint.java:126)
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.security.UserGroupInformation
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
> ... 12 more
> .
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)