You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by Susi Chan <sk...@yahoo.com> on 2020/08/10 18:25:26 UTC

Error: Failed to load class + Command exited with status 101 error

I upgraded my project from mesos 1.4.1 + jdk 8 + spark 2.3.1 + CentOS7 to use mesos 1.9.0 and jdk headless 11 in RHEL7 with spark 3.0.0.  I am getting the following "Failed to load class" error I0807 16:47:34.699182 21059 executor.cpp:190] Received LAUNCH eventI0807 16:47:34.699383 21059 executor.cpp:722] Starting task driver-20200807164731-0014I0807 16:47:34.705006 21059 executor.cpp:738] Forked command at 21068WARNING: An illegal reflective access operation has occurredWARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/var/lib/mesos-slave/slaves/38e5abe1-7fa3-431c-a8f7-c3ed02458dcf-S0/frameworks/f9ba2f70-4709-466d-8e63-baae3c7eca42-0000/executors/driver-20200807164731-0014/runs/6b1ea2c9-5a46-4c49-8f47-fafaabe9395b/spark-3.0.0-executor/jars/spark-unsafe_2.12-3.0.0.jar) to constructor java.nio.DirectByteBuffer(long,int)WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.PlatformWARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operationsWARNING: All illegal access operations will be denied in a future releaseError: Failed to load class org.apache.spark.examples.SparkPi.I0807 16:47:37.503019 21059 executor.cpp:1039] Command exited with status 101 (pid: 21068)I0807 16:47:38.504026 21067 process.cpp:935] Stopped the socket accept loop
I got this error with our product jar and so I tried to use the example jar that came with spark and got the same error as well.I noticed that with the previous mesos version 1.4.1, the downloaded extracted spark folder has uid=501 and gid=games.  After the upgrade, the dowloaded spark folder has uid=root and gid=root.  Will that has anything to do with the "Failed to load class... status 101" failure?  Both the jar and the spark folder was downloaded successfully.  I can execute the downloaded jars locally but mesos cannot load the class.
Mesos was installed using the mesos-1.9.0-1.el7.x86_64.rpm