[jira] [Created] (SPARK-1702) Mesos executor won't start because of a ClassNotFoundException

["Bouke van der Bijl (JIRA)" <ji...@apache.org>]

Bouke van der Bijl created SPARK-1702:
-----------------------------------------

             Summary: Mesos executor won't start because of a ClassNotFoundException
                 Key: SPARK-1702
                 URL: https://issues.apache.org/jira/browse/SPARK-1702
             Project: Spark
          Issue Type: Bug
          Components: Mesos
    Affects Versions: 1.0.0
            Reporter: Bouke van der Bijl


Some discussion here: http://apache-spark-user-list.1001560.n3.nabble.com/java-lang-ClassNotFoundException-spark-on-mesos-td3510.html

Fix here (which is probably not the right fix): https://github.com/apache/spark/pull/620

This was broken in v0.9.0, was fixed in v0.9.1 and is now broken again.

Error in Mesos executor stderr:

WARNING: Logging before InitGoogleLogging() is written to STDERR
I0502 17:31:42.672224 14688 exec.cpp:131] Version: 0.18.0
I0502 17:31:42.674959 14707 exec.cpp:205] Executor registered on slave 20140501-182306-16842879-5050-10155-0
14/05/02 17:31:42 INFO MesosExecutorBackend: Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
14/05/02 17:31:42 INFO MesosExecutorBackend: Registered with Mesos as executor ID 20140501-182306-16842879-5050-10155-0
14/05/02 17:31:43 INFO SecurityManager: Changing view acls to: vagrant
14/05/02 17:31:43 INFO SecurityManager: SecurityManager, is authentication enabled: false are ui acls enabled: false users with view permissions: Set(vagrant)
14/05/02 17:31:43 INFO Slf4jLogger: Slf4jLogger started
14/05/02 17:31:43 INFO Remoting: Starting remoting
14/05/02 17:31:43 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://spark@localhost:50843]
14/05/02 17:31:43 INFO Remoting: Remoting now listens on addresses: [akka.tcp://spark@localhost:50843]
java.lang.ClassNotFoundException: org/apache/spark/serializer/JavaSerializer
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:270)
    at org.apache.spark.SparkEnv$.instantiateClass$1(SparkEnv.scala:165)
    at org.apache.spark.SparkEnv$.create(SparkEnv.scala:176)
    at org.apache.spark.executor.Executor.<init>(Executor.scala:106)
    at org.apache.spark.executor.MesosExecutorBackend.registered(MesosExecutorBackend.scala:56)
Exception in thread "Thread-0" I0502 17:31:43.710039 14707 exec.cpp:412] Deactivating the executor libprocess


The problem is that it can't find the class. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)