You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Dale Johnson <da...@ebay.com> on 2014/07/23 08:53:11 UTC
Re: Spark 0.9.1 core dumps on Mesos 0.18.0
I'm having the exact same problem. I tried Mesos 0.19, 0.14.2, 0.14.1,
hadoop 2.3.0, spark 0.9.1.
# SIGSEGV (0xb) at pc=0x00007fab70c55c4d, pid=31012, tid=140366980314880
#
# JRE version: 6.0_31-b31
# Java VM: OpenJDK 64-Bit Server VM (23.25-b01 mixed mode linux-amd64
compressed oops)
# Problematic frame:
# V [libjvm.so+0x529c4d] jni_GetByteArrayElements+0x5d
It's on ubuntu. No hadoop, yarn or zookeeper. It seems to happen when
launching the connection to the mesos server. It's a complete showstopper.
Dale.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-0-9-1-core-dumps-on-Mesos-0-18-0-tp4392p10470.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: Spark 0.9.1 core dumps on Mesos 0.18.0
Posted by qingyang li <li...@gmail.com>.
hi, dale , yes, that could work. But new problem comes：
----------task always lost-----
14/07/31 16:46:29 INFO TaskSetManager: Starting task 0.0:1 as TID 20 on
executor 20140731-154806-1694607552-5050-4716-7: bigdata008 (PROCESS_LOCAL)
14/07/31 16:46:29 INFO TaskSetManager: Serialized task 0.0:1 as 1559 bytes
in 1 ms
14/07/31 16:46:29 INFO TaskSetManager: Re-queueing tasks for
20140731-154806-1694607552-5050-4716-7 from TaskSet 0.0
14/07/31 16:46:29 WARN TaskSetManager: Lost TID 20 (task 0.0:1)
14/07/31 16:46:29 WARN TaskSetManager: Lost TID 18 (task 0.0:0)
14/07/31 16:46:29 INFO DAGScheduler: Executor lost:
20140731-154806-1694607552-5050-4716-7 (epoch 13)
14/07/31 16:46:29 INFO BlockManagerMasterActor: Trying to remove executor
20140731-154806-1694607552-5050-4716-7 from BlockManagerMaster.
-------------
have you encounter this problem?
2014-07-23 15:40 GMT+08:00 Dale Johnson <da...@ebay.com>:
> Okay, I finally got this. The project/SparkBuild needed to be set, and
> only
> 0.19.0 seems to work (out of 0.14.1, 0.14.2).
>
> "org.apache.mesos" % "mesos" % "0.19.0",
>
> was the one that worked.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-0-9-1-core-dumps-on-Mesos-0-18-0-tp4392p10477.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
Re: Spark 0.9.1 core dumps on Mesos 0.18.0
Posted by Dale Johnson <da...@ebay.com>.
Okay, I finally got this. The project/SparkBuild needed to be set, and only
0.19.0 seems to work (out of 0.14.1, 0.14.2).
"org.apache.mesos" % "mesos" % "0.19.0",
was the one that worked.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-0-9-1-core-dumps-on-Mesos-0-18-0-tp4392p10477.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.