You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by qingyang li <li...@gmail.com> on 2014/06/17 09:50:29 UTC

Re: Spark 0.9.1 core dumps on Mesos 0.18.0

hi, steven,  have you resolved this problem?   i encounter the same
problem, too.


2014-04-18 3:48 GMT+08:00 Sean Owen <so...@cloudera.com>:

> Oh dear I read this as a build problem. I can build with the latest
> Java 7, including those versions of Spark and Mesos, no problem. I did
> not deploy them.
>
> Mesos does have some native libraries, so it might well be some kind
> of compatibility issue at that level. Anything more in the error log
> that would demonstrate it came from Mesos vs the JDK?
>
> (I likely don't have anything useful to add here though)
>
> On Thu, Apr 17, 2014 at 8:21 PM, andy petrella <an...@gmail.com>
> wrote:
> > No of course, but I was guessing some native libs imported (to
> communicate
> > with Mesos) in the project that... could miserably crash the JVM.
> >
> > Anyway, so you tell us that using this oracle version, you don't have any
> > issues when using spark on mesos 0.18.0, that's interesting 'cause
> AFAIR, my
> > last test (done by night, which means floating and eventual memory) I was
> > using this particular version as well.
> >
> > Just to make thing clear, Sean, you're using spark 0.9.1 on Mesos 0.18.0
> > with Hadoop 2.x (x >= 2) without any modification than just specifying
> > against which version of hadoop you had run make-distribution?
>

Re: Spark 0.9.1 core dumps on Mesos 0.18.0

Posted by qingyang li <li...@gmail.com>.
i am using spark 0.9.1 , mesos 0.19.0  and tachyon 0.4.1 ,  is spark0.9.1
compatiable with mesos0.19.0?


2014-06-17 15:50 GMT+08:00 qingyang li <li...@gmail.com>:

> hi, steven,  have you resolved this problem?   i encounter the same
> problem, too.
>
>
> 2014-04-18 3:48 GMT+08:00 Sean Owen <so...@cloudera.com>:
>
> Oh dear I read this as a build problem. I can build with the latest
>> Java 7, including those versions of Spark and Mesos, no problem. I did
>> not deploy them.
>>
>> Mesos does have some native libraries, so it might well be some kind
>> of compatibility issue at that level. Anything more in the error log
>> that would demonstrate it came from Mesos vs the JDK?
>>
>> (I likely don't have anything useful to add here though)
>>
>> On Thu, Apr 17, 2014 at 8:21 PM, andy petrella <an...@gmail.com>
>> wrote:
>> > No of course, but I was guessing some native libs imported (to
>> communicate
>> > with Mesos) in the project that... could miserably crash the JVM.
>> >
>> > Anyway, so you tell us that using this oracle version, you don't have
>> any
>> > issues when using spark on mesos 0.18.0, that's interesting 'cause
>> AFAIR, my
>> > last test (done by night, which means floating and eventual memory) I
>> was
>> > using this particular version as well.
>> >
>> > Just to make thing clear, Sean, you're using spark 0.9.1 on Mesos 0.18.0
>> > with Hadoop 2.x (x >= 2) without any modification than just specifying
>> > against which version of hadoop you had run make-distribution?
>>
>
>