mesos running spark - lib issue

[Eyal Levy <el...@gmail.com>]

Hello everyone

I am trying to run spark on mesos using Tomcat application
(Trying to creating Spark context within the web application)
when running spark driver from the command line it works perfectly and I
can see the executor of spark through the mesos UI , e.g.
 /bin/spark-shell --master mesos://<ip>:5050

but when I try to create the Spark Context through the java code (running
inside tomcat on different machine) I got error regarding the
java.library.path that it missing the mesos lib (*nested exception is
java.lang.UnsatisfiedLinkError: no mesos in java.library.path*)
so, I define the lib as "export MESOS_NATIVE_LIBRARY=/usr/lib/
libmesos-0.19.0.so" and it found the mesos lib
but now I am encounter new issue within the dependency of this lib

*java.lang.UnsatisfiedLinkError: /usr/lib/libmesos-0.19.0.so
<http://libmesos-0.19.0.so/>: /usr/lib64/libstdc++.so.6: version
`GLIBCXX_3.4.18' not found (required by /usr/lib/libmesos-0.19.0.so
<http://libmesos-0.19.0.so/>)*

I am running on CentOS 6.5

*any help on this issue will be appreciated, *

another Question:
*How can I run tomcat on window machine using mesos?*

*Best regards*

*Eyal Levy*, elevy30@gmail.com
<ht...@gmail.com>

Re: mesos running spark - lib issue

[Benjamin Hindman <be...@gmail.com>]

Hey Eyal,

It sounds like the version of libstdc++ that the JVM is linking with is not
sufficient for what libmesos.so was compiled against. Did you build Mesos
yourself? If so, are you sure that the machine you built Mesos on has the
same libraries as the machine where you're running Mesos (i.e., the Tomcat
machine)?

Ben.




On Mon, Jun 23, 2014 at 2:24 AM, Eyal Levy <el...@gmail.com> wrote:

> Hello everyone
>
> I am trying to run spark on mesos using Tomcat application
> (Trying to creating Spark context within the web application)
> when running spark driver from the command line it works perfectly and I
> can see the executor of spark through the mesos UI , e.g.
>  /bin/spark-shell --master mesos://<ip>:5050
>
> but when I try to create the Spark Context through the java code (running
> inside tomcat on different machine) I got error regarding the
> java.library.path that it missing the mesos lib (*nested exception is
> java.lang.UnsatisfiedLinkError: no mesos in java.library.path*)
> so, I define the lib as "export MESOS_NATIVE_LIBRARY=/usr/lib/
> libmesos-0.19.0.so" and it found the mesos lib
> but now I am encounter new issue within the dependency of this lib
>
> *java.lang.UnsatisfiedLinkError: /usr/lib/libmesos-0.19.0.so
> <http://libmesos-0.19.0.so/>: /usr/lib64/libstdc++.so.6: version
> `GLIBCXX_3.4.18' not found (required by /usr/lib/libmesos-0.19.0.so
> <http://libmesos-0.19.0.so/>)*
>
>  I am running on CentOS 6.5
>
> *any help on this issue will be appreciated, *
>
> another Question:
> *How can I run tomcat on window machine using mesos?*
>
> *Best regards*
>
> *Eyal Levy*, elevy30@gmail.com
> <ht...@gmail.com>
>
>
>