You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Virag Kothari <vi...@streamsets.com> on 2015/10/21 23:14:19 UTC

--jars option not working for spark on Mesos in cluster mode

Hi,

I am trying to run a spark job on mesos in cluster mode using the following
command
./bin/spark-submit  --deploy-mode cluster --master mesos://172.17.0.1:7077
 —-jars  http://172.17.0.2:18630/mesos/extraJars.jar --class MyClass
http://172.17.0.2:18630/mesos/foo.jar

The application jar “foo.jar” is downloaded to the working directory of
mesos slave, however the jars passed through —-jars option (extraJars.jar)
are ignored. The client mode works fine.
Is it a bug or am I doing something wrong?

Thanks,
Virag