You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Shay Seng <sh...@1618labs.com> on 2013/10/08 19:15:23 UTC
spark_ec2 script in 0.8.0 and mesos
Hi,
The "http://spark.incubator.apache.org/docs/latest/running-on-mesos.html"
running on mesos web page says that the spark_ec2 script provides and easy
way to launch spark cluster with mesos configured.
In 0.7.3, the spark_ec2 script had a --cluster-type option, but that seems
to be taken out of the 0.8.0 version...
Any tips on how I can configure and run spark on mesos?
Also I have a couple of suggestions for the spark_ec2 scripts is there
somewhere I can post feature requests?
tks,
Shay
Re: spark_ec2 script in 0.8.0 and mesos
Posted by Aaron Davidson <il...@gmail.com>.
Also, please post feature requests here: http://spark-project.atlassian.net
Make sure to search prior to posting to avoid duplicates.
On Tue, Oct 8, 2013 at 11:50 AM, Matei Zaharia <ma...@gmail.com>wrote:
> Hi Shay,
>
> We actually don't support Mesos in the EC2 scripts anymore -- sorry about
> that. If you want to deploy Mesos on EC2, I'd recommend looking at Mesos's
> own EC2 scripts. Then it's fairly easy to launch Spark on there. If you
> want to deploy Mesos locally you can go through the Spark docs for that.
>
> Matei
>
> On Oct 8, 2013, at 10:15 AM, Shay Seng <sh...@1618labs.com> wrote:
>
>
> Hi,
> The "http://spark.incubator.apache.org/docs/latest/running-on-mesos.html"
> running on mesos web page says that the spark_ec2 script provides and easy
> way to launch spark cluster with mesos configured.
>
> In 0.7.3, the spark_ec2 script had a --cluster-type option, but that seems
> to be taken out of the 0.8.0 version...
>
> Any tips on how I can configure and run spark on mesos?
>
> Also I have a couple of suggestions for the spark_ec2 scripts is there
> somewhere I can post feature requests?
>
> tks,
> Shay
>
>
>
Re: spark_ec2 script in 0.8.0 and mesos
Posted by Matei Zaharia <ma...@gmail.com>.
Hi Shay,
We actually don't support Mesos in the EC2 scripts anymore -- sorry about that. If you want to deploy Mesos on EC2, I'd recommend looking at Mesos's own EC2 scripts. Then it's fairly easy to launch Spark on there. If you want to deploy Mesos locally you can go through the Spark docs for that.
Matei
On Oct 8, 2013, at 10:15 AM, Shay Seng <sh...@1618labs.com> wrote:
>
> Hi,
> The "http://spark.incubator.apache.org/docs/latest/running-on-mesos.html" running on mesos web page says that the spark_ec2 script provides and easy way to launch spark cluster with mesos configured.
>
> In 0.7.3, the spark_ec2 script had a --cluster-type option, but that seems to be taken out of the 0.8.0 version...
>
> Any tips on how I can configure and run spark on mesos?
>
> Also I have a couple of suggestions for the spark_ec2 scripts is there somewhere I can post feature requests?
>
> tks,
> Shay