You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by Mudit Kumar <mk...@sapient.com> on 2016/10/24 16:12:38 UTC

Spark on mesos

Hi,
I want to setup mesos cluster then setup spark and hdfs on mesos to run few examples and POC jobs.
Any direction for good documentation.

Thanks,
Mudit

Re: Spark on mesos

Posted by Yu Wei <yu...@hotmail.com>.
Although DC/OS could be used. However, is there any approach to customize authentication with DC/OS?


Thanks,

Jared, (韦煜）
Software developer
Interested in open source software, big data, Linux

________________________________
From: Guillermo Rodriguez <gu...@spritekin.com>
Sent: Tuesday, October 25, 2016 8:59:23 AM
To: user@mesos.apache.org
Subject: re: Spark on mesos

If just testing, use mesosphere scripts.
https://dcos.io/

Lots of things done for you. I don't think you need you will need anything else until you reach production and need a costomised setup.


________________________________
From: "Mudit Kumar" <mk...@sapient.com>
Sent: Tuesday, October 25, 2016 3:13 AM
To: "user@mesos.apache.org" <us...@mesos.apache.org>
Subject: Spark on mesos

Hi,
I want to setup mesos cluster then setup spark and hdfs on mesos to run few examples and POC jobs.
Any direction for good documentation.

Thanks,
Mudit

re: Spark on mesos

Posted by Guillermo Rodriguez <gu...@spritekin.com>.
If just testing, use mesosphere scripts.
 https://dcos.io/
  
 Lots of things done for you. I don't think you need you will need anything 
else until you reach production and need a costomised setup.
  
  

----------------------------------------
 From: "Mudit Kumar" <mk...@sapient.com>
Sent: Tuesday, October 25, 2016 3:13 AM
To: "user@mesos.apache.org" <us...@mesos.apache.org>
Subject: Spark on mesos   

Hi,  

I want to setup mesos cluster then setup spark and hdfs on mesos to run few 
examples and POC jobs.  

Any direction for good documentation.  

   

Thanks,  

Mudit

Re: Spark on mesos

Posted by Radoslaw Gruchalski <ra...@gruchalski.com>.
Hi Mudit,

This sounds like a great place to start:
http://spark.apache.org/docs/latest/running-on-mesos.html
Eventually, you may want to look at DC/OS:
https://docs.mesosphere.com/1.7/usage/service-guides/spark/

–
Best regards,
Radek Gruchalski
radek@gruchalski.com


On October 24, 2016 at 12:12:54 PM, Mudit Kumar (mkumar128@sapient.com)
wrote:

Hi,

I want to setup mesos cluster then setup spark and hdfs on mesos to run few
examples and POC jobs.

Any direction for good documentation.



Thanks,

Mudit