You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by kant kodali <ka...@gmail.com> on 2017/02/04 06:08:17 UTC

can I use Spark Standalone with HDFS but no YARN

can I use Spark Standalone with HDFS but no YARN?

Thanks!

Re: can I use Spark Standalone with HDFS but no YARN

Posted by kant kodali <ka...@gmail.com>.

I have 3 Spark Masters colocated with ZK's nodes and 2 Workers nodes. so my
NameNodes are the same nodes as my spark master and DataNodes are the same
Nodes as my Spark Workers. is that correct? How do I setup HDFS with
zookeeper?

On Fri, Feb 3, 2017 at 10:27 PM, Mark Hamstra <ma...@clearstorydata.com>
wrote:

> yes
>
> On Fri, Feb 3, 2017 at 10:08 PM, kant kodali <ka...@gmail.com> wrote:
>
>> can I use Spark Standalone with HDFS but no YARN?
>>
>> Thanks!
>>
>
>

Re: can I use Spark Standalone with HDFS but no YARN

Posted by kant kodali <ka...@gmail.com>.

On Fri, Feb 3, 2017 at 10:27 PM, Mark Hamstra <ma...@clearstorydata.com>
wrote:

> yes
>
> On Fri, Feb 3, 2017 at 10:08 PM, kant kodali <ka...@gmail.com> wrote:
>
>> can I use Spark Standalone with HDFS but no YARN?
>>
>> Thanks!
>>
>
>

Re: can I use Spark Standalone with HDFS but no YARN

Posted by Mark Hamstra <ma...@clearstorydata.com>.

yes

On Fri, Feb 3, 2017 at 10:08 PM, kant kodali <ka...@gmail.com> wrote:

> can I use Spark Standalone with HDFS but no YARN?
>
> Thanks!
>