You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Eugene Morozov <ev...@gmail.com> on 2016/03/08 01:25:11 UTC
Dynamic allocation availability on standalone mode. Misleading doc.
Hi, the feature looks like the one I'd like to use, but there are two
different descriptions in the docs of whether it's available.
I'm on a standalone deployment mode and here:
http://spark.apache.org/docs/latest/configuration.html it's specified the
feature is available only for YARN, but here:
http://spark.apache.org/docs/latest/job-scheduling.html#dynamic-resource-allocation
it says it's available on all coarse-grained cluster managers including
standalone.
So, is the feature available in standalone mode?
Thank you.
--
Be well!
Jean Morozov
Re: Dynamic allocation availability on standalone mode. Misleading doc.
Posted by Reynold Xin <rx...@databricks.com>.
The doc fix was merged in 1.6.1, so it will get updated automatically once
we push the 1.6.1 docs.
On Mon, Mar 7, 2016 at 5:40 PM, Saisai Shao <sa...@gmail.com> wrote:
> Yes, we need to fix the document.
>
> On Tue, Mar 8, 2016 at 9:07 AM, Mark Hamstra <ma...@clearstorydata.com>
> wrote:
>
>> Yes, it works in standalone mode.
>>
>> On Mon, Mar 7, 2016 at 4:25 PM, Eugene Morozov <
>> evgeny.a.morozov@gmail.com> wrote:
>>
>>> Hi, the feature looks like the one I'd like to use, but there are two
>>> different descriptions in the docs of whether it's available.
>>>
>>> I'm on a standalone deployment mode and here:
>>> http://spark.apache.org/docs/latest/configuration.html it's specified
>>> the feature is available only for YARN, but here:
>>> http://spark.apache.org/docs/latest/job-scheduling.html#dynamic-resource-allocation
>>> it says it's available on all coarse-grained cluster managers including
>>> standalone.
>>>
>>> So, is the feature available in standalone mode?
>>>
>>> Thank you.
>>> --
>>> Be well!
>>> Jean Morozov
>>>
>>
>>
>
Re: Dynamic allocation availability on standalone mode. Misleading doc.
Posted by Saisai Shao <sa...@gmail.com>.
Yes, we need to fix the document.
On Tue, Mar 8, 2016 at 9:07 AM, Mark Hamstra <ma...@clearstorydata.com>
wrote:
> Yes, it works in standalone mode.
>
> On Mon, Mar 7, 2016 at 4:25 PM, Eugene Morozov <evgeny.a.morozov@gmail.com
> > wrote:
>
>> Hi, the feature looks like the one I'd like to use, but there are two
>> different descriptions in the docs of whether it's available.
>>
>> I'm on a standalone deployment mode and here:
>> http://spark.apache.org/docs/latest/configuration.html it's specified
>> the feature is available only for YARN, but here:
>> http://spark.apache.org/docs/latest/job-scheduling.html#dynamic-resource-allocation
>> it says it's available on all coarse-grained cluster managers including
>> standalone.
>>
>> So, is the feature available in standalone mode?
>>
>> Thank you.
>> --
>> Be well!
>> Jean Morozov
>>
>
>
Re: Dynamic allocation availability on standalone mode. Misleading doc.
Posted by Mark Hamstra <ma...@clearstorydata.com>.
Yes, it works in standalone mode.
On Mon, Mar 7, 2016 at 4:25 PM, Eugene Morozov <ev...@gmail.com>
wrote:
> Hi, the feature looks like the one I'd like to use, but there are two
> different descriptions in the docs of whether it's available.
>
> I'm on a standalone deployment mode and here:
> http://spark.apache.org/docs/latest/configuration.html it's specified the
> feature is available only for YARN, but here:
> http://spark.apache.org/docs/latest/job-scheduling.html#dynamic-resource-allocation
> it says it's available on all coarse-grained cluster managers including
> standalone.
>
> So, is the feature available in standalone mode?
>
> Thank you.
> --
> Be well!
> Jean Morozov
>