You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@aurora.apache.org by Mohit Jaggi <mo...@uber.com> on 2017/10/30 21:01:25 UTC
updateconfig doc
Folks,
Does the following doc mean A or B?
*A*: batch_size is the number of instances in a given shard
*B:* batch_size is the number of shards. So every batch has (number of
instances)/(batch_size) tasks.
Mohit.
UpdateConfig Objects
Parameters for controlling the rate and policy of rolling updates.
objecttypedescription
batch_size Integer Maximum number of shards to be updated in one iteration
(Default: 1)
Re: updateconfig doc
Posted by Bill Farner <wf...@apache.org>.
Correct!
On Mon, Oct 30, 2017 at 2:32 PM, Mohit Jaggi <mo...@uber.com> wrote:
> Got it...and wait_for_batch_completion changes this from a "sliding" to a
> "rolling" window ?
>
> On Mon, Oct 30, 2017 at 2:28 PM, Bill Farner <wf...@apache.org> wrote:
>
>> Joshua beat me to the reply, so now you have corroboration for his
>> correction :-)
>>
>> On Mon, Oct 30, 2017 at 2:26 PM, Bill Farner <wf...@apache.org> wrote:
>>
>>> Clarification - shard and instance are (unfortunately) used
>>> interchangeably in some of our docs, despite the fact that shard can have a
>>> different meaning in other contexts.
>>>
>>> The meaning of batch_size doesn't match either rephrasing you offer,
>>> perhaps the docs need work! batch_size effectively tells the updater what
>>> portion of your service may be down in the course of the update. This
>>> becomes the size of a sliding window as the update proceeds across the
>>> instances of the service.
>>>
>>> i.e. if batch_size is 3, the updater will start updating 3 instances
>>> immediately, and proceed through all instances with 3 instances updating a
>>> any time until it reaches the end.
>>>
>>> Does that clarify?
>>>
>>> On Mon, Oct 30, 2017 at 2:01 PM, Mohit Jaggi <mo...@uber.com>
>>> wrote:
>>>
>>>> Folks,
>>>> Does the following doc mean A or B?
>>>>
>>>> *A*: batch_size is the number of instances in a given shard
>>>> *B:* batch_size is the number of shards. So every batch has (number of
>>>> instances)/(batch_size) tasks.
>>>>
>>>> Mohit.
>>>> UpdateConfig Objects
>>>>
>>>> Parameters for controlling the rate and policy of rolling updates.
>>>> objecttypedescription
>>>> batch_size Integer Maximum number of shards to be updated in one
>>>> iteration (Default: 1)
>>>>
>>>
>>>
>>
>
Re: updateconfig doc
Posted by Mohit Jaggi <mo...@uber.com>.
Got it...and wait_for_batch_completion changes this from a "sliding" to a
"rolling" window ?
On Mon, Oct 30, 2017 at 2:28 PM, Bill Farner <wf...@apache.org> wrote:
> Joshua beat me to the reply, so now you have corroboration for his
> correction :-)
>
> On Mon, Oct 30, 2017 at 2:26 PM, Bill Farner <wf...@apache.org> wrote:
>
>> Clarification - shard and instance are (unfortunately) used
>> interchangeably in some of our docs, despite the fact that shard can have a
>> different meaning in other contexts.
>>
>> The meaning of batch_size doesn't match either rephrasing you offer,
>> perhaps the docs need work! batch_size effectively tells the updater what
>> portion of your service may be down in the course of the update. This
>> becomes the size of a sliding window as the update proceeds across the
>> instances of the service.
>>
>> i.e. if batch_size is 3, the updater will start updating 3 instances
>> immediately, and proceed through all instances with 3 instances updating a
>> any time until it reaches the end.
>>
>> Does that clarify?
>>
>> On Mon, Oct 30, 2017 at 2:01 PM, Mohit Jaggi <mo...@uber.com>
>> wrote:
>>
>>> Folks,
>>> Does the following doc mean A or B?
>>>
>>> *A*: batch_size is the number of instances in a given shard
>>> *B:* batch_size is the number of shards. So every batch has (number of
>>> instances)/(batch_size) tasks.
>>>
>>> Mohit.
>>> UpdateConfig Objects
>>>
>>> Parameters for controlling the rate and policy of rolling updates.
>>> objecttypedescription
>>> batch_size Integer Maximum number of shards to be updated in one
>>> iteration (Default: 1)
>>>
>>
>>
>
Re: updateconfig doc
Posted by Bill Farner <wf...@apache.org>.
Joshua beat me to the reply, so now you have corroboration for his
correction :-)
On Mon, Oct 30, 2017 at 2:26 PM, Bill Farner <wf...@apache.org> wrote:
> Clarification - shard and instance are (unfortunately) used
> interchangeably in some of our docs, despite the fact that shard can have a
> different meaning in other contexts.
>
> The meaning of batch_size doesn't match either rephrasing you offer,
> perhaps the docs need work! batch_size effectively tells the updater what
> portion of your service may be down in the course of the update. This
> becomes the size of a sliding window as the update proceeds across the
> instances of the service.
>
> i.e. if batch_size is 3, the updater will start updating 3 instances
> immediately, and proceed through all instances with 3 instances updating a
> any time until it reaches the end.
>
> Does that clarify?
>
> On Mon, Oct 30, 2017 at 2:01 PM, Mohit Jaggi <mo...@uber.com> wrote:
>
>> Folks,
>> Does the following doc mean A or B?
>>
>> *A*: batch_size is the number of instances in a given shard
>> *B:* batch_size is the number of shards. So every batch has (number of
>> instances)/(batch_size) tasks.
>>
>> Mohit.
>> UpdateConfig Objects
>>
>> Parameters for controlling the rate and policy of rolling updates.
>> objecttypedescription
>> batch_size Integer Maximum number of shards to be updated in one
>> iteration (Default: 1)
>>
>
>
Re: updateconfig doc
Posted by Bill Farner <wf...@apache.org>.
Clarification - shard and instance are (unfortunately) used interchangeably
in some of our docs, despite the fact that shard can have a different
meaning in other contexts.
The meaning of batch_size doesn't match either rephrasing you offer,
perhaps the docs need work! batch_size effectively tells the updater what
portion of your service may be down in the course of the update. This
becomes the size of a sliding window as the update proceeds across the
instances of the service.
i.e. if batch_size is 3, the updater will start updating 3 instances
immediately, and proceed through all instances with 3 instances updating a
any time until it reaches the end.
Does that clarify?
On Mon, Oct 30, 2017 at 2:01 PM, Mohit Jaggi <mo...@uber.com> wrote:
> Folks,
> Does the following doc mean A or B?
>
> *A*: batch_size is the number of instances in a given shard
> *B:* batch_size is the number of shards. So every batch has (number of
> instances)/(batch_size) tasks.
>
> Mohit.
> UpdateConfig Objects
>
> Parameters for controlling the rate and policy of rolling updates.
> objecttypedescription
> batch_size Integer Maximum number of shards to be updated in one
> iteration (Default: 1)
>
Re: updateconfig doc
Posted by Mohit Jaggi <mo...@uber.com>.
Thanks. That is what I meant by A. So the doc is a bit misleading. Probably
"Maximum number of instances to be updated...." is clearer.
On Mon, Oct 30, 2017 at 2:11 PM, Joshua Cohen <jc...@apache.org> wrote:
> It's C: batch_size is the number of instances that can be updated at a
> given time.
>
> There's no direct relation between batch size and total number of
> shards/instances. E.g. for a job with 100 instances and a batch size of 10,
> at most 10 instances will be updating at a given time. If it turns out that
> all instances finish updating at exactly the same time, then it would take
> 10 batches to complete the update. However, the more likely scenario is
> that due to scheduling delays, startup times, etc., updates from the
> initial batch will complete at staggered intervals. As individual instances
> complete their update, additional instances will begin their updates to
> keep the number of instances currently updating at batch_size.
>
> Does that make sense?
>
> On Mon, Oct 30, 2017 at 4:01 PM, Mohit Jaggi <mo...@uber.com> wrote:
>
>> Folks,
>> Does the following doc mean A or B?
>>
>> *A*: batch_size is the number of instances in a given shard
>> *B:* batch_size is the number of shards. So every batch has (number of
>> instances)/(batch_size) tasks.
>>
>> Mohit.
>> UpdateConfig Objects
>>
>> Parameters for controlling the rate and policy of rolling updates.
>> objecttypedescription
>> batch_size Integer Maximum number of shards to be updated in one
>> iteration (Default: 1)
>>
>
>
Re: updateconfig doc
Posted by Joshua Cohen <jc...@apache.org>.
It's C: batch_size is the number of instances that can be updated at a
given time.
There's no direct relation between batch size and total number of
shards/instances. E.g. for a job with 100 instances and a batch size of 10,
at most 10 instances will be updating at a given time. If it turns out that
all instances finish updating at exactly the same time, then it would take
10 batches to complete the update. However, the more likely scenario is
that due to scheduling delays, startup times, etc., updates from the
initial batch will complete at staggered intervals. As individual instances
complete their update, additional instances will begin their updates to
keep the number of instances currently updating at batch_size.
Does that make sense?
On Mon, Oct 30, 2017 at 4:01 PM, Mohit Jaggi <mo...@uber.com> wrote:
> Folks,
> Does the following doc mean A or B?
>
> *A*: batch_size is the number of instances in a given shard
> *B:* batch_size is the number of shards. So every batch has (number of
> instances)/(batch_size) tasks.
>
> Mohit.
> UpdateConfig Objects
>
> Parameters for controlling the rate and policy of rolling updates.
> objecttypedescription
> batch_size Integer Maximum number of shards to be updated in one
> iteration (Default: 1)
>