You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by Wil Yegelwel <wy...@gmail.com> on 2016/06/17 17:33:57 UTC
Order of URIs in CommandInfo protobuf
I'm curious whether there is an ordering assumption on the CommandInfo
protobuf or if the order does not matter. The comment in mesos.proto, "Any
URIs specified are fetched before executing the command" seems to imply
that ordering does not matter. I just wanted to confirm that was the case.
Thanks,
Wil
Re: Order of URIs in CommandInfo protobuf
Posted by Zhitao Li <zh...@gmail.com>.
Hi Robert,
I also think parallelization of fetching is important for many use cases to
reduce the time it takes to launch a task. Can we make sure the it's still
possible to parallel downloads if you file a feature request?
Also, when a task is launched, all URIs should be already fetched into
sandbox, so I'm very interested how out-of-order could break your use case.
On Mon, Jun 20, 2016 at 12:36 PM, Jie Yu <yu...@gmail.com> wrote:
> Robert, I just checked the code and the ordering is not guaranteed since
> we parallelize the download currently.
>
> This sounds like a feature request. Robert, do you want to create a
> ticket? For now, i think a startup script should be able to workaround that.
>
> On Mon, Jun 20, 2016 at 11:02 AM, Robert Lacroix <rl...@apple.com>
> wrote:
>
>> Jie, would it hurt if we would guarantee ordering of URIs? I could see
>> use cases where the order in which files are extracted matters. Protobuf
>> preserves ordering of repeated fields, so it shouldn't be a huge effort (it
>> probably already works).
>>
>> Robert
>>
>> On Jun 17, 2016, at 7:37 PM, Jie Yu <yu...@gmail.com> wrote:
>>
>> There is no ordering assumption in the API.
>>
>> - Jie
>>
>> On Fri, Jun 17, 2016 at 10:33 AM, Wil Yegelwel <wy...@gmail.com>
>> wrote:
>>
>>> I'm curious whether there is an ordering assumption on the CommandInfo
>>> protobuf or if the order does not matter. The comment in mesos.proto, "Any
>>> URIs specified are fetched before executing the command" seems to imply
>>> that ordering does not matter. I just wanted to confirm that was the case.
>>>
>>> Thanks,
>>> Wil
>>>
>>
>>
>>
>
--
Cheers,
Zhitao Li
Re: Order of URIs in CommandInfo protobuf
Posted by Jie Yu <yu...@gmail.com>.
Robert, I just checked the code and the ordering is not guaranteed since we
parallelize the download currently.
This sounds like a feature request. Robert, do you want to create a ticket?
For now, i think a startup script should be able to workaround that.
On Mon, Jun 20, 2016 at 11:02 AM, Robert Lacroix <rl...@apple.com> wrote:
> Jie, would it hurt if we would guarantee ordering of URIs? I could see use
> cases where the order in which files are extracted matters. Protobuf
> preserves ordering of repeated fields, so it shouldn't be a huge effort (it
> probably already works).
>
> Robert
>
> On Jun 17, 2016, at 7:37 PM, Jie Yu <yu...@gmail.com> wrote:
>
> There is no ordering assumption in the API.
>
> - Jie
>
> On Fri, Jun 17, 2016 at 10:33 AM, Wil Yegelwel <wy...@gmail.com>
> wrote:
>
>> I'm curious whether there is an ordering assumption on the CommandInfo
>> protobuf or if the order does not matter. The comment in mesos.proto, "Any
>> URIs specified are fetched before executing the command" seems to imply
>> that ordering does not matter. I just wanted to confirm that was the case.
>>
>> Thanks,
>> Wil
>>
>
>
>
Re: Order of URIs in CommandInfo protobuf
Posted by Robert Lacroix <rl...@apple.com>.
Jie, would it hurt if we would guarantee ordering of URIs? I could see use cases where the order in which files are extracted matters. Protobuf preserves ordering of repeated fields, so it shouldn't be a huge effort (it probably already works).
Robert
> On Jun 17, 2016, at 7:37 PM, Jie Yu <yu...@gmail.com> wrote:
>
> There is no ordering assumption in the API.
>
> - Jie
>
> On Fri, Jun 17, 2016 at 10:33 AM, Wil Yegelwel <wyegelwel@gmail.com <ma...@gmail.com>> wrote:
> I'm curious whether there is an ordering assumption on the CommandInfo protobuf or if the order does not matter. The comment in mesos.proto, "Any URIs specified are fetched before executing the command" seems to imply that ordering does not matter. I just wanted to confirm that was the case.
>
> Thanks,
> Wil
>
Re: Order of URIs in CommandInfo protobuf
Posted by Jie Yu <yu...@gmail.com>.
There is no ordering assumption in the API.
- Jie
On Fri, Jun 17, 2016 at 10:33 AM, Wil Yegelwel <wy...@gmail.com> wrote:
> I'm curious whether there is an ordering assumption on the CommandInfo
> protobuf or if the order does not matter. The comment in mesos.proto, "Any
> URIs specified are fetched before executing the command" seems to imply
> that ordering does not matter. I just wanted to confirm that was the case.
>
> Thanks,
> Wil
>