You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@mesos.apache.org by Benjamin Bannier <be...@mesosphere.io> on 2019/02/04 11:14:40 UTC

Re: Review Request 69818: Added offer filters to static framework configuration.

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69818/
-----------------------------------------------------------

(Updated Feb. 4, 2019, 12:14 p.m.)


Review request for mesos, Benjamin Mahler and Meng Zhu.


Changes
-------

Mention behavior of default allocator in protos


Bugs: MESOS-9523
    https://issues.apache.org/jira/browse/MESOS-9523


Repository: mesos


Description (updated)
-------

This patch adds a new field to `FrameworkInfo` which can be used by
frameworks to configure static, per-role resource requirements. We
currently support specifying minimal allocatable resources which is
interpreted by the default, hierarchical allocator for filtering out
resources not relevant to the framework, and for overriding any globally
configured `min_allocatable_resources` on a per framework, per role
basis.

We use a new message `ResourceQuantities` to specify resource
requirements. This class is modelled after the internal class of the
same name, and we provide a conversion from the API to the internal
type.


Diffs (updated)
-----

  include/mesos/mesos.proto 9d5c2b53164adb44eb4a6f12a507e009bd607940 
  include/mesos/v1/mesos.proto aef31eb5b8781182d3f42d935b12470b319027ed 
  src/common/resource_quantities.hpp 11eb426104577bbbbb7977c2307df3e4917085cd 
  src/common/resource_quantities.cpp 320983929cd7d14973c4b98d6ed5338de690ff5f 
  src/master/framework.cpp 4089cf4dfc65ac4dc5a092c04f4c2022ed8a1587 


Diff: https://reviews.apache.org/r/69818/diff/7/

Changes: https://reviews.apache.org/r/69818/diff/6-7/


Testing
-------

`make check`


Thanks,

Benjamin Bannier


Re: Review Request 69818: Added offer filters to static framework configuration.

Posted by Benjamin Mahler <bm...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69818/#review212841
-----------------------------------------------------------


Ship it!




Ship It!

- Benjamin Mahler


On Feb. 14, 2019, 8:45 p.m., Benjamin Bannier wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69818/
> -----------------------------------------------------------
> 
> (Updated Feb. 14, 2019, 8:45 p.m.)
> 
> 
> Review request for mesos, Benjamin Mahler and Meng Zhu.
> 
> 
> Bugs: MESOS-9523
>     https://issues.apache.org/jira/browse/MESOS-9523
> 
> 
> Repository: mesos
> 
> 
> Description
> -------
> 
> This patch adds a new field to `FrameworkInfo` which can be used by
> frameworks to configure static, per-role resource requirements. We
> currently support specifying minimal allocatable resources which is
> interpreted by the default, hierarchical allocator for filtering out
> resources not relevant to the framework, and for overriding any globally
> configured `min_allocatable_resources` on a per framework, per role
> basis.
> 
> We use a new message `ResourceQuantities` to specify resource
> requirements. This class is modelled after the internal class of the
> same name, and we provide a conversion from the API to the internal
> type.
> 
> 
> Diffs
> -----
> 
>   include/mesos/mesos.proto 9d5c2b53164adb44eb4a6f12a507e009bd607940 
>   include/mesos/v1/mesos.proto aef31eb5b8781182d3f42d935b12470b319027ed 
>   src/common/resource_quantities.hpp 11eb426104577bbbbb7977c2307df3e4917085cd 
>   src/common/resource_quantities.cpp 320983929cd7d14973c4b98d6ed5338de690ff5f 
>   src/master/framework.cpp 4089cf4dfc65ac4dc5a092c04f4c2022ed8a1587 
> 
> 
> Diff: https://reviews.apache.org/r/69818/diff/11/
> 
> 
> Testing
> -------
> 
> `make check`
> 
> 
> Thanks,
> 
> Benjamin Bannier
> 
>


Re: Review Request 69818: Added offer filters to static framework configuration.

Posted by Benjamin Bannier <be...@mesosphere.io>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69818/
-----------------------------------------------------------

(Updated Feb. 14, 2019, 9:45 p.m.)


Review request for mesos, Benjamin Mahler and Meng Zhu.


Changes
-------

Update documentation


Bugs: MESOS-9523
    https://issues.apache.org/jira/browse/MESOS-9523


Repository: mesos


Description
-------

This patch adds a new field to `FrameworkInfo` which can be used by
frameworks to configure static, per-role resource requirements. We
currently support specifying minimal allocatable resources which is
interpreted by the default, hierarchical allocator for filtering out
resources not relevant to the framework, and for overriding any globally
configured `min_allocatable_resources` on a per framework, per role
basis.

We use a new message `ResourceQuantities` to specify resource
requirements. This class is modelled after the internal class of the
same name, and we provide a conversion from the API to the internal
type.


Diffs (updated)
-----

  include/mesos/mesos.proto 9d5c2b53164adb44eb4a6f12a507e009bd607940 
  include/mesos/v1/mesos.proto aef31eb5b8781182d3f42d935b12470b319027ed 
  src/common/resource_quantities.hpp 11eb426104577bbbbb7977c2307df3e4917085cd 
  src/common/resource_quantities.cpp 320983929cd7d14973c4b98d6ed5338de690ff5f 
  src/master/framework.cpp 4089cf4dfc65ac4dc5a092c04f4c2022ed8a1587 


Diff: https://reviews.apache.org/r/69818/diff/11/

Changes: https://reviews.apache.org/r/69818/diff/10-11/


Testing
-------

`make check`


Thanks,

Benjamin Bannier


Re: Review Request 69818: Added offer filters to static framework configuration.

Posted by Benjamin Bannier <be...@mesosphere.io>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69818/
-----------------------------------------------------------

(Updated Feb. 11, 2019, 5:19 p.m.)


Review request for mesos, Benjamin Mahler and Meng Zhu.


Changes
-------

Add an example quantity as suggested offline by jdef


Bugs: MESOS-9523
    https://issues.apache.org/jira/browse/MESOS-9523


Repository: mesos


Description
-------

This patch adds a new field to `FrameworkInfo` which can be used by
frameworks to configure static, per-role resource requirements. We
currently support specifying minimal allocatable resources which is
interpreted by the default, hierarchical allocator for filtering out
resources not relevant to the framework, and for overriding any globally
configured `min_allocatable_resources` on a per framework, per role
basis.

We use a new message `ResourceQuantities` to specify resource
requirements. This class is modelled after the internal class of the
same name, and we provide a conversion from the API to the internal
type.


Diffs (updated)
-----

  include/mesos/mesos.proto 9d5c2b53164adb44eb4a6f12a507e009bd607940 
  include/mesos/v1/mesos.proto aef31eb5b8781182d3f42d935b12470b319027ed 
  src/common/resource_quantities.hpp 11eb426104577bbbbb7977c2307df3e4917085cd 
  src/common/resource_quantities.cpp 320983929cd7d14973c4b98d6ed5338de690ff5f 
  src/master/framework.cpp 4089cf4dfc65ac4dc5a092c04f4c2022ed8a1587 


Diff: https://reviews.apache.org/r/69818/diff/10/

Changes: https://reviews.apache.org/r/69818/diff/9-10/


Testing
-------

`make check`


Thanks,

Benjamin Bannier


Re: Review Request 69818: Added offer filters to static framework configuration.

Posted by Benjamin Bannier <be...@mesosphere.io>.

> On Feb. 6, 2019, 6:01 p.m., James DeFelice wrote:
> > include/mesos/mesos.proto
> > Lines 1541 (patched)
> > <https://reviews.apache.org/r/69818/diff/8/?file=2123848#file2123848line1541>
> >
> >     Each `ResourceQuantities` item here represents a "shape" that will be matched against a potential offer, yes?

Yes. Anything you feel is missing currently?


- Benjamin


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69818/#review212609
-----------------------------------------------------------


On Feb. 4, 2019, 9:37 p.m., Benjamin Bannier wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69818/
> -----------------------------------------------------------
> 
> (Updated Feb. 4, 2019, 9:37 p.m.)
> 
> 
> Review request for mesos, Benjamin Mahler and Meng Zhu.
> 
> 
> Bugs: MESOS-9523
>     https://issues.apache.org/jira/browse/MESOS-9523
> 
> 
> Repository: mesos
> 
> 
> Description
> -------
> 
> This patch adds a new field to `FrameworkInfo` which can be used by
> frameworks to configure static, per-role resource requirements. We
> currently support specifying minimal allocatable resources which is
> interpreted by the default, hierarchical allocator for filtering out
> resources not relevant to the framework, and for overriding any globally
> configured `min_allocatable_resources` on a per framework, per role
> basis.
> 
> We use a new message `ResourceQuantities` to specify resource
> requirements. This class is modelled after the internal class of the
> same name, and we provide a conversion from the API to the internal
> type.
> 
> 
> Diffs
> -----
> 
>   include/mesos/mesos.proto 9d5c2b53164adb44eb4a6f12a507e009bd607940 
>   include/mesos/v1/mesos.proto aef31eb5b8781182d3f42d935b12470b319027ed 
>   src/common/resource_quantities.hpp 11eb426104577bbbbb7977c2307df3e4917085cd 
>   src/common/resource_quantities.cpp 320983929cd7d14973c4b98d6ed5338de690ff5f 
>   src/master/framework.cpp 4089cf4dfc65ac4dc5a092c04f4c2022ed8a1587 
> 
> 
> Diff: https://reviews.apache.org/r/69818/diff/8/
> 
> 
> Testing
> -------
> 
> `make check`
> 
> 
> Thanks,
> 
> Benjamin Bannier
> 
>


Re: Review Request 69818: Added offer filters to static framework configuration.

Posted by Benjamin Bannier <be...@mesosphere.io>.

> On Feb. 6, 2019, 6:01 p.m., James DeFelice wrote:
> > include/mesos/mesos.proto
> > Lines 1541 (patched)
> > <https://reviews.apache.org/r/69818/diff/8/?file=2123848#file2123848line1541>
> >
> >     Each `ResourceQuantities` item here represents a "shape" that will be matched against a potential offer, yes?
> 
> Benjamin Bannier wrote:
>     Yes. Anything you feel is missing currently?

I added an example use.


- Benjamin


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69818/#review212609
-----------------------------------------------------------


On Feb. 11, 2019, 5:19 p.m., Benjamin Bannier wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69818/
> -----------------------------------------------------------
> 
> (Updated Feb. 11, 2019, 5:19 p.m.)
> 
> 
> Review request for mesos, Benjamin Mahler and Meng Zhu.
> 
> 
> Bugs: MESOS-9523
>     https://issues.apache.org/jira/browse/MESOS-9523
> 
> 
> Repository: mesos
> 
> 
> Description
> -------
> 
> This patch adds a new field to `FrameworkInfo` which can be used by
> frameworks to configure static, per-role resource requirements. We
> currently support specifying minimal allocatable resources which is
> interpreted by the default, hierarchical allocator for filtering out
> resources not relevant to the framework, and for overriding any globally
> configured `min_allocatable_resources` on a per framework, per role
> basis.
> 
> We use a new message `ResourceQuantities` to specify resource
> requirements. This class is modelled after the internal class of the
> same name, and we provide a conversion from the API to the internal
> type.
> 
> 
> Diffs
> -----
> 
>   include/mesos/mesos.proto 9d5c2b53164adb44eb4a6f12a507e009bd607940 
>   include/mesos/v1/mesos.proto aef31eb5b8781182d3f42d935b12470b319027ed 
>   src/common/resource_quantities.hpp 11eb426104577bbbbb7977c2307df3e4917085cd 
>   src/common/resource_quantities.cpp 320983929cd7d14973c4b98d6ed5338de690ff5f 
>   src/master/framework.cpp 4089cf4dfc65ac4dc5a092c04f4c2022ed8a1587 
> 
> 
> Diff: https://reviews.apache.org/r/69818/diff/10/
> 
> 
> Testing
> -------
> 
> `make check`
> 
> 
> Thanks,
> 
> Benjamin Bannier
> 
>


Re: Review Request 69818: Added offer filters to static framework configuration.

Posted by James DeFelice <ja...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69818/#review212609
-----------------------------------------------------------




include/mesos/mesos.proto
Lines 1541 (patched)
<https://reviews.apache.org/r/69818/#comment298435>

    Each `ResourceQuantities` item here represents a "shape" that will be matched against a potential offer, yes?


- James DeFelice


On Feb. 4, 2019, 8:37 p.m., Benjamin Bannier wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69818/
> -----------------------------------------------------------
> 
> (Updated Feb. 4, 2019, 8:37 p.m.)
> 
> 
> Review request for mesos, Benjamin Mahler and Meng Zhu.
> 
> 
> Bugs: MESOS-9523
>     https://issues.apache.org/jira/browse/MESOS-9523
> 
> 
> Repository: mesos
> 
> 
> Description
> -------
> 
> This patch adds a new field to `FrameworkInfo` which can be used by
> frameworks to configure static, per-role resource requirements. We
> currently support specifying minimal allocatable resources which is
> interpreted by the default, hierarchical allocator for filtering out
> resources not relevant to the framework, and for overriding any globally
> configured `min_allocatable_resources` on a per framework, per role
> basis.
> 
> We use a new message `ResourceQuantities` to specify resource
> requirements. This class is modelled after the internal class of the
> same name, and we provide a conversion from the API to the internal
> type.
> 
> 
> Diffs
> -----
> 
>   include/mesos/mesos.proto 9d5c2b53164adb44eb4a6f12a507e009bd607940 
>   include/mesos/v1/mesos.proto aef31eb5b8781182d3f42d935b12470b319027ed 
>   src/common/resource_quantities.hpp 11eb426104577bbbbb7977c2307df3e4917085cd 
>   src/common/resource_quantities.cpp 320983929cd7d14973c4b98d6ed5338de690ff5f 
>   src/master/framework.cpp 4089cf4dfc65ac4dc5a092c04f4c2022ed8a1587 
> 
> 
> Diff: https://reviews.apache.org/r/69818/diff/8/
> 
> 
> Testing
> -------
> 
> `make check`
> 
> 
> Thanks,
> 
> Benjamin Bannier
> 
>


Re: Review Request 69818: Added offer filters to static framework configuration.

Posted by Benjamin Bannier <be...@mesosphere.io>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69818/
-----------------------------------------------------------

(Updated Feb. 4, 2019, 9:37 p.m.)


Review request for mesos, Benjamin Mahler and Meng Zhu.


Changes
-------

Move a comment from https://reviews.apache.org/r/69821/ here


Bugs: MESOS-9523
    https://issues.apache.org/jira/browse/MESOS-9523


Repository: mesos


Description
-------

This patch adds a new field to `FrameworkInfo` which can be used by
frameworks to configure static, per-role resource requirements. We
currently support specifying minimal allocatable resources which is
interpreted by the default, hierarchical allocator for filtering out
resources not relevant to the framework, and for overriding any globally
configured `min_allocatable_resources` on a per framework, per role
basis.

We use a new message `ResourceQuantities` to specify resource
requirements. This class is modelled after the internal class of the
same name, and we provide a conversion from the API to the internal
type.


Diffs (updated)
-----

  include/mesos/mesos.proto 9d5c2b53164adb44eb4a6f12a507e009bd607940 
  include/mesos/v1/mesos.proto aef31eb5b8781182d3f42d935b12470b319027ed 
  src/common/resource_quantities.hpp 11eb426104577bbbbb7977c2307df3e4917085cd 
  src/common/resource_quantities.cpp 320983929cd7d14973c4b98d6ed5338de690ff5f 
  src/master/framework.cpp 4089cf4dfc65ac4dc5a092c04f4c2022ed8a1587 


Diff: https://reviews.apache.org/r/69818/diff/8/

Changes: https://reviews.apache.org/r/69818/diff/7-8/


Testing
-------

`make check`


Thanks,

Benjamin Bannier


Re: Review Request 69818: Added offer filters to static framework configuration.

Posted by Benjamin Bannier <be...@mesosphere.io>.

> On Feb. 4, 2019, 9:31 p.m., Benjamin Mahler wrote:
> > src/master/framework.cpp
> > Lines 504 (patched)
> > <https://reviews.apache.org/r/69818/diff/7/?file=2123816#file2123816line504>
> >
> >     The comment you mentioned seems to be missing?

Accidentially squashed it into https://reviews.apache.org/r/69821/, fixed now.


- Benjamin


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69818/#review212522
-----------------------------------------------------------


On Feb. 4, 2019, 9:37 p.m., Benjamin Bannier wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69818/
> -----------------------------------------------------------
> 
> (Updated Feb. 4, 2019, 9:37 p.m.)
> 
> 
> Review request for mesos, Benjamin Mahler and Meng Zhu.
> 
> 
> Bugs: MESOS-9523
>     https://issues.apache.org/jira/browse/MESOS-9523
> 
> 
> Repository: mesos
> 
> 
> Description
> -------
> 
> This patch adds a new field to `FrameworkInfo` which can be used by
> frameworks to configure static, per-role resource requirements. We
> currently support specifying minimal allocatable resources which is
> interpreted by the default, hierarchical allocator for filtering out
> resources not relevant to the framework, and for overriding any globally
> configured `min_allocatable_resources` on a per framework, per role
> basis.
> 
> We use a new message `ResourceQuantities` to specify resource
> requirements. This class is modelled after the internal class of the
> same name, and we provide a conversion from the API to the internal
> type.
> 
> 
> Diffs
> -----
> 
>   include/mesos/mesos.proto 9d5c2b53164adb44eb4a6f12a507e009bd607940 
>   include/mesos/v1/mesos.proto aef31eb5b8781182d3f42d935b12470b319027ed 
>   src/common/resource_quantities.hpp 11eb426104577bbbbb7977c2307df3e4917085cd 
>   src/common/resource_quantities.cpp 320983929cd7d14973c4b98d6ed5338de690ff5f 
>   src/master/framework.cpp 4089cf4dfc65ac4dc5a092c04f4c2022ed8a1587 
> 
> 
> Diff: https://reviews.apache.org/r/69818/diff/8/
> 
> 
> Testing
> -------
> 
> `make check`
> 
> 
> Thanks,
> 
> Benjamin Bannier
> 
>


Re: Review Request 69818: Added offer filters to static framework configuration.

Posted by Benjamin Mahler <bm...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/69818/#review212522
-----------------------------------------------------------


Fix it, then Ship it!





src/master/framework.cpp
Lines 504 (patched)
<https://reviews.apache.org/r/69818/#comment298324>

    The comment you mentioned seems to be missing?


- Benjamin Mahler


On Feb. 4, 2019, 11:14 a.m., Benjamin Bannier wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/69818/
> -----------------------------------------------------------
> 
> (Updated Feb. 4, 2019, 11:14 a.m.)
> 
> 
> Review request for mesos, Benjamin Mahler and Meng Zhu.
> 
> 
> Bugs: MESOS-9523
>     https://issues.apache.org/jira/browse/MESOS-9523
> 
> 
> Repository: mesos
> 
> 
> Description
> -------
> 
> This patch adds a new field to `FrameworkInfo` which can be used by
> frameworks to configure static, per-role resource requirements. We
> currently support specifying minimal allocatable resources which is
> interpreted by the default, hierarchical allocator for filtering out
> resources not relevant to the framework, and for overriding any globally
> configured `min_allocatable_resources` on a per framework, per role
> basis.
> 
> We use a new message `ResourceQuantities` to specify resource
> requirements. This class is modelled after the internal class of the
> same name, and we provide a conversion from the API to the internal
> type.
> 
> 
> Diffs
> -----
> 
>   include/mesos/mesos.proto 9d5c2b53164adb44eb4a6f12a507e009bd607940 
>   include/mesos/v1/mesos.proto aef31eb5b8781182d3f42d935b12470b319027ed 
>   src/common/resource_quantities.hpp 11eb426104577bbbbb7977c2307df3e4917085cd 
>   src/common/resource_quantities.cpp 320983929cd7d14973c4b98d6ed5338de690ff5f 
>   src/master/framework.cpp 4089cf4dfc65ac4dc5a092c04f4c2022ed8a1587 
> 
> 
> Diff: https://reviews.apache.org/r/69818/diff/7/
> 
> 
> Testing
> -------
> 
> `make check`
> 
> 
> Thanks,
> 
> Benjamin Bannier
> 
>