[jira] [Updated] (MESOS-2738) Report resources allocated to default executors equally for frameworks and slaves in state.json

["Bernd Mathiske (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MESOS-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bernd Mathiske updated MESOS-2738:
----------------------------------
    Description: 
[~rcorral] recently observed that according to the master's and the slave's state.json summing up the resources allocated to tasks from different frameworks on a slave does not always match the total that is reported for the slave. The latter number is sometimes higher.

It would be desirable for tools that display allocation statistics to find balanced tallies.


  was:
[~rcorral] recently observed that according to state.json summing up the resources allocated to tasks from different frameworks on a slave does not match the total that is reported for the slave. The latter number is higher.

[~adam-mesos] and I have the strong suspicion that when in state.json the sum of all resources allocated to a framework is reported, this does not include the resources for default (command line) executors. However, when the resources of a slave are summed up in state.json, these resources are included in the total. Custom executor resources are included in both cases. Browsing master source code supports this theory.

It would be desirable for tools that display allocation statistics to find balanced tallies.

Possible alternative approaches:
- Exclude default executors from the sum for slaves.
- Include default executors for frameworks and their tasks.
- Emit a global record listing the canonical resource values for default executors, which are always the same. Then the sums of such resources can be determined by multiplying by the number of tasks involved.

Workaround for now: determine the latter amounts by reading Mesos source code and hardcode them into your external tool.


> Report resources allocated to default executors equally for frameworks and slaves in state.json
> -----------------------------------------------------------------------------------------------
>
>                 Key: MESOS-2738
>                 URL: https://issues.apache.org/jira/browse/MESOS-2738
>             Project: Mesos
>          Issue Type: Improvement
>          Components: json api, master
>            Reporter: Bernd Mathiske
>              Labels: mesosphere
>
> [~rcorral] recently observed that according to the master's and the slave's state.json summing up the resources allocated to tasks from different frameworks on a slave does not always match the total that is reported for the slave. The latter number is sometimes higher.
> It would be desirable for tools that display allocation statistics to find balanced tallies.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)