You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Benjamin Mahler (JIRA)" <ji...@apache.org> on 2015/02/14 02:21:11 UTC
[jira] [Created] (MESOS-2353) Improve performance of the master's
state.json endpoint for large clusters.
Benjamin Mahler created MESOS-2353:
--------------------------------------
Summary: Improve performance of the master's state.json endpoint for large clusters.
Key: MESOS-2353
URL: https://issues.apache.org/jira/browse/MESOS-2353
Project: Mesos
Issue Type: Improvement
Components: master
Reporter: Benjamin Mahler
The master's state.json endpoint consistently takes a long time to compute the JSON result, for large clusters:
{noformat}
$ time curl -s -o /dev/null localhost:5050/master/state.json; sleep 1; done
Mon Jan 26 22:38:50 UTC 2015
real 0m13.174s
user 0m0.003s
sys 0m0.022s
{noformat}
This can cause the master to get backlogged if there are many state.json requests in flight.
Looking at {{perf}} data, it seems most of the time is spent doing memory allocation / de-allocation. This ticket will try to capture any low hanging fruit to speed this up. Possibly we can leverage moves if they are not already being used by the compiler.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: [jira] [Created] (MESOS-2353) Improve performance of the master's
state.json endpoint for large clusters.
Posted by Dominic Hamon <dh...@twopensource.com>.
Check out reserving maps and vectors up front too if we know what the size
should be.
On Feb 13, 2015 5:21 PM, "Benjamin Mahler (JIRA)" <ji...@apache.org> wrote:
> Benjamin Mahler created MESOS-2353:
> --------------------------------------
>
> Summary: Improve performance of the master's state.json
> endpoint for large clusters.
> Key: MESOS-2353
> URL: https://issues.apache.org/jira/browse/MESOS-2353
> Project: Mesos
> Issue Type: Improvement
> Components: master
> Reporter: Benjamin Mahler
>
>
> The master's state.json endpoint consistently takes a long time to compute
> the JSON result, for large clusters:
>
> {noformat}
> $ time curl -s -o /dev/null localhost:5050/master/state.json; sleep 1; done
> Mon Jan 26 22:38:50 UTC 2015
>
> real 0m13.174s
> user 0m0.003s
> sys 0m0.022s
> {noformat}
>
> This can cause the master to get backlogged if there are many state.json
> requests in flight.
>
> Looking at {{perf}} data, it seems most of the time is spent doing memory
> allocation / de-allocation. This ticket will try to capture any low hanging
> fruit to speed this up. Possibly we can leverage moves if they are not
> already being used by the compiler.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>