You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Benjamin Mahler (JIRA)" <ji...@apache.org> on 2015/02/14 02:24:11 UTC
[jira] [Updated] (MESOS-2353) Improve performance of the master's
state.json endpoint for large clusters.
[ https://issues.apache.org/jira/browse/MESOS-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benjamin Mahler updated MESOS-2353:
-----------------------------------
Description:
The master's state.json endpoint consistently takes a long time to compute the JSON result, for large clusters:
{noformat}
$ time curl -s -o /dev/null localhost:5050/master/state.json
Mon Jan 26 22:38:50 UTC 2015
real 0m13.174s
user 0m0.003s
sys 0m0.022s
{noformat}
This can cause the master to get backlogged if there are many state.json requests in flight.
Looking at {{perf}} data, it seems most of the time is spent doing memory allocation / de-allocation. This ticket will try to capture any low hanging fruit to speed this up. Possibly we can leverage moves if they are not already being used by the compiler.
was:
The master's state.json endpoint consistently takes a long time to compute the JSON result, for large clusters:
{noformat}
$ time curl -s -o /dev/null localhost:5050/master/state.json; sleep 1; done
Mon Jan 26 22:38:50 UTC 2015
real 0m13.174s
user 0m0.003s
sys 0m0.022s
{noformat}
This can cause the master to get backlogged if there are many state.json requests in flight.
Looking at {{perf}} data, it seems most of the time is spent doing memory allocation / de-allocation. This ticket will try to capture any low hanging fruit to speed this up. Possibly we can leverage moves if they are not already being used by the compiler.
> Improve performance of the master's state.json endpoint for large clusters.
> ---------------------------------------------------------------------------
>
> Key: MESOS-2353
> URL: https://issues.apache.org/jira/browse/MESOS-2353
> Project: Mesos
> Issue Type: Improvement
> Components: master
> Reporter: Benjamin Mahler
> Labels: twitter
>
> The master's state.json endpoint consistently takes a long time to compute the JSON result, for large clusters:
> {noformat}
> $ time curl -s -o /dev/null localhost:5050/master/state.json
> Mon Jan 26 22:38:50 UTC 2015
> real 0m13.174s
> user 0m0.003s
> sys 0m0.022s
> {noformat}
> This can cause the master to get backlogged if there are many state.json requests in flight.
> Looking at {{perf}} data, it seems most of the time is spent doing memory allocation / de-allocation. This ticket will try to capture any low hanging fruit to speed this up. Possibly we can leverage moves if they are not already being used by the compiler.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)