You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by Ray Rodriguez <ra...@gmail.com> on 2014/06/26 21:13:06 UTC
Mesos 0.19.0 stats.json endpoint Collectd plugin
Hey everyone just thought I'd post a simple collectd python plugin that I
just released which turns all stats returned from the Mesos stats.json
endpoint into Collectd metrics.
This plugin requires Mesos 0.19.0+ and collectd 4.9+
Big shout out to phobos182(https://github.com/phobos182) who wrote the
original Elasticsearch collectd python plugin upon which my plugin borrows
from heavily.
Mesos Collectd Python plugin: https://github.com/rayrod2030/collectd-mesos
Hope this is useful to others and I welcome pull requests, comments and
suggestions.
Ray Rodriguez
Twitter: @rayray2030
Github: rayrod2030
Re: Mesos 0.19.0 stats.json endpoint Collectd plugin
Posted by Benjamin Hindman <be...@gmail.com>.
Thanks for sharing this Ray!
On Thu, Jun 26, 2014 at 12:13 PM, Ray Rodriguez <ra...@gmail.com>
wrote:
> Hey everyone just thought I'd post a simple collectd python plugin that I
> just released which turns all stats returned from the Mesos stats.json
> endpoint into Collectd metrics.
>
> This plugin requires Mesos 0.19.0+ and collectd 4.9+
>
> Big shout out to phobos182(https://github.com/phobos182) who wrote the
> original Elasticsearch collectd python plugin upon which my plugin borrows
> from heavily.
>
> Mesos Collectd Python plugin: https://github.com/rayrod2030/collectd-mesos
>
> Hope this is useful to others and I welcome pull requests, comments and
> suggestions.
>
> Ray Rodriguez
> Twitter: @rayray2030
> Github: rayrod2030
>
Re: Mesos 0.19.0 stats.json endpoint Collectd plugin
Posted by Dominic Hamon <dh...@twopensource.com>.
Hi Dave
The JIRA is here: https://issues.apache.org/jira/browse/MESOS-1036
There's a link in the comments to the design document.
On Mon, Jul 7, 2014 at 11:14 AM, Dave Lester <da...@gmail.com> wrote:
> Hey Dominic, is there a specific review or JIRA issue that you could point
> to re: the new stats endpoint?
>
> Thanks,
> Dave
>
>
> On Thu, Jun 26, 2014 at 1:26 PM, Dominic Hamon <dh...@twitter.com> wrote:
>
>> In 0.20, stats.json is completely represented by the new endpoint.
>> stats.json will be deprecated in one of the next few versions.
>> On Jun 26, 2014 1:10 PM, "Ray Rodriguez" <ra...@gmail.com> wrote:
>>
>>> Hey Ben, It looks like /metrics/snapshot is a subset of the metrics
>>> exposed from /stats.json. Is stats.json eventually going to be deprecated?
>>> Why collect less metrics in this case?
>>>
>>>
>>> On Thu, Jun 26, 2014 at 3:38 PM, Ray Rodriguez <ra...@gmail.com>
>>> wrote:
>>>
>>>> Yup totally makes sense. I'll update the endpoint. Thanks.
>>>>
>>>>
>>>> On Thu, Jun 26, 2014 at 3:33 PM, Benjamin Mahler <
>>>> benjamin.mahler@gmail.com> wrote:
>>>>
>>>>> This is great! If only supporting 0.19.0+ I would recommend just
>>>>> collecting from /metrics/snapshot because it obviates /stats.json.
>>>>>
>>>>>
>>>>> On Thu, Jun 26, 2014 at 12:13 PM, Ray Rodriguez <ra...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hey everyone just thought I'd post a simple collectd python plugin
>>>>>> that I just released which turns all stats returned from the Mesos
>>>>>> stats.json endpoint into Collectd metrics.
>>>>>>
>>>>>> This plugin requires Mesos 0.19.0+ and collectd 4.9+
>>>>>>
>>>>>> Big shout out to phobos182(https://github.com/phobos182) who wrote
>>>>>> the original Elasticsearch collectd python plugin upon which my plugin
>>>>>> borrows from heavily.
>>>>>>
>>>>>> Mesos Collectd Python plugin:
>>>>>> https://github.com/rayrod2030/collectd-mesos
>>>>>>
>>>>>> Hope this is useful to others and I welcome pull requests, comments
>>>>>> and suggestions.
>>>>>>
>>>>>> Ray Rodriguez
>>>>>> Twitter: @rayray2030
>>>>>> Github: rayrod2030
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>
Re: Mesos 0.19.0 stats.json endpoint Collectd plugin
Posted by Ray Rodriguez <ra...@gmail.com>.
I just updated the collectd-mesos plugin to now use the new
/metrics/snapshot metrics endpoint as well as only reporting metrics from
the elected master. You can see my changes here:
https://github.com/rayrod2030/collectd-mesos/pull/2. Thanks for the
feedback everyone.
Ray
On Mon, Jul 7, 2014 at 2:14 PM, Dave Lester <da...@gmail.com> wrote:
> Hey Dominic, is there a specific review or JIRA issue that you could point
> to re: the new stats endpoint?
>
> Thanks,
> Dave
>
>
> On Thu, Jun 26, 2014 at 1:26 PM, Dominic Hamon <dh...@twitter.com> wrote:
>
>> In 0.20, stats.json is completely represented by the new endpoint.
>> stats.json will be deprecated in one of the next few versions.
>> On Jun 26, 2014 1:10 PM, "Ray Rodriguez" <ra...@gmail.com> wrote:
>>
>>> Hey Ben, It looks like /metrics/snapshot is a subset of the metrics
>>> exposed from /stats.json. Is stats.json eventually going to be deprecated?
>>> Why collect less metrics in this case?
>>>
>>>
>>> On Thu, Jun 26, 2014 at 3:38 PM, Ray Rodriguez <ra...@gmail.com>
>>> wrote:
>>>
>>>> Yup totally makes sense. I'll update the endpoint. Thanks.
>>>>
>>>>
>>>> On Thu, Jun 26, 2014 at 3:33 PM, Benjamin Mahler <
>>>> benjamin.mahler@gmail.com> wrote:
>>>>
>>>>> This is great! If only supporting 0.19.0+ I would recommend just
>>>>> collecting from /metrics/snapshot because it obviates /stats.json.
>>>>>
>>>>>
>>>>> On Thu, Jun 26, 2014 at 12:13 PM, Ray Rodriguez <ra...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Hey everyone just thought I'd post a simple collectd python plugin
>>>>>> that I just released which turns all stats returned from the Mesos
>>>>>> stats.json endpoint into Collectd metrics.
>>>>>>
>>>>>> This plugin requires Mesos 0.19.0+ and collectd 4.9+
>>>>>>
>>>>>> Big shout out to phobos182(https://github.com/phobos182) who wrote
>>>>>> the original Elasticsearch collectd python plugin upon which my plugin
>>>>>> borrows from heavily.
>>>>>>
>>>>>> Mesos Collectd Python plugin:
>>>>>> https://github.com/rayrod2030/collectd-mesos
>>>>>>
>>>>>> Hope this is useful to others and I welcome pull requests, comments
>>>>>> and suggestions.
>>>>>>
>>>>>> Ray Rodriguez
>>>>>> Twitter: @rayray2030
>>>>>> Github: rayrod2030
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>
Re: Mesos 0.19.0 stats.json endpoint Collectd plugin
Posted by Dave Lester <da...@gmail.com>.
Hey Dominic, is there a specific review or JIRA issue that you could point
to re: the new stats endpoint?
Thanks,
Dave
On Thu, Jun 26, 2014 at 1:26 PM, Dominic Hamon <dh...@twitter.com> wrote:
> In 0.20, stats.json is completely represented by the new endpoint.
> stats.json will be deprecated in one of the next few versions.
> On Jun 26, 2014 1:10 PM, "Ray Rodriguez" <ra...@gmail.com> wrote:
>
>> Hey Ben, It looks like /metrics/snapshot is a subset of the metrics
>> exposed from /stats.json. Is stats.json eventually going to be deprecated?
>> Why collect less metrics in this case?
>>
>>
>> On Thu, Jun 26, 2014 at 3:38 PM, Ray Rodriguez <ra...@gmail.com>
>> wrote:
>>
>>> Yup totally makes sense. I'll update the endpoint. Thanks.
>>>
>>>
>>> On Thu, Jun 26, 2014 at 3:33 PM, Benjamin Mahler <
>>> benjamin.mahler@gmail.com> wrote:
>>>
>>>> This is great! If only supporting 0.19.0+ I would recommend just
>>>> collecting from /metrics/snapshot because it obviates /stats.json.
>>>>
>>>>
>>>> On Thu, Jun 26, 2014 at 12:13 PM, Ray Rodriguez <ra...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hey everyone just thought I'd post a simple collectd python plugin
>>>>> that I just released which turns all stats returned from the Mesos
>>>>> stats.json endpoint into Collectd metrics.
>>>>>
>>>>> This plugin requires Mesos 0.19.0+ and collectd 4.9+
>>>>>
>>>>> Big shout out to phobos182(https://github.com/phobos182) who wrote
>>>>> the original Elasticsearch collectd python plugin upon which my plugin
>>>>> borrows from heavily.
>>>>>
>>>>> Mesos Collectd Python plugin:
>>>>> https://github.com/rayrod2030/collectd-mesos
>>>>>
>>>>> Hope this is useful to others and I welcome pull requests, comments
>>>>> and suggestions.
>>>>>
>>>>> Ray Rodriguez
>>>>> Twitter: @rayray2030
>>>>> Github: rayrod2030
>>>>>
>>>>
>>>>
>>>
>>
Re: Mesos 0.19.0 stats.json endpoint Collectd plugin
Posted by Dominic Hamon <dh...@twitter.com>.
In 0.20, stats.json is completely represented by the new endpoint.
stats.json will be deprecated in one of the next few versions.
On Jun 26, 2014 1:10 PM, "Ray Rodriguez" <ra...@gmail.com> wrote:
> Hey Ben, It looks like /metrics/snapshot is a subset of the metrics
> exposed from /stats.json. Is stats.json eventually going to be deprecated?
> Why collect less metrics in this case?
>
>
> On Thu, Jun 26, 2014 at 3:38 PM, Ray Rodriguez <ra...@gmail.com>
> wrote:
>
>> Yup totally makes sense. I'll update the endpoint. Thanks.
>>
>>
>> On Thu, Jun 26, 2014 at 3:33 PM, Benjamin Mahler <
>> benjamin.mahler@gmail.com> wrote:
>>
>>> This is great! If only supporting 0.19.0+ I would recommend just
>>> collecting from /metrics/snapshot because it obviates /stats.json.
>>>
>>>
>>> On Thu, Jun 26, 2014 at 12:13 PM, Ray Rodriguez <ra...@gmail.com>
>>> wrote:
>>>
>>>> Hey everyone just thought I'd post a simple collectd python plugin that
>>>> I just released which turns all stats returned from the Mesos stats.json
>>>> endpoint into Collectd metrics.
>>>>
>>>> This plugin requires Mesos 0.19.0+ and collectd 4.9+
>>>>
>>>> Big shout out to phobos182(https://github.com/phobos182) who wrote the
>>>> original Elasticsearch collectd python plugin upon which my plugin borrows
>>>> from heavily.
>>>>
>>>> Mesos Collectd Python plugin:
>>>> https://github.com/rayrod2030/collectd-mesos
>>>>
>>>> Hope this is useful to others and I welcome pull requests, comments and
>>>> suggestions.
>>>>
>>>> Ray Rodriguez
>>>> Twitter: @rayray2030
>>>> Github: rayrod2030
>>>>
>>>
>>>
>>
>
Re: Mesos 0.19.0 stats.json endpoint Collectd plugin
Posted by Ray Rodriguez <ra...@gmail.com>.
Hey Ben, It looks like /metrics/snapshot is a subset of the metrics exposed
from /stats.json. Is stats.json eventually going to be deprecated? Why
collect less metrics in this case?
On Thu, Jun 26, 2014 at 3:38 PM, Ray Rodriguez <ra...@gmail.com> wrote:
> Yup totally makes sense. I'll update the endpoint. Thanks.
>
>
> On Thu, Jun 26, 2014 at 3:33 PM, Benjamin Mahler <
> benjamin.mahler@gmail.com> wrote:
>
>> This is great! If only supporting 0.19.0+ I would recommend just
>> collecting from /metrics/snapshot because it obviates /stats.json.
>>
>>
>> On Thu, Jun 26, 2014 at 12:13 PM, Ray Rodriguez <ra...@gmail.com>
>> wrote:
>>
>>> Hey everyone just thought I'd post a simple collectd python plugin that
>>> I just released which turns all stats returned from the Mesos stats.json
>>> endpoint into Collectd metrics.
>>>
>>> This plugin requires Mesos 0.19.0+ and collectd 4.9+
>>>
>>> Big shout out to phobos182(https://github.com/phobos182) who wrote the
>>> original Elasticsearch collectd python plugin upon which my plugin borrows
>>> from heavily.
>>>
>>> Mesos Collectd Python plugin:
>>> https://github.com/rayrod2030/collectd-mesos
>>>
>>> Hope this is useful to others and I welcome pull requests, comments and
>>> suggestions.
>>>
>>> Ray Rodriguez
>>> Twitter: @rayray2030
>>> Github: rayrod2030
>>>
>>
>>
>
Re: Mesos 0.19.0 stats.json endpoint Collectd plugin
Posted by Ray Rodriguez <ra...@gmail.com>.
Yup totally makes sense. I'll update the endpoint. Thanks.
On Thu, Jun 26, 2014 at 3:33 PM, Benjamin Mahler
<be...@gmail.com> wrote:
> This is great! If only supporting 0.19.0+ I would recommend just collecting
> from /metrics/snapshot because it obviates /stats.json.
> On Thu, Jun 26, 2014 at 12:13 PM, Ray Rodriguez <ra...@gmail.com>
> wrote:
>> Hey everyone just thought I'd post a simple collectd python plugin that I
>> just released which turns all stats returned from the Mesos stats.json
>> endpoint into Collectd metrics.
>>
>> This plugin requires Mesos 0.19.0+ and collectd 4.9+
>>
>> Big shout out to phobos182(https://github.com/phobos182) who wrote the
>> original Elasticsearch collectd python plugin upon which my plugin borrows
>> from heavily.
>>
>> Mesos Collectd Python plugin: https://github.com/rayrod2030/collectd-mesos
>>
>> Hope this is useful to others and I welcome pull requests, comments and
>> suggestions.
>>
>> Ray Rodriguez
>> Twitter: @rayray2030
>> Github: rayrod2030
>>
Re: Mesos 0.19.0 stats.json endpoint Collectd plugin
Posted by Benjamin Mahler <be...@gmail.com>.
This is great! If only supporting 0.19.0+ I would recommend just collecting
from /metrics/snapshot because it obviates /stats.json.
On Thu, Jun 26, 2014 at 12:13 PM, Ray Rodriguez <ra...@gmail.com>
wrote:
> Hey everyone just thought I'd post a simple collectd python plugin that I
> just released which turns all stats returned from the Mesos stats.json
> endpoint into Collectd metrics.
>
> This plugin requires Mesos 0.19.0+ and collectd 4.9+
>
> Big shout out to phobos182(https://github.com/phobos182) who wrote the
> original Elasticsearch collectd python plugin upon which my plugin borrows
> from heavily.
>
> Mesos Collectd Python plugin: https://github.com/rayrod2030/collectd-mesos
>
> Hope this is useful to others and I welcome pull requests, comments and
> suggestions.
>
> Ray Rodriguez
> Twitter: @rayray2030
> Github: rayrod2030
>