You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ambari.apache.org by Jayesh Thakrar <j_...@yahoo.com> on 2015/05/20 00:01:01 UTC
Adding configuration parameters and monitoring metrics for custom
service
The Ambari doc page https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133 is very useful and I was able to add a test service.I am at the next evolution step on some pointers for adding configuration parameters and monitoring metrics.And ofcourse, the step after that would be how to expose the metrics in Ambari UI and the REST API.
I did come across https://issues.apache.org/jira/browse/AMBARI-5707 and was not sure if I need to "understand" that in order to write and inject my own metrics.
Any pointers?
Thanks,Jayesh
Re: Adding configuration parameters and monitoring metrics for
custom service
Posted by Jayesh Thakrar <j_...@yahoo.com>.
Thanks Jaimin!This sounds great and worth the wait for 2.1 and not hack through Ambari-web.
From: Jaimin Jetly <ja...@hortonworks.com>
To: "user@ambari.apache.org" <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 6:25 PM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
#yiv8529064785 #yiv8529064785 -- p {margin-top:0px;margin-bottom:0px;}#yiv8529064785 Hi Jayesh,
Enhanced dashboard is the ongoing effort and is being actively worked upon on trunk. This feature will be available in the upcoming Ambari release 2.1.0. (Bring tracked at https://issues.apache.org/jira/browse/AMBARI-9792)
After this epic is completed, minimal effort needs to be done to expose the AMS stored metric data via Ambari API and create your service's dashboard view in Ambari web.
Documentation for the feature will be done shortly.
For reference you can look at the example patch for Accumulo service (https://issues.apache.org/jira/browse/AMBARI-9910) which is using this epic work and trying to get a new service dashboard.
-Thanks
Jaimin
From: Siddharth Wagle <sw...@hortonworks.com>
Sent: Wednesday, May 20, 2015 2:38 PM
To: user@ambari.apache.org; Jayesh Thakrar
Subject: Re: Adding configuration parameters and monitoring metrics for custom service It is also stack defined through widgets.json (default). In 2.1 you can create a dashboard view for yourself and save it / share it, etc.
Documentation for widgets.josn is still missing on wiki, should be there soon.
BR,Sid
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 9:51 AM
To: user@ambari.apache.org
Subject: Re: Adding configuration parameters and monitoring metrics for custom service Thanks again - that's exactly what I was looking for!And I think for the metrics display on the UI, I will need to browse through the Ambari web, right?
From: Siddharth Wagle <sw...@hortonworks.com>
To: "user@ambari.apache.org" <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 11:45 AM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
#yiv8529064785 #yiv8529064785 -- --P {margin-top:0;margin-bottom:0;}#yiv8529064785 --P {margin-top:0;margin-bottom:0;}#yiv8529064785 Hi Jayesh,
Did you look through the API docs?
https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification
-Sid
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 8:15 AM
To: user@ambari.apache.org
Subject: Re: Adding configuration parameters and monitoring metrics for custom service Thank you for the link, Sid !I had a look at that, but it does not have any details or pointers to samples on how to dump your own metrics to the Ambari Metrics subsystem.For example, my sample service is TSDB - where I have several TSDB daemons running on an Ambari cluster and I want to dump their health metrics to Ambari so that it can be displayed on the UI. I know how to extract the TSDB metrics from TSDB - but don't know how where and how to route that to the Ambari metrics collector (or montior?).
And once those TSDB metrics are in Ambari, how do I show them in simple graphs in Ambari?
From: Siddharth Wagle <sw...@hortonworks.com>
To: User <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 6:31 PM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
#yiv8529064785 #yiv8529064785 -- -- --P {margin-top:0;margin-bottom:0;}#yiv8529064785 Ambari Metrics wiki page has useful info for you:
https://cwiki.apache.org/confluence/display/AMBARI/Metrics
BR,Sid
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 3:01 PM
To: User
Subject: Adding configuration parameters and monitoring metrics for custom service The Ambari doc page https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133 is very useful and I was able to add a test service.I am at the next evolution step on some pointers for adding configuration parameters and monitoring metrics.And ofcourse, the step after that would be how to expose the metrics in Ambari UI and the REST API.
I did come across https://issues.apache.org/jira/browse/AMBARI-5707 and was not sure if I need to "understand" that in order to write and inject my own metrics.
Any pointers?
Thanks,Jayesh
Re: Adding configuration parameters and monitoring metrics for
custom service
Posted by Jaimin Jetly <ja...@hortonworks.com>.
Hi Jayesh,
Enhanced dashboard is the ongoing effort and is being actively worked upon on trunk. This feature will be available in the upcoming Ambari release 2.1.0. (Bring tracked at https://issues.apache.org/jira/browse/AMBARI-9792)
After this epic is completed, minimal effort needs to be done to expose the AMS stored metric data via Ambari API and create your service's dashboard view in Ambari web.?
Documentation for the feature will be done shortly.
For reference you can look at the example patch for Accumulo service (https://issues.apache.org/jira/browse/AMBARI-9910) which is using this epic work and trying to get a new service dashboard.
-Thanks
Jaimin
________________________________
From: Siddharth Wagle <sw...@hortonworks.com>
Sent: Wednesday, May 20, 2015 2:38 PM
To: user@ambari.apache.org; Jayesh Thakrar
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
It is also stack defined through widgets.json (default). In 2.1 you can create a dashboard view for yourself and save it / share it, etc.
Documentation for widgets.josn is still missing on wiki, should be there soon.
BR,
Sid
________________________________
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 9:51 AM
To: user@ambari.apache.org
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
Thanks again - that's exactly what I was looking for!
And I think for the metrics display on the UI, I will need to browse through the Ambari web, right?
________________________________
From: Siddharth Wagle <sw...@hortonworks.com>
To: "user@ambari.apache.org" <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 11:45 AM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
Hi Jayesh,
Did you look through the API docs?
https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification
-Sid
________________________________
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 8:15 AM
To: user@ambari.apache.org
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
Thank you for the link, Sid !
I had a look at that, but it does not have any details or pointers to samples on how to dump your own metrics to the Ambari Metrics subsystem.
For example, my sample service is TSDB - where I have several TSDB daemons running on an Ambari cluster and I want to dump their health metrics to Ambari so that it can be displayed on the UI. I know how to extract the TSDB metrics from TSDB - but don't know how where and how to route that to the Ambari metrics collector (or montior?).
And once those TSDB metrics are in Ambari, how do I show them in simple graphs in Ambari?
________________________________
From: Siddharth Wagle <sw...@hortonworks.com>
To: User <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 6:31 PM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
Ambari Metrics wiki page has useful info for you:
https://cwiki.apache.org/confluence/display/AMBARI/Metrics
BR,
Sid
________________________________
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 3:01 PM
To: User
Subject: Adding configuration parameters and monitoring metrics for custom service
The Ambari doc page https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133 is very useful and I was able to add a test service.
I am at the next evolution step on some pointers for adding configuration parameters and monitoring metrics.
And ofcourse, the step after that would be how to expose the metrics in Ambari UI and the REST API.
I did come across https://issues.apache.org/jira/browse/AMBARI-5707 and was not sure if I need to "understand" that in order to write and inject my own metrics.
Any pointers?
Thanks,
Jayesh
Re: Adding configuration parameters and monitoring metrics for
custom service
Posted by Siddharth Wagle <sw...@hortonworks.com>.
It is also stack defined through widgets.json (default). In 2.1 you can create a dashboard view for yourself and save it / share it, etc.
Documentation for widgets.josn is still missing on wiki, should be there soon.
BR,
Sid
________________________________
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 9:51 AM
To: user@ambari.apache.org
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
Thanks again - that's exactly what I was looking for!
And I think for the metrics display on the UI, I will need to browse through the Ambari web, right?
________________________________
From: Siddharth Wagle <sw...@hortonworks.com>
To: "user@ambari.apache.org" <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 11:45 AM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
Hi Jayesh,
Did you look through the API docs?
https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification
-Sid
________________________________
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 8:15 AM
To: user@ambari.apache.org
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
Thank you for the link, Sid !
I had a look at that, but it does not have any details or pointers to samples on how to dump your own metrics to the Ambari Metrics subsystem.
For example, my sample service is TSDB - where I have several TSDB daemons running on an Ambari cluster and I want to dump their health metrics to Ambari so that it can be displayed on the UI. I know how to extract the TSDB metrics from TSDB - but don't know how where and how to route that to the Ambari metrics collector (or montior?).
And once those TSDB metrics are in Ambari, how do I show them in simple graphs in Ambari?
________________________________
From: Siddharth Wagle <sw...@hortonworks.com>
To: User <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 6:31 PM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
Ambari Metrics wiki page has useful info for you:
https://cwiki.apache.org/confluence/display/AMBARI/Metrics
BR,
Sid
________________________________
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 3:01 PM
To: User
Subject: Adding configuration parameters and monitoring metrics for custom service
The Ambari doc page https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133 is very useful and I was able to add a test service.
I am at the next evolution step on some pointers for adding configuration parameters and monitoring metrics.
And ofcourse, the step after that would be how to expose the metrics in Ambari UI and the REST API.
I did come across https://issues.apache.org/jira/browse/AMBARI-5707 and was not sure if I need to "understand" that in order to write and inject my own metrics.
Any pointers?
Thanks,
Jayesh
Re: Adding configuration parameters and monitoring metrics for
custom service
Posted by Jayesh Thakrar <j_...@yahoo.com>.
Thanks again - that's exactly what I was looking for!And I think for the metrics display on the UI, I will need to browse through the Ambari web, right?
From: Siddharth Wagle <sw...@hortonworks.com>
To: "user@ambari.apache.org" <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 11:45 AM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
#yiv0747758478 #yiv0747758478 --P{margin-top:0;margin-bottom:0;}#yiv0747758478 --P {margin-top:0;margin-bottom:0;}#yiv0747758478 Hi Jayesh,
Did you look through the API docs?
https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification
-Sid
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 8:15 AM
To: user@ambari.apache.org
Subject: Re: Adding configuration parameters and monitoring metrics for custom service Thank you for the link, Sid !I had a look at that, but it does not have any details or pointers to samples on how to dump your own metrics to the Ambari Metrics subsystem.For example, my sample service is TSDB - where I have several TSDB daemons running on an Ambari cluster and I want to dump their health metrics to Ambari so that it can be displayed on the UI. I know how to extract the TSDB metrics from TSDB - but don't know how where and how to route that to the Ambari metrics collector (or montior?).
And once those TSDB metrics are in Ambari, how do I show them in simple graphs in Ambari?
From: Siddharth Wagle <sw...@hortonworks.com>
To: User <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 6:31 PM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
#yiv0747758478 #yiv0747758478 -- --P {margin-top:0;margin-bottom:0;}#yiv0747758478 Ambari Metrics wiki page has useful info for you:
https://cwiki.apache.org/confluence/display/AMBARI/Metrics
BR,Sid
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 3:01 PM
To: User
Subject: Adding configuration parameters and monitoring metrics for custom service The Ambari doc page https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133 is very useful and I was able to add a test service.I am at the next evolution step on some pointers for adding configuration parameters and monitoring metrics.And ofcourse, the step after that would be how to expose the metrics in Ambari UI and the REST API.
I did come across https://issues.apache.org/jira/browse/AMBARI-5707 and was not sure if I need to "understand" that in order to write and inject my own metrics.
Any pointers?
Thanks,Jayesh
Re: Adding configuration parameters and monitoring metrics for
custom service
Posted by Siddharth Wagle <sw...@hortonworks.com>.
Hi Jayesh,
Did you look through the API docs?
https://cwiki.apache.org/confluence/display/AMBARI/Metrics+Collector+API+Specification
-Sid
________________________________
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Wednesday, May 20, 2015 8:15 AM
To: user@ambari.apache.org
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
Thank you for the link, Sid !
I had a look at that, but it does not have any details or pointers to samples on how to dump your own metrics to the Ambari Metrics subsystem.
For example, my sample service is TSDB - where I have several TSDB daemons running on an Ambari cluster and I want to dump their health metrics to Ambari so that it can be displayed on the UI. I know how to extract the TSDB metrics from TSDB - but don't know how where and how to route that to the Ambari metrics collector (or montior?).
And once those TSDB metrics are in Ambari, how do I show them in simple graphs in Ambari?
________________________________
From: Siddharth Wagle <sw...@hortonworks.com>
To: User <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 6:31 PM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
Ambari Metrics wiki page has useful info for you:
https://cwiki.apache.org/confluence/display/AMBARI/Metrics
BR,
Sid
________________________________
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 3:01 PM
To: User
Subject: Adding configuration parameters and monitoring metrics for custom service
The Ambari doc page https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133 is very useful and I was able to add a test service.
I am at the next evolution step on some pointers for adding configuration parameters and monitoring metrics.
And ofcourse, the step after that would be how to expose the metrics in Ambari UI and the REST API.
I did come across https://issues.apache.org/jira/browse/AMBARI-5707 and was not sure if I need to "understand" that in order to write and inject my own metrics.
Any pointers?
Thanks,
Jayesh
Re: Adding configuration parameters and monitoring metrics for
custom service
Posted by Jayesh Thakrar <j_...@yahoo.com>.
Thank you for the link, Sid !I had a look at that, but it does not have any details or pointers to samples on how to dump your own metrics to the Ambari Metrics subsystem.For example, my sample service is TSDB - where I have several TSDB daemons running on an Ambari cluster and I want to dump their health metrics to Ambari so that it can be displayed on the UI. I know how to extract the TSDB metrics from TSDB - but don't know how where and how to route that to the Ambari metrics collector (or montior?).
And once those TSDB metrics are in Ambari, how do I show them in simple graphs in Ambari?
From: Siddharth Wagle <sw...@hortonworks.com>
To: User <us...@ambari.apache.org>; Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 6:31 PM
Subject: Re: Adding configuration parameters and monitoring metrics for custom service
#yiv7182681973 #yiv7182681973 --P{margin-top:0;margin-bottom:0;}#yiv7182681973 Ambari Metrics wiki page has useful info for you:
https://cwiki.apache.org/confluence/display/AMBARI/Metrics
BR,Sid
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 3:01 PM
To: User
Subject: Adding configuration parameters and monitoring metrics for custom service The Ambari doc page https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133 is very useful and I was able to add a test service.I am at the next evolution step on some pointers for adding configuration parameters and monitoring metrics.And ofcourse, the step after that would be how to expose the metrics in Ambari UI and the REST API.
I did come across https://issues.apache.org/jira/browse/AMBARI-5707 and was not sure if I need to "understand" that in order to write and inject my own metrics.
Any pointers?
Thanks,Jayesh
Re: Adding configuration parameters and monitoring metrics for
custom service
Posted by Siddharth Wagle <sw...@hortonworks.com>.
Ambari Metrics wiki page has useful info for you:
https://cwiki.apache.org/confluence/display/AMBARI/Metrics
BR,
Sid
________________________________
From: Jayesh Thakrar <j_...@yahoo.com>
Sent: Tuesday, May 19, 2015 3:01 PM
To: User
Subject: Adding configuration parameters and monitoring metrics for custom service
The Ambari doc page https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133 is very useful and I was able to add a test service.
I am at the next evolution step on some pointers for adding configuration parameters and monitoring metrics.
And ofcourse, the step after that would be how to expose the metrics in Ambari UI and the REST API.
I did come across https://issues.apache.org/jira/browse/AMBARI-5707 and was not sure if I need to "understand" that in order to write and inject my own metrics.
Any pointers?
Thanks,
Jayesh