Re: Random thought...

[Steve Loughran <st...@hortonworks.com>]

there is a bit of one in the YARN rest API, but it doesn't provide that
much info into what is going on; knowing live app use could be interesting.

I've been adding Codahale metrics to slider in the form of a YARN service
to start the registry & register with jmx & optionally ganglia
https://github.com/apache/incubator-slider/tree/develop/slider-core/src/main/java/org/apache/slider/server/appmaster/management

it also exports 4 servlets from the metrics Jar: /metrics, /health, /ping
and /threads . (
https://github.com/apache/incubator-slider/blob/develop/slider-core/src/main/java/org/apache/slider/server/appmaster/web/SliderAMWebApp.java#L88
)

Given the emergent popularity of that metric library, maybe a proc/
interface could take a path supplied on AM registration to be the base of
those metrics URLs, which could then be relayed/redirected through a URL
like http://rm/proc/appid_40967/status/metrics and
http://rm/proc/appid_40967/status/health

Looking at the maven repo graph, there's not much takeup in the hadoop
stack yet -just Cassandra and kite-morphlines. We'd have to add it to MR &
Tez to make it immediately useful.

On 5 December 2014 at 11:40, Arun Murthy <ac...@hortonworks.com> wrote:

> How about /proc for YARN?
> Cmd line, REST etc.
>
> Arun
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.