You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Szehon Ho (JIRA)" <ji...@apache.org> on 2015/05/20 01:16:00 UTC

[jira] [Created] (HIVE-10761) Create codahale-based metrics system for Hive

Szehon Ho created HIVE-10761:
--------------------------------

             Summary: Create codahale-based metrics system for Hive
                 Key: HIVE-10761
                 URL: https://issues.apache.org/jira/browse/HIVE-10761
             Project: Hive
          Issue Type: New Feature
            Reporter: Szehon Ho


There is a current Hive metrics system that hooks up to a JMX reporting, but all its measurements, models are custom.

This is to make another metrics system that will be based on Codahale (ie yammer, dropwizard), which has the following advantage:

* Well-defined metric model for frequently-needed metrics (ie JVM metrics)
* Well-defined measurements for all metrics (ie max, mean, stddev, mean_rate, etc), 
* Built-in reporting frameworks like JMX, Console, Log, JSON webserver

It is used for many projects, including several Apache projects like Oozie.  Overall, monitoring tools should find it easier to understand these common metric, measurement, reporting models.

As part of this change, Hive's JVMPauseMonitor (that was using Hadoop's private one) is now hooked into the new metric framework to give pause time counts.

The existing metric subsystem will be kept and can be enabled if backward compatibility is desired.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)