You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Michael Ho (JIRA)" <ji...@apache.org> on 2018/11/01 22:10:00 UTC

[jira] [Created] (IMPALA-7799) Store periodic snapshots of Impalad metrics

Michael Ho created IMPALA-7799:
----------------------------------

             Summary: Store periodic snapshots of Impalad metrics
                 Key: IMPALA-7799
                 URL: https://issues.apache.org/jira/browse/IMPALA-7799
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 2.12.0, Impala 3.0, Impala 3.1.0
            Reporter: Michael Ho


Currently, each Impala demon exposes a set of metrics exposed via the debug webpage metrics page. While this may be very helpful for development, there are many incidents in which one may want to record these metrics to do postmortem analysis for various issues.

We should consider taking periodic snapshots of these Impalad metrics and archive them for a certain retention period to allow for postmortem analysis. We need to be mindful of the space usage concern. 

To enable easier analysis, one may need to build a tool (or use some existing off-the-shell libraries) to show the collected snapshots as time series and calculate various statistics (e.g. mean, median, min, max etc).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)