[jira] [Updated] (ACCUMULO-3300) monitor ingest, query, etc. rates are too smooth

["Adam Fuchs (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ACCUMULO-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Adam Fuchs updated ACCUMULO-3300:
---------------------------------
    Attachment: smoothed_0.2.png
                smoothed_0.95.png

The two attached images show a ci test run twice with smoothing parameters set to 0.2 and 0.95. The .95 version converges on an accurate measurement much more quickly when rates change, and you can see more clearly that there is a square wave of ingest performance. Features like the dip after the third hump wouldn't have shown up in the 0.2 version, and would have simply been smoothed away.

> monitor ingest, query, etc. rates are too smooth
> ------------------------------------------------
>
>                 Key: ACCUMULO-3300
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-3300
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: monitor, tserver
>            Reporter: Adam Fuchs
>         Attachments: smoothed_0.2.png, smoothed_0.95.png
>
>
> We use an exponential decay function to smooth performance monitoring. This dates back to the early days of the project when we were taking samples frequently and everything looked like noise. Now our performance is a bit more steady and we take samples about every 5 seconds. I think we need to update some parameters so that finer-grained performance characteristics show up in the monitor. This is critical for the next wave of Accumulo performance improvements.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)