[jira] [Created] (KUDU-2643) Add tools to do basic analysis on the metrics logs

["Will Berkeley (JIRA)" <ji...@apache.org>]

Will Berkeley created KUDU-2643:
-----------------------------------

             Summary: Add tools to do basic analysis on the metrics logs
                 Key: KUDU-2643
                 URL: https://issues.apache.org/jira/browse/KUDU-2643
             Project: Kudu
          Issue Type: Improvement
    Affects Versions: 1.8.0
            Reporter: Will Berkeley
            Assignee: Will Berkeley


KUDU-2597 tracks adding a tool to parse the metrics logs. We should also add (probably as Python scripts) some tools for analyzing the metrics logs:

* Finding tablets with unusual performance characteristics: longest apply|prepare|replicate|write|updateconsensus times
* Finding servers with the most disk activity
* Finding servers with slows scanners
* Finding replicas that are largest on disk or in-memory
* Characterizing workloads of tables and tablets (insert/upserts/deletes/updates/duplicate key inserts/pk lookups + times/op)
* Compaction (average height, delta size, compaction times)
* Log performance (append latency, sync latency, throughput)

Some of this can be rules-based, i.e. if metric X is > constant A) and some should be pattern-based (most tablets' histograms look different than this tablet's).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)