You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2016/11/29 16:21:58 UTC

[jira] [Created] (HADOOP-13844) Move swift duration stats tracking to hadoop common utils

Steve Loughran created HADOOP-13844:
---------------------------------------

             Summary: Move swift duration stats tracking to hadoop common utils
                 Key: HADOOP-13844
                 URL: https://issues.apache.org/jira/browse/HADOOP-13844
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs/azure, fs/oss, fs/s3, fs/swift
    Affects Versions: 2.9.0
            Reporter: Steve Loughran
            Assignee: Steve Loughran
            Priority: Minor


Swift FS has some simple duration counting classes which are used to track HTTP performance, with incremental creation of mean, min, max and variance. These are not moving averages, simply ongoing over time. They've proved useful in detecting which operations are slowest against objects stores. (it turned out to be delete throttling in test teardown BTW, showing the value of the instrumentation)

By moving them into utils, all the object stores can build up some stats on cost of HTTP operations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org