You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2016/04/15 13:35:25 UTC

[jira] [Created] (HADOOP-13028) add counter and timer metrics for S3A operations

Steve Loughran created HADOOP-13028:
---------------------------------------

             Summary: add counter and timer metrics for S3A operations
                 Key: HADOOP-13028
                 URL: https://issues.apache.org/jira/browse/HADOOP-13028
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3, metrics
    Affects Versions: 2.8.0
            Reporter: Steve Loughran
            Priority: Minor


against S3 (and other object stores), opening connections can be expensive, closing connections may be expensive (a sign of a regression). 

S3A FS and individual input streams should have counters of the # of open/close/failure+reconnect operations, timers of how long things take. This can be used downstream to measure efficiency of the code (how often connections are being made), connection reliability, etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)