[jira] [Commented] (HADOOP-13551) hook up AwsSdkMetrics to hadoop metrics

["Steve Loughran (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-13551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17209759#comment-17209759 ] 

Steve Loughran commented on HADOOP-13551:
-----------------------------------------

One aspect of wiring this up is we will find about throttle events being handled in the SDK.

I propose handling those specially, with
* logging @ warn with the request ID, operation & URL
* updating an FS-wide stat
* maybe: some plugin point for someone to add their own reporter

the other thing to consider is could we support adding the XRay instrumentation to the client, which would then do the publishing that way

> hook up AwsSdkMetrics to hadoop metrics
> ---------------------------------------
>
>                 Key: HADOOP-13551
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13551
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs/s3
>    Affects Versions: 3.0.0-beta1
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Major
>
> There's an API in {{com.amazonaws.metrics.AwsSdkMetrics}} to give access to the internal metrics of the AWS libraries. We might want to get at those



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org