You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Ahmar Suhail (Jira)" <ji...@apache.org> on 2024/12/13 11:23:00 UTC
[jira] [Commented] (HADOOP-19365) Add audit header support
[ https://issues.apache.org/jira/browse/HADOOP-19365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17905453#comment-17905453 ]
Ahmar Suhail commented on HADOOP-19365:
---------------------------------------
Current flow of how this works (I think) is
when creating the RequestFactory in S3AFileSystem, we do
RequestFactoryImpl.builder().withRequestPreparer(getAuditManager()::requestCreated),
then when requests are created, we do prepareRequest(builder), see RequestFactoryImpl.newGetObjectRequestBuilder(). This attaches the span to a request.
And then executionInterceptors before submitting the request, will extract the referrer, using [https://sdk.amazonaws.com/java/api/latest/software/amazon/awssdk/core/interceptor/ExecutionInterceptor.html#modifyHttpRequest(software.amazon.awssdk.core.interceptor.Context.ModifyHttpRequest,software.amazon.awssdk.core.interceptor.ExecutionAttributes)]
> Add audit header support
> -------------------------
>
> Key: HADOOP-19365
> URL: https://issues.apache.org/jira/browse/HADOOP-19365
> Project: Hadoop Common
> Issue Type: Sub-task
> Reporter: Ahmar Suhail
> Priority: Major
>
> S3A adds audit information as referrer headers, see [https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/auditing.md] for documentation on this.
> These are attached using execution interceptors, see ActiveAuditManagerS3A.
> createExecutionInterceptors().
>
> analyitcs-accelerator-s3 makes the GET requests now but does not update the referrer with GETs.
>
> See LoggingAuditor.attachRangeFromRequest() for how this is done.
>
> When using analytics-accelerator-s3, audit headers from S3A should be sent through.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org