You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2024/07/08 15:49:00 UTC
[jira] [Commented] (HADOOP-18877) AWS SDK V2 - Move to S3 Java async client
[ https://issues.apache.org/jira/browse/HADOOP-18877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863840#comment-17863840 ]
Steve Loughran commented on HADOOP-18877:
-----------------------------------------
proposed: all use is moved (operation by operation?) into S3AStore interface/impl, so that neither client is explicitly accessible by the rest of the codebase. we will still export the s3 client via the Internals interface, but only create it on demand and warn it may be removed in future
> AWS SDK V2 - Move to S3 Java async client
> -----------------------------------------
>
> Key: HADOOP-18877
> URL: https://issues.apache.org/jira/browse/HADOOP-18877
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: Ahmar Suhail
> Assignee: Ahmar Suhail
> Priority: Major
>
> With the upgrade, S3A now has two S3 clients the Java async client and the Java sync client.
> Java async is required for the transfer manager.
> Java sync is used for everything else.
>
> * Move all operations to use the Java async client and remove the sync client.
> * Provide option to configure java async client with the CRT HTTP client.
> * Create a new interface for S3Client operations, move them out of S3AFS. interface will take request and span, and return response.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org