You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/06/20 12:54:00 UTC
[jira] [Comment Edited] (HADOOP-18073) Upgrade AWS SDK to v2
[ https://issues.apache.org/jira/browse/HADOOP-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556357#comment-17556357 ]
Steve Loughran edited comment on HADOOP-18073 at 6/20/22 12:53 PM:
-------------------------------------------------------------------
this is probably going to break the signing and credential provider plugin points the S3A connector supports, which means that delegation token support will also break.
Marking as an incompatible change.
And it will be good to know if {{awssdk_config_override.json}} will still be loaded and so can be used as a way of providing endpoint to region mappings.
was (Author: stevel@apache.org):
this is probably going to break the signing and credential provider plugin points the S3A connector supports, which means that delegation token support will also break.
Marking as an incompatible change.
And it will be good to know if {{awssdk_config_override.json)) I am will still be loaded and so can be used as a way of providing endpoint to region mappings.
> Upgrade AWS SDK to v2
> ---------------------
>
> Key: HADOOP-18073
> URL: https://issues.apache.org/jira/browse/HADOOP-18073
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: auth, fs/s3
> Affects Versions: 3.3.1
> Reporter: xiaowei sun
> Priority: Major
>
> We would like to access s3 with AWS SSO, which is supported in software.amazon.awssdk:sdk-core:2.*.
> In particular, from [https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/index.html], when to set 'fs.s3a.aws.credentials.provider', it must be "com.amazonaws.auth.AWSCredentialsProvider". We would like to support "software.amazon.awssdk.auth.credentials.ProfileCredentialsProvider" which supports AWS SSO, so users only need to authenticate once.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org