You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2020/03/21 02:29:00 UTC

[jira] [Commented] (HADOOP-16930) Add com.amazonaws.auth.profile.ProfileCredentialsProvider to hadoop-aws docs

    [ https://issues.apache.org/jira/browse/HADOOP-16930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17063734#comment-17063734 ] 

Nicholas Chammas commented on HADOOP-16930:
-------------------------------------------

cc [~stevel@apache.org] - I'd be happy to work on the doc update if I've understood the issue correctly.

> Add com.amazonaws.auth.profile.ProfileCredentialsProvider to hadoop-aws docs
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-16930
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16930
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: documentation, fs/s3
>            Reporter: Nicholas Chammas
>            Priority: Minor
>
> There is a very, very useful S3A authentication method that is not currently documented: {{com.amazonaws.auth.profile.ProfileCredentialsProvider}}
> This provider lets you source your AWS credentials from a shared credentials file, typically stored under {{~/.aws/credentials}}, using a [named profile|https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-profiles.html]. All you need is to set the {{AWS_PROFILE}} environment variable, and the provider will get the appropriate credentials for you.
> I discovered this from my coworkers, but cannot find it in the docs for hadoop-aws. I'd expect to see it at least mentioned in [this section|https://hadoop.apache.org/docs/r2.9.2/hadoop-aws/tools/hadoop-aws/index.html#S3A_Authentication_methods]. It should probably be added to the docs for every minor release that supports it, which I'd guess includes 2.8 on up.
> (This provider should probably also be added to the default list of credential provider classes, but we can address that in another ticket. I can say that at least in 2.9.2, it's not in the default list.)
> (This is not to be confused with {{com.amazonaws.auth.InstanceProfileCredentialsProvider}}, which serves a completely different purpose.)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org