You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/07/31 05:57:00 UTC
[jira] [Commented] (HADOOP-15642) Update to latest/recent version
of aws-sdk for Hadoop 3.2
[ https://issues.apache.org/jira/browse/HADOOP-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16563173#comment-16563173 ]
Steve Loughran commented on HADOOP-15642:
-----------------------------------------
Patch 001. SDK update, with upgrade instructions. I should add one 'submit patch, see what extra deprecations have surfaced, consider fixing them'
Testing: did what I discuss in the instructions, with the caveat that trunk tests aren't working 100% for me as the combination of assume role & s3guard is failing until HADOOP-15583 is in; plus the file context issue of HADOOP-15626 which I'll fix tomorrow if nobody else does it.
I'd like to get this in so we can spend a few weeks playing with it before the release cutoff.
> Update to latest/recent version of aws-sdk for Hadoop 3.2
> ---------------------------------------------------------
>
> Key: HADOOP-15642
> URL: https://issues.apache.org/jira/browse/HADOOP-15642
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: build, fs/s3
> Affects Versions: 3.2.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Blocker
> Attachments: HADOOP-15642-001.patch, Screen Shot 2018-07-30 at 14.11.22.png
>
>
> Move to a later version of the AWS SDK library for a different set of features and issues.
> One thing which doesn't work on the one we ship with is the ability to create assumed role sessions >1h, as there's a check in the client lib for role-duration <= 3600 seconds. I'll assume more recent SDKs delegate duration checks to the far end.
> see: [https://aws.amazon.com/about-aws/whats-new/2018/03/longer-role-sessions/]
> * assuming later versions will extend assumed role life, docs will need changing,
> * Adding a test in HADOOP-15583 which expects an error message if you ask for a duration of 3h; this should act as the test to see what happens.
> * think this time would be good to explicitly write down the SDK update process
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org