You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/01/18 16:52:00 UTC
[jira] [Work logged] (HADOOP-18085) S3 SDK Upgrade causes AccessPoint ARN endpoint mistranslation
[ https://issues.apache.org/jira/browse/HADOOP-18085?focusedWorklogId=710648&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-710648 ]
ASF GitHub Bot logged work on HADOOP-18085:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 18/Jan/22 16:51
Start Date: 18/Jan/22 16:51
Worklog Time Spent: 10m
Work Description: bogthe opened a new pull request #3902:
URL: https://github.com/apache/hadoop/pull/3902
### Description of PR
Since upgrading the SDK to 1.12.132 the access point endpoint translation was broken.
Correct endpoints should start with "s3-accesspoint.", after SDK upgrade they start with
"s3.accesspoint-" which messes up tests + region detection by the SDK.
- Fixed endpoint translation with a .replace, if SDK will fix the bug
then this replace will remain harmless;
- Fixed the TestArnResource tests;
### How was this patch tested?
Tested in `eu-west-1` by running
```
mvn -Dparallel-tests -DtestsThreadCount=32 clean verify
```
with output:
```
[INFO] Results:
[INFO]
[WARNING] Tests run: 1061, Failures: 0, Errors: 0, Skipped: 181
--------
[INFO]
[INFO] Results:
[INFO]
[WARNING] Tests run: 108, Failures: 0, Errors: 0, Skipped: 68
```
### For code changes:
- [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
- [x] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
- [x] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [x] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files?
@steveloughran
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 710648)
Remaining Estimate: 0h
Time Spent: 10m
> S3 SDK Upgrade causes AccessPoint ARN endpoint mistranslation
> -------------------------------------------------------------
>
> Key: HADOOP-18085
> URL: https://issues.apache.org/jira/browse/HADOOP-18085
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Bogdan Stolojan
> Assignee: Bogdan Stolojan
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Since upgrading the [SDK to 1.12.132|https://github.com/apache/hadoop/pull/3864] the access point endpoint translation was broken.
> Correct endpoints should start with "s3-accesspoint.", after SDK upgrade they start with "s3.accesspoint-" which messes up tests + region detection by the SDK.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org