[jira] [Work started] (BEAM-14011) AWS SDK2 S3FileSystem MultiPart Copy sets incorrect request parameters

["Alexey Romanenko (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-14011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on BEAM-14011 started by Stephen Patel.
--------------------------------------------
> AWS SDK2 S3FileSystem MultiPart Copy sets incorrect request parameters
> ----------------------------------------------------------------------
>
>                 Key: BEAM-14011
>                 URL: https://issues.apache.org/jira/browse/BEAM-14011
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-aws
>    Affects Versions: 2.29.0, 2.30.0, 2.31.0, 2.32.0, 2.33.0, 2.34.0, 2.35.0, 2.36.0
>            Reporter: Stephen Patel
>            Assignee: Stephen Patel
>            Priority: P2
>          Time Spent: 4h
>  Remaining Estimate: 0h
>
> The following code locations use incorrect parameters:
> [Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L518-L519] and [Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L539-L540] specifies the sourcePath instead of the destinationPath.
> [Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L541] specifies destinationPath.getBucket() instead of sourcePath.getBucket()
> [Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L556] specifies a constant part number of 1, instead of using the partNumber variable.
> Taken together, these issues cause multipart copies to fail due to:
> {noformat}
> software.amazon.awssdk.services.s3.model.NoSuchUploadException: The specified upload does not exist. The upload ID may be invalid, or the upload may have been aborted or completed.
> {noformat}
> If the object references are fixes, the part number issue causes multipart copies to fail due to:
> {noformat}
> software.amazon.awssdk.services.s3.model.S3Exception: The list of parts was not in ascending order. Parts must be ordered by part number. 
> {noformat}
> Note: I checked the AWS SDK1 S3FileSystem and did not see the same issues.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)