[jira] [Commented] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when disabled

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711534#comment-17711534 ] 

ASF GitHub Bot commented on HADOOP-18695:
-----------------------------------------

steveloughran opened a new pull request, #5548:
URL: https://github.com/apache/hadoop/pull/5548

   
   Adds a new subclass of AuditFailureException, AuditOperationRejectedException to indicate audit rejection of the operation.
   This is mapped to a new PathIOE subclass, UnsupportedRequestException, in the method AuditIntegration.translateAuditException(), so avoiding making S3AUtils.translateException even more complicated.
   
   New test ITestS3AHugeFilesNoMultipart extends the huge file test to verify rename worked, and that it is correctly rejected if the part size is too small.
   
   Contains
   HADOOP-18698 S3ABlockOutputStream doesn't collect stats on multipart block uploads
    This adds a new DurationTrackerFactory parameter to WriteOperation.uploadPart()
    and the S3AFileSystem equivalent; all callers updated to collect duration
    of this in their IOStatistics.
   
   
   ### How was this patch tested?
   
   new unit tests + new ITest
   
   ### For code changes:
   
   - [X] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
   - [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files?
   
   




> S3A: reject multipart copy requests initiated by transfer manager when disabled
> -------------------------------------------------------------------------------
>
>                 Key: HADOOP-18695
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18695
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>    Affects Versions: 3.4.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Minor
>
> follow-on to HADOOP-18637 and support for huge file uploads with stores which don't support MPU.
> * prevent use of API against any s3 store when disabled, using logging auditor to reject it
> * tests to verify rename of huge files still works (by setting large part size)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org