You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Saketa Chalamchala (Jira)" <ji...@apache.org> on 2024/04/01 19:41:00 UTC
[jira] [Assigned] (HDDS-10630) S3A: parent directory not found during CompleteMPU request in FSO bucket
[ https://issues.apache.org/jira/browse/HDDS-10630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Saketa Chalamchala reassigned HDDS-10630:
-----------------------------------------
Assignee: Saketa Chalamchala
> S3A: parent directory not found during CompleteMPU request in FSO bucket
> ------------------------------------------------------------------------
>
> Key: HDDS-10630
> URL: https://issues.apache.org/jira/browse/HDDS-10630
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: S3
> Reporter: Saketa Chalamchala
> Assignee: Saketa Chalamchala
> Priority: Major
>
> {{ITestS3ACommitterMRJob}} fails on FSO bucket.
> S3 Gateway audit log:
> {code}
> 2024-03-22 18:05:34,785 | INFO | OMAudit | user=s3acontract | ip=192.168.192.3 | op=CREATE_DIRECTORY {volume=s3v, bucket=fso-bucket, key=test/ITestS3ACommitterMRJob-execute-directory/, dataSize=0} | ret=SUCCESS |
> 2024-03-22 18:05:40,117 | INFO | OMAudit | user=s3acontract | ip=192.168.192.3 | op=DELETE_KEY {volume=s3v, bucket=fso-bucket, key=test/ITestS3ACommitterMRJob-execute-directory, dataSize=0} | ret=SUCCESS |
> 2024-03-22 18:05:40,160 | ERROR | OMAudit | user=s3acontract | ip=192.168.192.3 | op=COMPLETE_MULTIPART_UPLOAD {volume=s3v, bucket=fso-bucket, key=test/ITestS3ACommitterMRJob-execute-directory/part-m-00000, dataSize=0, multipartList=[partNumber: 1 partName: "f03627c876605452a26379320675064e" eTag: "f03627c876605452a26379320675064e" ]} | ret=FAILURE | DIRECTORY_NOT_FOUND org.apache.hadoop.ozone.om.exceptions.OMException: Failed to find parent directory of test/ITestS3ACommitterMRJob-execute-directory/part-m-00000
> {code}
> S3A uses multipart upload to commit job results in a batch. The staging committer's {{replace}} mode deletes the target directory before completing MPU. The problem is that FSO creates intermediate dirs during "initiate MPU" request. Thus the "complete MPU" request finds directory to be non-existent.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org