You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2025/01/08 17:49:00 UTC
[jira] [Updated] (HADOOP-19278) S3A: remove option to delete directory markers
[ https://issues.apache.org/jira/browse/HADOOP-19278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran updated HADOOP-19278:
------------------------------------
Description:
S3A no longer supports the ability to disable deletion of parent directory
markers on file or directory creation.
The option "fs.s3a.directory.marker.retention" is no longer supported.
Tnhis is incompatible with all hadoop versions before 3.2.2 and with hadoop 3.3.0
when applications using the s3a connector attempt to write to the same repository.
We've supported directory marker retention since HADOOP-13230 went in.
and switch to making it the default in HADOOP-18752
was:
We've supported directory marker retention since HADOOP-13230 went in.
and switch to making it the default in HADOOP-18752
nobody has ever complained about this.
proposed: cut directory marker deletion entirely.
this will
* simplify our code
* cut down on test options
> S3A: remove option to delete directory markers
> ----------------------------------------------
>
> Key: HADOOP-19278
> URL: https://issues.apache.org/jira/browse/HADOOP-19278
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Affects Versions: 3.4.1
> Reporter: Steve Loughran
> Priority: Major
> Labels: pull-request-available
>
> S3A no longer supports the ability to disable deletion of parent directory
> markers on file or directory creation.
> The option "fs.s3a.directory.marker.retention" is no longer supported.
> Tnhis is incompatible with all hadoop versions before 3.2.2 and with hadoop 3.3.0
> when applications using the s3a connector attempt to write to the same repository.
> We've supported directory marker retention since HADOOP-13230 went in.
> and switch to making it the default in HADOOP-18752
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org