You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2024/12/03 13:40:02 UTC
[jira] [Updated] (HADOOP-18113) remove filtering of directory markers in s3a RenameOperation
[ https://issues.apache.org/jira/browse/HADOOP-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran updated HADOOP-18113:
------------------------------------
Parent: HADOOP-19353 (was: HADOOP-18477)
> remove filtering of directory markers in s3a RenameOperation
> ------------------------------------------------------------
>
> Key: HADOOP-18113
> URL: https://issues.apache.org/jira/browse/HADOOP-18113
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: Steve Loughran
> Priority: Minor
>
> S3A RenameOperation tries to filter out renaming intermediate directory markers so as to avoid retaining them when copying from an authoritiative dir to a non-auth one. we did this to support installations where dir marker retention was only enabled for auth dirs
> * nobody, AFAIK, does this..it is all or nothing
> * all recent hadoop releases, including earlier branches, is now marker aware
> * the extras complexity makes debugging rename problems harder.
> let's just cut it out.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org