You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Hongbing Wang (Jira)" <ji...@apache.org> on 2022/02/09 10:27:00 UTC
[jira] [Commented] (HADOOP-18117) Add an option to preserve root directory permissions
[ https://issues.apache.org/jira/browse/HADOOP-18117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489432#comment-17489432 ]
Hongbing Wang commented on HADOOP-18117:
----------------------------------------
Thanks for considering this issue. In fact, we also faced this problem and solved it in our internal version as -HADOOP-15211- pointed out.
Some discussion:
1. Is it better not to add extra parameters?
2. If add parameters, `updateRootDirectoryAttributes` may be too complicated.
> Add an option to preserve root directory permissions
> ----------------------------------------------------
>
> Key: HADOOP-18117
> URL: https://issues.apache.org/jira/browse/HADOOP-18117
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Mohanad Elsafty
> Priority: Minor
>
> As mentioned in https://issues.apache.org/jira/browse/HADOOP-15211
>
> If *-update* or *-overwrite* is being passed when *distcp* used, the root directory will be skipped in two occasions (CopyListing#doBuildListing & CopyCommitter#preserveFileAttributesForDirectories), which will ignore root directory's attributes.
>
> We face the same issue when distcp huge data between clusters and it takes too much effort to update root directories attributes manually.
>
> From the earlier ticket it's obvious why this behaviour is there, but sometime we need to enforce root directory update hence I will add a new option for distcp to enable someone (who understands the need of this and know what they are doing) to enforce the update of root directory's attributes (permissions, ownership, ...)
>
> It should be simple one, something like this
> {code:java}
> $ hadoop distcp -p -update -updateRootDirectoryAttributes /a/b/c /a/b/d {code}
> This behaviour is optional and will be *false* by default. (it should not affect existing *distcp* users).
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org