You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Hongbing Wang (Jira)" <ji...@apache.org> on 2022/02/09 10:27:00 UTC

[jira] [Commented] (HADOOP-18117) Add an option to preserve root directory permissions

    [ https://issues.apache.org/jira/browse/HADOOP-18117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489432#comment-17489432 ] 

Hongbing Wang commented on HADOOP-18117:
----------------------------------------

Thanks for considering this issue. In fact, we also faced this problem and solved it in our internal version as -HADOOP-15211- pointed out. 

Some discussion:
1.  Is it better not to add extra parameters?
2. If add parameters, `updateRootDirectoryAttributes` may be too complicated.

 

> Add an option to preserve root directory permissions
> ----------------------------------------------------
>
>                 Key: HADOOP-18117
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18117
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Mohanad Elsafty
>            Priority: Minor
>
> As mentioned in https://issues.apache.org/jira/browse/HADOOP-15211
>  
> If *-update* or *-overwrite* is being passed when *distcp* used, the root directory will be skipped in two occasions (CopyListing#doBuildListing & CopyCommitter#preserveFileAttributesForDirectories), which will ignore root directory's attributes.
>  
> We face the same issue when distcp huge data between clusters and it takes too much effort to update root directories attributes manually.
>  
> From the earlier ticket it's obvious why this behaviour is there, but sometime we need to enforce root directory update hence I will add a new option for distcp to enable someone (who understands the need of this and know what they are doing) to enforce the update of root directory's attributes (permissions, ownership, ...)
>  
> It should be simple one, something like this
> {code:java}
> $ hadoop distcp -p -update -updateRootDirectoryAttributes /a/b/c /a/b/d {code}
> This behaviour is optional and will be *false* by default. (it should not affect existing *distcp* users).



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org