You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "William Lo (Jira)" <ji...@apache.org> on 2024/05/28 20:24:00 UTC

[jira] [Updated] (GOBBLIN-2072) Permission mismatch in manifest distcp where empty folders are copied

     [ https://issues.apache.org/jira/browse/GOBBLIN-2072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

William Lo updated GOBBLIN-2072:
--------------------------------
    Priority: Minor  (was: Major)

> Permission mismatch in manifest distcp where empty folders are copied
> ---------------------------------------------------------------------
>
>                 Key: GOBBLIN-2072
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-2072
>             Project: Apache Gobblin
>          Issue Type: Bug
>          Components: gobblin-core
>            Reporter: William Lo
>            Assignee: Abhishek Tiwari
>            Priority: Minor
>
> In Manifest distcp, empty folders are being set with the incorrect permissions in SetPermissionStep after being correctly set in the CopyDataPublisher.
> The suspected reason is that the folders themselves are being treated as ancestors, and this causes the permission checking of the source and destination ancestors to act incorrectly. TODO: We should consolidate our permission comparison and logic given that there are a multitude of different implementations and they each seem to have their own quirks.
> Correct CopyDataPublisher:
> {code:java}
> Setting destination directory hdfs://cluster/a/b/c owner and permission to rwxr-x---{code}
> Incorrect permission commit step:
> {code:java}
> [Azkaban] Setting permission rwxr-xr-x on path /a/b/c{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)