You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "William Lo (Jira)" <ji...@apache.org> on 2024/05/28 20:24:00 UTC
[jira] [Updated] (GOBBLIN-2072) Permission mismatch in manifest distcp where empty folders are copied
[ https://issues.apache.org/jira/browse/GOBBLIN-2072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
William Lo updated GOBBLIN-2072:
--------------------------------
Priority: Minor (was: Major)
> Permission mismatch in manifest distcp where empty folders are copied
> ---------------------------------------------------------------------
>
> Key: GOBBLIN-2072
> URL: https://issues.apache.org/jira/browse/GOBBLIN-2072
> Project: Apache Gobblin
> Issue Type: Bug
> Components: gobblin-core
> Reporter: William Lo
> Assignee: Abhishek Tiwari
> Priority: Minor
>
> In Manifest distcp, empty folders are being set with the incorrect permissions in SetPermissionStep after being correctly set in the CopyDataPublisher.
> The suspected reason is that the folders themselves are being treated as ancestors, and this causes the permission checking of the source and destination ancestors to act incorrectly. TODO: We should consolidate our permission comparison and logic given that there are a multitude of different implementations and they each seem to have their own quirks.
> Correct CopyDataPublisher:
> {code:java}
> Setting destination directory hdfs://cluster/a/b/c owner and permission to rwxr-x---{code}
> Incorrect permission commit step:
> {code:java}
> [Azkaban] Setting permission rwxr-xr-x on path /a/b/c{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)