You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Tom McCormick (Jira)" <ji...@apache.org> on 2022/10/03 16:30:00 UTC

[jira] [Created] (HADOOP-18473) New API for enclosing root path for a file

Tom McCormick created HADOOP-18473:
--------------------------------------

             Summary: New API for enclosing root path for a file
                 Key: HADOOP-18473
                 URL: https://issues.apache.org/jira/browse/HADOOP-18473
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Tom McCormick


At LinkedIn we run many HDFS volumes that are federated by either ViewFilesystem or Router Based Federation. As our number of hdfs volumes grows, we have a growing need to migrate data seemlessly across volumes.

Many frameworks have a notion of staging or temp directories, but those directories often live in random locations. We want an API getEnclosingRoot, which provides the root path a file or dataset. 

In ViewFilesystem / Router Based Federation, the enclosingRoot will be the mount point.

We will also take into account other restrictions for renames like encryptions zones.

If there are several paths (a mount point and an encryption zone), we will return the longer path



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org