[jira] [Created] (HDFS-16911) Distcp with snapshot diff to support Ozone filesystem.

["Sadanand Shenoy (Jira)" <ji...@apache.org>]

Sadanand Shenoy created HDFS-16911:
--------------------------------------

             Summary: Distcp with snapshot diff to support Ozone filesystem.
                 Key: HDFS-16911
                 URL: https://issues.apache.org/jira/browse/HDFS-16911
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: distcp
            Reporter: Sadanand Shenoy


Currently in DistcpSync i.e the step which applies the diff b/w 2 provided snapshots as arguments to the distcp job with -diff option, only DistributedFilesystem and WebHDFS filesytems are supported.

 
{code:java}
// currently we require both the source and the target file system are
// DistributedFileSystem or (S)WebHdfsFileSystem.
if (!(srcFs instanceof DistributedFileSystem
        || srcFs instanceof WebHdfsFileSystem)) {
  throw new IllegalArgumentException("Unsupported source file system: "
      + srcFs.getScheme() + "://. " +
      "Supported file systems: hdfs://, webhdfs:// and swebhdfs://.");
}
if (!(tgtFs instanceof DistributedFileSystem
    || tgtFs instanceof WebHdfsFileSystem)) {
  throw new IllegalArgumentException("Unsupported target file system: "
      + tgtFs.getScheme() + "://. " +
      "Supported file systems: hdfs://, webhdfs:// and swebhdfs://.");
}{code}
As Ozone now supports snapshot feature after HDDS-6517, add support to use distcp with ozone snapshots.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org