You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Yang Yun (Jira)" <ji...@apache.org> on 2019/11/28 14:29:00 UTC

[jira] [Created] (HDFS-15022) Add new RPC to transfer data block with external shell script across Datanode

Yang Yun created HDFS-15022:
-------------------------------

             Summary: Add new RPC to transfer data block with external shell script across Datanode
                 Key: HDFS-15022
                 URL: https://issues.apache.org/jira/browse/HDFS-15022
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: datanode
            Reporter: Yang Yun
            Assignee: Yang Yun


Replicating data block is expensive when some Datanodes are down, especially for slow storage. Add a new RPC to replicate block with external shell script across datanode. User can choose more effective way to copy block files.


In our setup, Archive volume are configured to remote reliable storage. we just add a new link file in new datanode to the remote file when do replication.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org