You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Yang Yun (Jira)" <ji...@apache.org> on 2019/11/28 14:29:00 UTC
[jira] [Created] (HDFS-15022) Add new RPC to transfer data block
with external shell script across Datanode
Yang Yun created HDFS-15022:
-------------------------------
Summary: Add new RPC to transfer data block with external shell script across Datanode
Key: HDFS-15022
URL: https://issues.apache.org/jira/browse/HDFS-15022
Project: Hadoop HDFS
Issue Type: Improvement
Components: datanode
Reporter: Yang Yun
Assignee: Yang Yun
Replicating data block is expensive when some Datanodes are down, especially for slow storage. Add a new RPC to replicate block with external shell script across datanode. User can choose more effective way to copy block files.
In our setup, Archive volume are configured to remote reliable storage. we just add a new link file in new datanode to the remote file when do replication.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org