You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Yang Yun (Jira)" <ji...@apache.org> on 2019/12/08 03:47:00 UTC
[jira] [Updated] (HDFS-15022) Add new RPC to transfer data block
with external shell script across Datanode
[ https://issues.apache.org/jira/browse/HDFS-15022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yang Yun updated HDFS-15022:
----------------------------
Attachment: link_block_across_datanode.pdf
> Add new RPC to transfer data block with external shell script across Datanode
> -----------------------------------------------------------------------------
>
> Key: HDFS-15022
> URL: https://issues.apache.org/jira/browse/HDFS-15022
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Reporter: Yang Yun
> Assignee: Yang Yun
> Priority: Minor
> Attachments: HDFS-15022.patch, HDFS-15022.patch, link_block_across_datanode.pdf
>
>
> Replicating data block is expensive when some Datanodes are down, especially for slow storage. Add a new RPC to replicate block with external shell script across datanode. User can choose more effective way to copy block files.
> In our setup, Archive volume are configured to remote reliable storage. we just add a new link file in new datanode to the remote file when do replication.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org