You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Li Bo (JIRA)" <ji...@apache.org> on 2015/01/22 03:49:34 UTC
[jira] [Commented] (HDFS-7653) Block Readers and Writers used in
both client side and datanode side
[ https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14286851#comment-14286851 ]
Li Bo commented on HDFS-7653:
-----------------------------
This patch includes block readers and writers that will be used by client and datanode. Because there exists BlockReader interface, we named a new interface called UnifiedBlockReader. Its sub classes include: ClientBlockReader(read a block from client), LocalDatanodeBlockReader(read a local block, used inside datanode), RemoteDatanodeBlockReader(read a block from remote datanode, used inside datanode). BlockWriter's sub classes include: ClientBlockWriter(write a block form client), LocalDatanodeBlockWriter(write a block locally, used inside datanode), RemoteDatanodeBlockWriter(write a block to a remote datanode, used inside datanode). Two unit tests are also uploaded.
Welcome to your feedback.
> Block Readers and Writers used in both client side and datanode side
> --------------------------------------------------------------------
>
> Key: HDFS-7653
> URL: https://issues.apache.org/jira/browse/HDFS-7653
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Li Bo
> Assignee: Li Bo
> Attachments: BlockReadersWriters.patch
>
>
> There're a lot of block read/write operations in HDFS-EC, for example, when client writes a file in striping layout, client has to write several blocks to several different datanodes; if a datanode wants to do an encoding/decoding task, it has to read several blocks from itself and other datanodes, and writes one or more blocks to itself or other datanodes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)