[jira] [Assigned] (HDFS-10911) Change edit log OP_UPDATE_BLOCKS to store delta blocks only.

["Lei (Eddy) Xu (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lei (Eddy) Xu reassigned HDFS-10911:
------------------------------------

    Assignee:     (was: Lei (Eddy) Xu)

> Change edit log OP_UPDATE_BLOCKS to store delta blocks only.
> ------------------------------------------------------------
>
>                 Key: HDFS-10911
>                 URL: https://issues.apache.org/jira/browse/HDFS-10911
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: namenode
>    Affects Versions: 2.7.3, 3.0.0-alpha1
>            Reporter: Lei (Eddy) Xu
>            Priority: Major
>
> Every time a HDFS client {{close}}  or {{hflush}} an open file, NameNode enumerates all the blocks  and stores then into edit log (OP_UPDATE_BLOCKS). 
> It would cause problem when the client is appending a large file frequently (i.e., WAL). 
> Because HDFS is append only, we can only store the blocks that have been changed (delta blocks) in edit log.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org