You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Lei (Eddy) Xu (JIRA)" <ji...@apache.org> on 2016/09/27 17:54:21 UTC
[jira] [Created] (HDFS-10911) Change edit log OP_UPDATE_BLOCKS to
store delta blocks only.
Lei (Eddy) Xu created HDFS-10911:
------------------------------------
Summary: Change edit log OP_UPDATE_BLOCKS to store delta blocks only.
Key: HDFS-10911
URL: https://issues.apache.org/jira/browse/HDFS-10911
Project: Hadoop HDFS
Issue Type: Improvement
Components: namenode
Affects Versions: 3.0.0-alpha1, 2.7.3
Reporter: Lei (Eddy) Xu
Assignee: Lei (Eddy) Xu
Every time a HDFS client {{close}} or {{hflush}} an open file, NameNode enumerates all the blocks and stores then into edit log (OP_UPDATE_BLOCKS).
It would cause problem when the client is appending a large file frequently (i.e., WAL).
Because HDFS is append only, we can only store the blocks that have been changed (delta blocks) in edit log.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org