You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Supratim Deka (JIRA)" <ji...@apache.org> on 2019/05/15 10:54:00 UTC
[jira] [Created] (HDDS-1535) Space tracking for Open Containers :
Handle Node Startup
Supratim Deka created HDDS-1535:
-----------------------------------
Summary: Space tracking for Open Containers : Handle Node Startup
Key: HDDS-1535
URL: https://issues.apache.org/jira/browse/HDDS-1535
Project: Hadoop Distributed Data Store
Issue Type: Improvement
Components: Ozone Datanode
Reporter: Supratim Deka
Assignee: Supratim Deka
This is related to HDDS-1511
Space tracking for Open Containers (committed space in the volume) relies on usedBytes in the Container state. usedBytes is not persisted for every update (chunkWrite). So on a node restart the value is stale.
The proposal is to:
iterate the block DB for each open container during startup and compute the used space.
The block DB process will be accelerated by spawning executors for each container.
This process will be carried out as part of building the container set during startup.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org