[jira] [Created] (HDFS-12651) Ozone: SCM: avoid synchronously loading all the keys from containers upon SCM datanode start

["Xiaoyu Yao (JIRA)" <ji...@apache.org>]

Xiaoyu Yao created HDFS-12651:
---------------------------------

             Summary: Ozone: SCM: avoid synchronously loading all the keys from containers upon SCM datanode start
                 Key: HDFS-12651
                 URL: https://issues.apache.org/jira/browse/HDFS-12651
             Project: Hadoop HDFS
          Issue Type: Sub-task
    Affects Versions: HDFS-7240
            Reporter: Xiaoyu Yao
            Assignee: Xiaoyu Yao


This is based on code review feedback from HDFS-12411 to avoid slow SCM datanode restart when there are large amount of keys and containers. 

E.g., 5 GB per container / 4 KB per key = 1.25 Million keys per container.

The proposed solution is async loading containers/key size info and update the containerStatus once done. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org