[jira] [Created] (HDFS-16331) Make dfs.blockreport.intervalMsec reconfigurable

["tomscut (Jira)" <ji...@apache.org>]

tomscut created HDFS-16331:
------------------------------

             Summary: Make dfs.blockreport.intervalMsec reconfigurable
                 Key: HDFS-16331
                 URL: https://issues.apache.org/jira/browse/HDFS-16331
             Project: Hadoop HDFS
          Issue Type: New Feature
            Reporter: tomscut
            Assignee: tomscut
         Attachments: image-2021-11-18-09-33-24-236.png, image-2021-11-18-09-35-35-400.png

We have a cold data cluster, which stores as EC policy. There are 24 fast disks on each node and each disk is 7 TB. 

Recently, many nodes have more than 10 million blocks, and the interval of FBR is 6h as default. Frequent FBR caused great pressure on NN.

!image-2021-11-18-09-35-35-400.png|width=491,height=337!

!image-2021-11-18-09-33-24-236.png|width=912,height=256!

We want to increase the interval of FBR, but have to rolling restart the DNs, this operation is very heavy. In this scenario, it is necessary to make _dfs.blockreport.intervalMsec_ reconfigurable.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org