[jira] [Updated] (HDFS-16331) Make dfs.blockreport.intervalMsec reconfigurable

["Shilun Fan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-16331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shilun Fan updated HDFS-16331:
------------------------------
    Affects Version/s: 3.3.5
                       3.4.0

> Make dfs.blockreport.intervalMsec reconfigurable
> ------------------------------------------------
>
>                 Key: HDFS-16331
>                 URL: https://issues.apache.org/jira/browse/HDFS-16331
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>    Affects Versions: 3.4.0, 3.3.5
>            Reporter: Tao Li
>            Assignee: Tao Li
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.4.0, 3.3.5
>
>         Attachments: image-2021-11-18-09-33-24-236.png, image-2021-11-18-09-35-35-400.png
>
>          Time Spent: 5h 40m
>  Remaining Estimate: 0h
>
> We have a cold data cluster, which stores as EC policy. There are 24 fast disks on each node and each disk is 7 TB. 
> Recently, many nodes have more than 10 million blocks, and the interval of FBR is 6h as default. Frequent FBR caused great pressure on NN.
> !image-2021-11-18-09-35-35-400.png|width=334,height=229!
> !image-2021-11-18-09-33-24-236.png|width=566,height=159!
> We want to increase the interval of FBR, but have to rolling restart the DNs, this operation is very heavy. In this scenario, it is necessary to make _dfs.blockreport.intervalMsec_ reconfigurable.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org