[jira] [Commented] (HDFS-15162) Optimize frequency of regular block reports

["Yanlei Yu (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDFS-15162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644205#comment-17644205 ] 

Yanlei Yu commented on HDFS-15162:
----------------------------------

hi，[~ayushtkn]，I submitted a patch to HDFS-16863, and FBR was executed only when failover and DiskError occurred. When I lost contact with namenode, I felt that sending FBR was meaningless

> Optimize frequency of regular block reports
> -------------------------------------------
>
>                 Key: HDFS-15162
>                 URL: https://issues.apache.org/jira/browse/HDFS-15162
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Ayush Saxena
>            Assignee: Ayush Saxena
>            Priority: Critical
>
> Avoid sending block report at regular interval, if there is no failover, DiskError or any exception encountered in connecting to the Namenode.
> This JIRA intents to limit the regular block reports to be sent only in case of the above scenarios and during re-registration  of datanode, to eliminate the overhead of processing BlockReports at Namenode in case of huge clusters.
> *Eg.* If a block report was sent at 0000 hours and the next was scheduled at 0600 hours if there is no above mentioned scenario, it will skip sending the BR, and schedule it to next 1200 hrs. if something of such sort happens between 06:- 12: it would send the BR normally.
> *NOTE*: This would be optional and can be turned off by default. Would add a configuration to enable this.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org