[jira] [Created] (HDFS-10244) Avoid accumulation of IBRs for SNN when the standby is down for more than expected time

["Brahma Reddy Battula (JIRA)" <ji...@apache.org>]

Brahma Reddy Battula created HDFS-10244:
-------------------------------------------

             Summary: Avoid accumulation of IBRs for SNN when the standby is down for more than expected time
                 Key: HDFS-10244
                 URL: https://issues.apache.org/jira/browse/HDFS-10244
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Brahma Reddy Battula
            Assignee: Brahma Reddy Battula


As per discussion in HDFS-9917 and [comment|https://issues.apache.org/jira/browse/HDFS-9917?focusedCommentId=15213947&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15213947] from [~vinayrpet] 

 Avoid accumulation of IBRs when the standby is down for long time, can we consider as below.
1. IBRs for StandbyNN can have a threshold ( say 100K or 1Million IBRs ).
2. Also not to loose any important IBRs, IBRs can be cleared when "the threshold is reached AND 'lastIBR' is more than 'heartbeatExpiryInterval'. i.e. DataNode is considered dead in Namenode side". In that case, for sure re-Register() will be called on reconnection to running NameNode (if any).




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)