You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Kihwal Lee (Jira)" <ji...@apache.org> on 2020/06/19 15:07:00 UTC

[jira] [Created] (HDFS-15422) Reported IBR is partially replaced with stored info when queuing.

Kihwal Lee created HDFS-15422:
---------------------------------

             Summary: Reported IBR is partially replaced with stored info when queuing.
                 Key: HDFS-15422
                 URL: https://issues.apache.org/jira/browse/HDFS-15422
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: namenode
            Reporter: Kihwal Lee


When queueing an IBR (incremental block report) on a standby namenode, some of the reported information is being replaced with the existing stored information.  This can lead to false block corruption.

We had a namenode, after transitioning to active, started reporting missing blocks with "SIZE_MISMATCH" as corrupt reason. These were blocks that were appended and the sizes were actually correct on the datanodes. Upon further investigation, it was determined that the namenode was queueing IBRs with altered information.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org