You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Vinayakumar B (JIRA)" <ji...@apache.org> on 2014/03/18 11:32:46 UTC

[jira] [Created] (HDFS-6115) flush() should be called for every append on block scan verification log

Vinayakumar B created HDFS-6115:
-----------------------------------

             Summary: flush() should be called for every append on block scan verification log
                 Key: HDFS-6115
                 URL: https://issues.apache.org/jira/browse/HDFS-6115
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: datanode
    Affects Versions: 2.3.0
            Reporter: Vinayakumar B
            Assignee: Vinayakumar B


{{RollingLogsImpl#out}} is  {{PrintWriter}} and it have the default buffersize of 8kB.

So until the 8kB buffer is filled all scan verification entries will not be flushed, hence there will be chance loosing this scan information if the datanode gets restarted. And One more scan will happen for these blocks.

8kB will have ~80 entries, so 80 blocks needs to be re-scanned again.



--
This message was sent by Atlassian JIRA
(v6.2#6252)