You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Kanaka Kumar Avvaru (JIRA)" <ji...@apache.org> on 2017/06/02 08:03:04 UTC

[jira] [Created] (HDFS-11915) Sync rbw dir on the first hsync() to avoid file lost on power failure

Kanaka Kumar Avvaru created HDFS-11915:
------------------------------------------

             Summary: Sync rbw dir on the first hsync() to avoid file lost on power failure
                 Key: HDFS-11915
                 URL: https://issues.apache.org/jira/browse/HDFS-11915
             Project: Hadoop HDFS
          Issue Type: Bug
            Reporter: Kanaka Kumar Avvaru
            Priority: Critical


As discussed in HDFS-5042, there is a chance to loose blocks on power failure if rbw file creation entry is not yet sync to device. Then the block created is nowhere exists on disk. Neither in rbw nor in finalized. 

As suggested by [~kihwal], will discuss and track it in this JIRA.

As suggested by [~vinayrpet], May be first hsync() request on block file can call fsync on its parent directory (rbw) directory.





--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org