You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Bogdan Raducanu (JIRA)" <ji...@apache.org> on 2014/10/20 18:32:34 UTC

[jira] [Created] (HDFS-7268) Can't append with SYNC_BLOCK

Bogdan Raducanu created HDFS-7268:
-------------------------------------

             Summary: Can't append with SYNC_BLOCK
                 Key: HDFS-7268
                 URL: https://issues.apache.org/jira/browse/HDFS-7268
             Project: Hadoop HDFS
          Issue Type: Bug
          Components: hdfs-client
    Affects Versions: 2.4.1
            Reporter: Bogdan Raducanu
            Assignee: Bogdan Raducanu


It seems to me that currently it's not possible to start appending to a file with CreateFlag.SYNC_BLOCK behavior (i.e. hsync after each block). This means proper fsync is not possible when appending (unless doing hsync after every write, I guess).
FileSystem.append doesn't accept a CreateFlag argument (probably shouldn't anyway).
FileSystem.create ignores CreateFlag.APPEND
It seems it might work through FileContext but in the end DFSOutputStream can't be passed a CreateFlag for appending anyway.
Am I missing something?
I will think of a way to fix it. An immediate thought is to add a setSyncBlock() method to DFSOutputStream and remove CreateFlag.SYNC_BLOCK.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)