You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Brandon Li (JIRA)" <ji...@apache.org> on 2013/11/25 20:04:35 UTC

[jira] [Created] (HDFS-5563) NFS gateway should commit the buffered data when read request comes after write to the same file

Brandon Li created HDFS-5563:
--------------------------------

             Summary: NFS gateway should commit the buffered data when read request comes after write to the same file
                 Key: HDFS-5563
                 URL: https://issues.apache.org/jira/browse/HDFS-5563
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: nfs
            Reporter: Brandon Li
            Assignee: Brandon Li


HDFS write is asynchronous and data may not be available to read immediately after write.
One of the main reason is that DFSClient doesn't flush data to DN until its local buffer is full.

To workaround this problem, when a read comes after write to the same file, NFS gateway should sync the data so the read request can get the latest content. The drawback is that, the frequent hsync() call can slow down data write.




--
This message was sent by Atlassian JIRA
(v6.1#6144)