You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Thanh Do (JIRA)" <ji...@apache.org> on 2010/12/01 03:18:13 UTC
[jira] Commented: (HDFS-1058) reading from file under construction
fails if it reader beats writer to DN for new block
[ https://issues.apache.org/jira/browse/HDFS-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12965545#action_12965545 ]
Thanh Do commented on HDFS-1058:
--------------------------------
I think this is a design decision (stated in append design document at HDFS-265)
Here we trade performance for consistency,
> reading from file under construction fails if it reader beats writer to DN for new block
> ----------------------------------------------------------------------------------------
>
> Key: HDFS-1058
> URL: https://issues.apache.org/jira/browse/HDFS-1058
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: data-node, hdfs client
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Todd Lipcon
>
> If there is a writer and concurrent reader, the following can occur:
> - The writer allocates a new block from the NN
> - The reader calls getBlockLocations
> - Reader connects to the DN and calls getReplicaVisibleLength
> - writer still has not talked to the DN, so DN doesn't know about the block and throws an error
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.