You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2017/11/16 19:40:00 UTC
[jira] [Comment Edited] (HADOOP-15044) Wasb getFileBlockLocations()
returns too many locations.
[ https://issues.apache.org/jira/browse/HADOOP-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16255845#comment-16255845 ]
Steve Loughran edited comment on HADOOP-15044 at 11/16/17 7:39 PM:
-------------------------------------------------------------------
+[~tmarquardt].
Found this when merging the wasb logic with that I was adding for HADOOP-14043: you always get the #of blocks in the file, irrespective of offset or length. Will be fixed in that patch
was (Author: stevel@apache.org):
+[~tmarquardt].
Found this when merging the wasb logic with that I was adding for HADOOP-14393: you always get the #of blocks in the file, irrespective of offset or length. Will be fixed in that patch
> Wasb getFileBlockLocations() returns too many locations.
> --------------------------------------------------------
>
> Key: HADOOP-15044
> URL: https://issues.apache.org/jira/browse/HADOOP-15044
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Reporter: Steve Loughran
>
> The wasb mimicking of {{getFileBlockLocations()}} uses the length of the file as the number to use to calculate the # of blocks to create (i.e. file.length/blocksize), when it should be just the range of the request.
> As a result, you always get the number of blocks in the total file, not the number spanning the range of (start, len). If this is less (i.e start > 0 or len < file.length), you end up with some 0-byte-range blocks at the end
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org