You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by Hans Uhlig <hu...@uhlisys.com> on 2012/12/19 21:44:54 UTC

Block emulation on local FS

Is there a good way to emulate or determine the blocks that would exist on
HDFS for a given file. if I have a 135mb file and my block size is 128,
does it stand to say I would have 2 blocks, block A is byte 0-134217728 and
Block b is 134217729-141557761 deterministically? I am attempting to
calculate checksum in a manner that matches the method defined in
DFSClient.getChecksum(Path p).

Re: Block emulation on local FS

Posted by Harsh J <ha...@cloudera.com>.

Hi,

On Thu, Dec 20, 2012 at 2:14 AM, Hans Uhlig <hu...@uhlisys.com> wrote:
> Is there a good way to emulate or determine the blocks that would exist on
> HDFS for a given file. if I have a 135mb file and my block size is 128,
> does it stand to say I would have 2 blocks, block A is byte 0-134217728 and
> Block b is 134217729-141557761 deterministically?

Yes, blocks are split exactly at the specified block boundary.

--
Harsh J