You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by John Lilley <jo...@redpoint.net> on 2013/06/16 15:33:55 UTC
HDFS file reader and buffering
Do the HDFS file-reader classes perform internal buffering?
Thanks
John
Re: HDFS file reader and buffering
Posted by Harsh J <ha...@cloudera.com>.
Yes they do maintain a buffer equal to the configurable size of
io.file.buffer.size (4k default) for both reads and writes.
On Sun, Jun 16, 2013 at 7:03 PM, John Lilley <jo...@redpoint.net> wrote:
> Do the HDFS file-reader classes perform internal buffering?
>
> Thanks
>
> John
>
>
>
>
--
Harsh J
Re: HDFS file reader and buffering
Posted by Harsh J <ha...@cloudera.com>.
Yes they do maintain a buffer equal to the configurable size of
io.file.buffer.size (4k default) for both reads and writes.
On Sun, Jun 16, 2013 at 7:03 PM, John Lilley <jo...@redpoint.net> wrote:
> Do the HDFS file-reader classes perform internal buffering?
>
> Thanks
>
> John
>
>
>
>
--
Harsh J
Re: HDFS file reader and buffering
Posted by Harsh J <ha...@cloudera.com>.
Yes they do maintain a buffer equal to the configurable size of
io.file.buffer.size (4k default) for both reads and writes.
On Sun, Jun 16, 2013 at 7:03 PM, John Lilley <jo...@redpoint.net> wrote:
> Do the HDFS file-reader classes perform internal buffering?
>
> Thanks
>
> John
>
>
>
>
--
Harsh J
Re: HDFS file reader and buffering
Posted by Harsh J <ha...@cloudera.com>.
Yes they do maintain a buffer equal to the configurable size of
io.file.buffer.size (4k default) for both reads and writes.
On Sun, Jun 16, 2013 at 7:03 PM, John Lilley <jo...@redpoint.net> wrote:
> Do the HDFS file-reader classes perform internal buffering?
>
> Thanks
>
> John
>
>
>
>
--
Harsh J