You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Colin Freas <co...@gmail.com> on 2008/04/01 17:08:35 UTC

Performance impact of underlying file system?

Is the performance of Hadoop impacted by the underlying file system on the
nodes at all?

All my nodes are ext3.  I'm wondering if using XFS, Reiser, or ZFS might
improve performance.

Does anyone have any offhand knowledge about this?

-Colin

Re: Performance impact of underlying file system?

Posted by Ted Dunning <td...@veoh.com>.

I would expect that most file systems can saturate the disk bandwidth for
the large sequential reads that hadoop does.

We use ext3 with good results.

On 4/1/08 8:08 AM, "Colin Freas" <co...@gmail.com> wrote:

> Is the performance of Hadoop impacted by the underlying file system on the
> nodes at all?
> 
> All my nodes are ext3.  I'm wondering if using XFS, Reiser, or ZFS might
> improve performance.
> 
> Does anyone have any offhand knowledge about this?
> 
> -Colin