You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Matthew John <tm...@gmail.com> on 2011/06/02 06:08:05 UTC

IO benchmark ingesting data into HDFS

Hi all,

I wanted to use an IO benchmark that reads/writes Data from/into the HDFS
using MapReduce. TestDFSIO. I thought, does this. But what I understand is
that TestDFSIO merely creates the files in a temp folder in the local
filesystem of the TaskTracker nodes. Is this correct? How can such an
approach test the IOPs given by a IO intensive MapReduce workload ?

Matthew