You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by arun k <ar...@gmail.com> on 2011/12/09 07:26:17 UTC

Benchmarks for IO and CPU Intensive workload

Hi guys !

I want to see the behavior of a single node of Hadoop cluster when IO
intensive / CPU intensive workload and mix of both is submitted to the
single node alone.
These workloads must stress the nodes.
I see that TestDFSIO benchmark is good for IO intensive workload.
Which benchmarks do i need to use for this ?
What amount of input data will be fair enough for seeing the behavior under
these workloads for each type of boxes if i have boxes with :-
 B1: 4 GB RAM, Dual  core ,150-250 GB DISK ,
 B2 : 1GB RAM, 50-80 GB Disk.


Arun