You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Matthew John <tm...@gmail.com> on 2011/05/31 16:31:25 UTC

Benchmarks with different workloads

Hi ,

I am looking out for Hadoop benchmarks that could characterize the following
workloads :

1) IO intensive workload

2) CPU intensive workload

3) Mixed (IO + CPU) workloads

Some one please throw some pointers on these!!

Thanks,
Matthew

Re: Benchmarks with different workloads

Posted by Amar Kamat <am...@yahoo-inc.com>.

Matthew,
You can use Gridmix for benchmarking Hadoop. You can use Gridmix (v1 & v2) to benchmark the Hadoop cluster. Gridmix (v1 & v2) are scripts having MapReduce jobs with varying load characteristics. You can also modify these scripts to suit your need. Gridmix is part of Hadoop and can be found at src/benchmarks inside the MapReduce code repository.

Amar


On 5/31/11 8:01 PM, "Matthew John" <tm...@gmail.com> wrote:

Hi ,

I am looking out for Hadoop benchmarks that could characterize the following
workloads :

1) IO intensive workload

2) CPU intensive workload

3) Mixed (IO + CPU) workloads

Some one please throw some pointers on these!!

Thanks,
Matthew