You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Burak ISIKLI <bu...@yahoo.com> on 2010/08/25 23:12:09 UTC

Hadoop Benchmark Results

Hi,
I'm reading Hadoop Definitive Guide book. I've tried to benchmark my hadoop 
cluster. I got some results but when i compared them, i was shocked. Because 
there were several interesting difference. I don't understand is it good or bad?
Please help me
Regards...

Writing Test
 hadoop jar hadoop-0.20.2-test.jar TestDFSIO -write -nrFiles 10 -fileSize 1000
10/08/25 23:49:40 INFO mapred.FileInputFormat: ----- TestDFSIO ----- : write
10/08/25 23:49:40 INFO mapred.FileInputFormat:            Date & time: Wed Aug 
25 23:49:40 EEST 2010
10/08/25 23:49:40 INFO mapred.FileInputFormat:        Number of files: 10
10/08/25 23:49:40 INFO mapred.FileInputFormat: Total MBytes processed: 10000
10/08/25 23:49:40 INFO mapred.FileInputFormat:      Throughput mb/sec: 
36.09482833299645
10/08/25 23:49:40 INFO mapred.FileInputFormat: Average IO rate mb/sec: 
49.026153564453125
10/08/25 23:49:40 INFO mapred.FileInputFormat:  IO rate std deviation: 
22.15250292439401
10/08/25 23:49:40 INFO mapred.FileInputFormat:     Test exec time sec: 175.537

Reading Test
hadoop jar hadoop-0.20.2-test.jar TestDFSIO -read -nrFiles 10 -fileSize 1000
10/08/25 23:54:11 INFO mapred.FileInputFormat: ----- TestDFSIO ----- : read
10/08/25 23:54:11 INFO mapred.FileInputFormat:            Date & time: Wed Aug 
25 23:54:11 EEST 2010
10/08/25 23:54:11 INFO mapred.FileInputFormat:        Number of files: 10
10/08/25 23:54:11 INFO mapred.FileInputFormat: Total MBytes processed: 10000
10/08/25 23:54:11 INFO mapred.FileInputFormat:      Throughput mb/sec: 
152.87948510189418
10/08/25 23:54:11 INFO mapred.FileInputFormat: Average IO rate mb/sec: 
152.8846893310547
10/08/25 23:54:11 INFO mapred.FileInputFormat:  IO rate std deviation: 
0.8895501092647955
10/08/25 23:54:11 INFO mapred.FileInputFormat:     Test exec time sec: 61.618