You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Kannu <pu...@gmail.com> on 2011/03/15 05:59:02 UTC

Load testing in hadoop

Please tell me how to use synthetic load generator in hadoop or suggest me
any other way of load testing in hadoop cluster.

thanks,
kannu
-- 
View this message in context: http://old.nabble.com/Load-testing-in-hadoop-tp31151119p31151119.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.


Re: Load testing in hadoop

Posted by Steve Loughran <st...@apache.org>.
On 15/03/11 04:59, Kannu wrote:
>
> Please tell me how to use synthetic load generator in hadoop or suggest me
> any other way of load testing in hadoop cluster.
>
> thanks,
> kannu

terasort is the one most people use, as it generates its own datasets. 
Otherwise you need a few TB of data and some custom code to run on it.

Gridmix/gridmix2 can also simulate load.

All this stuff is in the hadoop source tree, with documentation