You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Gang Luo <lg...@yahoo.com.cn> on 2010/03/05 21:33:59 UTC

skewed dataset

Hi all,
I want to generate some datasets with data skew to test my
mapreduce jobs. I am using TPC-DS but it seems I cannot control the
data skew level. There is a suite from Microsoft that could generate
skewed datasets based on TPC-D, but only workable in windows. I haven't
succeed make it compilable in linux yet. Please tell me how can I get
some skewed dataset.

Thanks.
-Gang