You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by 郭帅 <ve...@163.com> on 2015/03/27 11:17:48 UTC

change Reduce_Number Of Order_By


I have some problems when I insert data with order by .
The data is non-uniform ， I changed  the configuration below 
     1. set hive.optimize.sampling.orderby=true;
     2. set hive.optimize.sampling.orderby.number=100000;
     3.set mapred.reduce.tasks=100;
but when the sampling had done , there were only 2 reducer for the job . 
Could I  make it 100   and How.


--
 have a nice day～guoshuai

回复: change Reduce_Number Of Order_By

Posted by "r7raul1984@163.com" <r7...@163.com>.

try set mapreduce.job.reduces



r7raul1984@163.com
 
发件人： 郭帅
发送时间： 2015-03-27 18:17
收件人： hiveMailing
主题： change Reduce_Number Of Order_By

I have some problems when I insert data with order by .
The data is non-uniform ， I changed  the configuration below 
     1. set hive.optimize.sampling.orderby=true;
     2. set hive.optimize.sampling.orderby.number=100000;
     3.set mapred.reduce.tasks=100;
but when the sampling had done , there were only 2 reducer for the job .  
Could I  make it 100   and How.

--
 have a nice day～guoshuai