You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by 耳东 <77...@qq.com> on 2016/05/20 08:31:50 UTC
回复： too little reduce
I set kylin.hbase.hfile.size.gb in kylin.properties to 1 and rebuild the cube. however in the Kylin_HFile_Generator_http_service_cube_Step, it still submitted 3260 map with 3 reduce.
------------------ 原始邮件 ------------------
发件人: "nichunen";<ni...@mininglamp.com>;
发送时间: 2016年5月19日(星期四) 晚上10:17
收件人: "dev"<de...@kylin.apache.org>;
抄送: "dev"<de...@kylin.apache.org>;
主题: Re: too little reduce
Hi,
Try set kylin.hbase.hfile.size.gb in kylin.properties to smaller size, the job will have more reducers and will be faster then.
George/倪春恩
Mobile:+86-13501723787| WeChat:nceecn
北京明略软件系统有限公司（MiningLamp.COM
）
上海市浦东新区晨晖路258号G座iDream张江科创中心C125
Room C125#,Intelligent Industrial Park Building G,258#Chenhui Road, Pudong District,Shanghai,201203
> On May 19, 2016, at 9:39 PM, 耳东 <77...@qq.com> wrote:
>
>
> HI all:
>
>
>
>
>
> When I build the cube, in the Convert Cuboid Data to HFile step, the mr job Kylin_HFile_Generator_http_service_cube_Step submitted 3260 map with 3 reduce. The map job completed in three minutes and the reduce job have been runing for 3 hours.
> How can I increase the reduce number?
>
Re: too little reduce
Posted by Li Yang <li...@apache.org>.
Try again on the coming 1.5.2 release.
On Fri, May 20, 2016 at 4:31 PM, 耳东 <77...@qq.com> wrote:
> I set kylin.hbase.hfile.size.gb in kylin.properties to 1 and rebuild the
> cube. however in the Kylin_HFile_Generator_http_service_cube_Step, it still
> submitted 3260 map with 3 reduce.
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "nichunen";<ni...@mininglamp.com>;
> 发送时间: 2016年5月19日(星期四) 晚上10:17
> 收件人: "dev"<de...@kylin.apache.org>;
> 抄送: "dev"<de...@kylin.apache.org>;
> 主题: Re: too little reduce
>
>
>
> Hi,
>
>
> Try set kylin.hbase.hfile.size.gb in kylin.properties to smaller size,
> the job will have more reducers and will be faster then.
>
>
>
>
> George/倪春恩
>
> Mobile:+86-13501723787| WeChat:nceecn
>
> 北京明略软件系统有限公司（MiningLamp.COM
> ）
>
>
>
>
>
> 上海市浦东新区晨晖路258号G座iDream张江科创中心C125
>
>
>
>
> Room C125#,Intelligent Industrial Park Building G,258#Chenhui Road, Pudong
> District,Shanghai,201203
>
>
>
>
> > On May 19, 2016, at 9:39 PM, 耳东 <77...@qq.com> wrote:
> >
> >
> > HI all:
> >
> >
> >
> >
> >
> > When I build the cube, in the Convert Cuboid Data to HFile step, the mr
> job Kylin_HFile_Generator_http_service_cube_Step submitted 3260 map with 3
> reduce. The map job completed in three minutes and the reduce job have been
> runing for 3 hours.
> > How can I increase the reduce number?
> >
>