You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Li Yang <li...@apache.org> on 2016/05/22 02:09:38 UTC

Re: Resource occupancy is low

The layered cubing does not make heavy use of memory.

The fast cubing in Kylin 1.5 does leverages memory, but it does not
guarantee build becomes faster.

Tuning build speed is not simple task.

On Thu, May 19, 2016 at 4:25 PM, 耳东 <77...@qq.com> wrote:

> hi all:
>         Now I am building two cube,
>         one is in the Build Cube step and resource occupancy is 2G in MR,
> the fact table have 119.8G data, 0.8 billion reconds.
>           the other is in the Extract Fact Table Distinct step and
> resource occupancy is 38G in MR, the fact table have 1013.7G data,
> 9.7billion redonds.
>           While my cluster have 20 nodes, 256G memory per nodes ,32 cores
> and the total memory  is 3.32T and the Total Vcores is 3400. I think the
> Resource occupancy is too low , where should I adjust to make the Resource
> occupancy much more.