You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Santoshakhilesh <sa...@huawei.com> on 2015/03/05 14:54:06 UTC

This error while saving cube//FW: Kylin is being killed when trying to build the cube




Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.

www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!
________________________________
From: Santoshakhilesh
Sent: Thursday, March 05, 2015 7:08 PM
To: dev@kylin.incubator.apache.org
Cc: Kulbhushan Rana
Subject: Kylin is being killed when trying to build the cube


Hi All ,



   I switched to 0.7 binary distribution , while building a small cube , I have a very small fact table around 1000 records and small dim tables. Running on 32 GB single node. 20G memory is free in my system.







#
# java.lang.OutOfMemoryError: PermGen space
# -XX:OnOutOfMemoryError="kill -9 %p"
#   Executing /bin/sh -c "kill -9 4788"...
)
[pool-4-thread-5]:[2015-03-06 03:01:34,485][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:d418a3d8-f360-488b-899a-f958b9354fbe-01 from RUNNING to SUCCEED
[pool-4-thread-5]:[2015-03-06 03:01:34,503][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d418a3d8-f360-488b-899a-f958b9354fbe (Store kylin_metadata_qa@hbase<ma...@hbase>)
[pool-4-thread-5]:[2015-03-06 03:01:34,511][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d418a3d8-f360-488b-899a-f958b9354fbe (Store kylin_metadata_qa@hbase<ma...@hbase>)
[pool-4-thread-5]:[2015-03-06 03:01:34,513][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:d418a3d8-f360-488b-899a-f958b9354fbe from RUNNING to SUCCEED



Regards,
Santosh Akhilesh
Bangalore R&D
HUAWEI TECHNOLOGIES CO.,LTD.

www.huawei.com
-------------------------------------------------------------------------------------------------------------------------------------
This e-mail and its attachments contain confidential information from HUAWEI, which
is intended only for the person or entity whose address is listed above. Any use of the
information contained herein in any way (including, but not limited to, total or partial
disclosure, reproduction, or dissemination) by persons other than the intended
recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!

Re: This error while saving cube//FW: Kylin is being killed when trying to build the cube

Posted by hongbin ma <ma...@apache.org>.
https://github.com/KylinOLAP/Kylin/pull/426

On Fri, Mar 6, 2015 at 10:01 AM, hongbin ma <ma...@apache.org> wrote:

> please refer this to increase PermGen space. maybe the default settings
> is too small for your case
>
> On Thu, Mar 5, 2015 at 9:54 PM, Santoshakhilesh <
> santosh.akhilesh@huawei.com> wrote:
>
>>
>>
>>
>>
>> Regards,
>> Santosh Akhilesh
>> Bangalore R&D
>> HUAWEI TECHNOLOGIES CO.,LTD.
>>
>> www.huawei.com
>>
>> -------------------------------------------------------------------------------------------------------------------------------------
>> This e-mail and its attachments contain confidential information from
>> HUAWEI, which
>> is intended only for the person or entity whose address is listed above.
>> Any use of the
>> information contained herein in any way (including, but not limited to,
>> total or partial
>> disclosure, reproduction, or dissemination) by persons other than the
>> intended
>> recipient(s) is prohibited. If you receive this e-mail in error, please
>> notify the sender by
>> phone or email immediately and delete it!
>> ________________________________
>> From: Santoshakhilesh
>> Sent: Thursday, March 05, 2015 7:08 PM
>> To: dev@kylin.incubator.apache.org
>> Cc: Kulbhushan Rana
>> Subject: Kylin is being killed when trying to build the cube
>>
>>
>> Hi All ,
>>
>>
>>
>>    I switched to 0.7 binary distribution , while building a small cube ,
>> I have a very small fact table around 1000 records and small dim tables.
>> Running on 32 GB single node. 20G memory is free in my system.
>>
>>
>>
>>
>>
>>
>>
>> #
>> # java.lang.OutOfMemoryError: PermGen space
>> # -XX:OnOutOfMemoryError="kill -9 %p"
>> #   Executing /bin/sh -c "kill -9 4788"...
>> )
>> [pool-4-thread-5]:[2015-03-06
>> 03:01:34,485][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
>> - job id:d418a3d8-f360-488b-899a-f958b9354fbe-01 from RUNNING to SUCCEED
>> [pool-4-thread-5]:[2015-03-06
>> 03:01:34,503][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
>> - Saving resource /execute_output/d418a3d8-f360-488b-899a-f958b9354fbe
>> (Store kylin_metadata_qa@hbase<ma...@hbase>)
>> [pool-4-thread-5]:[2015-03-06
>> 03:01:34,511][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
>> - Saving resource /execute_output/d418a3d8-f360-488b-899a-f958b9354fbe
>> (Store kylin_metadata_qa@hbase<ma...@hbase>)
>> [pool-4-thread-5]:[2015-03-06
>> 03:01:34,513][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
>> - job id:d418a3d8-f360-488b-899a-f958b9354fbe from RUNNING to SUCCEED
>>
>>
>>
>> Regards,
>> Santosh Akhilesh
>> Bangalore R&D
>> HUAWEI TECHNOLOGIES CO.,LTD.
>>
>> www.huawei.com
>>
>> -------------------------------------------------------------------------------------------------------------------------------------
>> This e-mail and its attachments contain confidential information from
>> HUAWEI, which
>> is intended only for the person or entity whose address is listed above.
>> Any use of the
>> information contained herein in any way (including, but not limited to,
>> total or partial
>> disclosure, reproduction, or dissemination) by persons other than the
>> intended
>> recipient(s) is prohibited. If you receive this e-mail in error, please
>> notify the sender by
>> phone or email immediately and delete it!
>>
>
>

Re: This error while saving cube//FW: Kylin is being killed when trying to build the cube

Posted by hongbin ma <ma...@apache.org>.
please refer this to increase PermGen space. maybe the default settings is
too small for your case

On Thu, Mar 5, 2015 at 9:54 PM, Santoshakhilesh <santosh.akhilesh@huawei.com
> wrote:

>
>
>
>
> Regards,
> Santosh Akhilesh
> Bangalore R&D
> HUAWEI TECHNOLOGIES CO.,LTD.
>
> www.huawei.com
>
> -------------------------------------------------------------------------------------------------------------------------------------
> This e-mail and its attachments contain confidential information from
> HUAWEI, which
> is intended only for the person or entity whose address is listed above.
> Any use of the
> information contained herein in any way (including, but not limited to,
> total or partial
> disclosure, reproduction, or dissemination) by persons other than the
> intended
> recipient(s) is prohibited. If you receive this e-mail in error, please
> notify the sender by
> phone or email immediately and delete it!
> ________________________________
> From: Santoshakhilesh
> Sent: Thursday, March 05, 2015 7:08 PM
> To: dev@kylin.incubator.apache.org
> Cc: Kulbhushan Rana
> Subject: Kylin is being killed when trying to build the cube
>
>
> Hi All ,
>
>
>
>    I switched to 0.7 binary distribution , while building a small cube , I
> have a very small fact table around 1000 records and small dim tables.
> Running on 32 GB single node. 20G memory is free in my system.
>
>
>
>
>
>
>
> #
> # java.lang.OutOfMemoryError: PermGen space
> # -XX:OnOutOfMemoryError="kill -9 %p"
> #   Executing /bin/sh -c "kill -9 4788"...
> )
> [pool-4-thread-5]:[2015-03-06
> 03:01:34,485][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:d418a3d8-f360-488b-899a-f958b9354fbe-01 from RUNNING to SUCCEED
> [pool-4-thread-5]:[2015-03-06
> 03:01:34,503][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d418a3d8-f360-488b-899a-f958b9354fbe
> (Store kylin_metadata_qa@hbase<ma...@hbase>)
> [pool-4-thread-5]:[2015-03-06
> 03:01:34,511][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d418a3d8-f360-488b-899a-f958b9354fbe
> (Store kylin_metadata_qa@hbase<ma...@hbase>)
> [pool-4-thread-5]:[2015-03-06
> 03:01:34,513][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:d418a3d8-f360-488b-899a-f958b9354fbe from RUNNING to SUCCEED
>
>
>
> Regards,
> Santosh Akhilesh
> Bangalore R&D
> HUAWEI TECHNOLOGIES CO.,LTD.
>
> www.huawei.com
>
> -------------------------------------------------------------------------------------------------------------------------------------
> This e-mail and its attachments contain confidential information from
> HUAWEI, which
> is intended only for the person or entity whose address is listed above.
> Any use of the
> information contained herein in any way (including, but not limited to,
> total or partial
> disclosure, reproduction, or dissemination) by persons other than the
> intended
> recipient(s) is prohibited. If you receive this e-mail in error, please
> notify the sender by
> phone or email immediately and delete it!
>