You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "QiangZhang (Jira)" <ji...@apache.org> on 2020/07/28 02:15:00 UTC

[jira] [Commented] (KYLIN-4668) outOfMemery,/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete true

    [ https://issues.apache.org/jira/browse/KYLIN-4668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17166081#comment-17166081 ] 

QiangZhang commented on KYLIN-4668:
-----------------------------------

You can use a tool to analyze the dump file and locate the code that generated the OOM。

I guess hbase caused the OOM,you can try setting "hbase-env.sh " to scale up JVM memory,such as:

export HBASE_OPTS="-Xmx268435456 -XX:+HeapDumpOnOutOfMemoryError -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -Djava.net.preferIPv4Stack=true $HBASE_OPTS"

> outOfMemery,/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete true
> -------------------------------------------------------------------------------
>
>                 Key: KYLIN-4668
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4668
>             Project: Kylin
>          Issue Type: Bug
>          Components: Others
>    Affects Versions: v2.1.0
>            Reporter: shiyu
>            Priority: Critical
>
> when do
>  {{${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete true}}
> {{}}
> 2020-07-28 09:28:00,520 DEBUG [main] cachesync.CachedCrudAssist:118 : Reloading ExecutablePO from KYLIN_STORAGE:kylin_metadata(key='/execute')@KYLIN_STORAGE:kylin_metadata@hbase
> 2020-07-28 09:29:00,027 INFO [ReadOnlyZKClient-bd201:2181,bd200:2181,bd197:2181,bd198:2181,bd199:2181@0x18025ced] zookeeper.ZooKeeper:693 : Session: 0x5734835e9cb26ea closed
> 2020-07-28 09:29:00,028 INFO [ReadOnlyZKClient-bd201:2181,bd200:2181,bd197:2181,bd198:2181,bd199:2181@0x18025ced-EventThread] zookeeper.ClientCnxn:505 : EventThread shut down
> 2020-07-28 09:33:59,725 DEBUG [main] cachesync.CachedCrudAssist:127 : Loaded 138601 ExecutablePO(s) out of 138601 resource
> 2020-07-28 09:33:59,726 DEBUG [main] dao.ExecutableDao:125 : Reloading execute_output from /execute_output
> java.lang.OutOfMemoryError: Java heap space
> Dumping heap to java_pid28268.hprof ...
> Heap dump file created [330938638 bytes in 2.292 secs]
> #
> # java.lang.OutOfMemoryError: Java heap space
> # -XX:OnOutOfMemoryError="kill -9 %p"
> # Executing /bin/sh -c "kill -9 28268"...{{}}
> {{}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)