You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by Fei Yi <yi...@gmail.com> on 2017/12/04 03:14:54 UTC

run metastore.sh clean --delete true oom

Hi,
Some days I did not cleanup the metadata,when i run metastore.sh clean
--delete true  shows the following error,i set jvm param -Xmx=32g

2017-12-04 10:25:08,506 INFO  [main] cube.CubeManager:795 : Loaded 18
cubes, fail on 0 cubes
2017-12-04 10:26:19,921 INFO  [main] dao.ExecutableDao:75 : Using metadata
url: kylin_metadata@hbase
java.lang.OutOfMemoryError: Java heap space
Dumping heap to java_pid95910.hprof ...
Heap dump file created [561523635 bytes in 2.433 secs]
#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError="kill -9 %p"
#   Executing /bin/sh -c "kill -9 95910"...
/app/apache-kylin-2.1.0-bin-cdh57/bin/metastore.sh: line 109: 95910 Killed
                ${KYLIN_HOME}/bin/kylin.sh
org.apache.kylin.tool.MetadataCleanupJob
"${@:2}"

Re: run metastore.sh clean --delete true oom

Posted by Fei Yi <yi...@gmail.com>.
Thank you Ge Silas ,your solution solved my problem.

2017-12-04 12:35 GMT+08:00 Ge Silas <go...@live.cn>:

> Hi Fei,
>
> Maybe you can try the below solution -
>
> create file {KYLIN_HOME}/bin/setenv-tool.sh
> add export KYLIN_EXTRA_START_OPTS="-Xmx1024M" to file
> {KYLIN_HOME}/bin/setenv-tool.sh
> rerun command bin/metastore.sh clean
>
> Thanks,
> Silas
>
> > On 4 Dec 2017, at 11:14 AM, Fei Yi <yi...@gmail.com> wrote:
> >
> > Hi,
> > Some days I did not cleanup the metadata,when i run metastore.sh clean
> --delete true  shows the following error,i set jvm param -Xmx=32g
> >
> > 2017-12-04 10:25:08,506 INFO  [main] cube.CubeManager:795 : Loaded 18
> cubes, fail on 0 cubes
> > 2017-12-04 10:26:19,921 INFO  [main] dao.ExecutableDao:75 : Using
> metadata url: kylin_metadata@hbase
> > java.lang.OutOfMemoryError: Java heap space
> > Dumping heap to java_pid95910.hprof ...
> > Heap dump file created [561523635 bytes in 2.433 secs]
> > #
> > # java.lang.OutOfMemoryError: Java heap space
> > # -XX:OnOutOfMemoryError="kill -9 %p"
> > #   Executing /bin/sh -c "kill -9 95910"...
> > /app/apache-kylin-2.1.0-bin-cdh57/bin/metastore.sh: line 109: 95910
> Killed                  ${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.MetadataCleanupJob
> "${@:2}"
> >
> >
> >
> >
>
>

Re: run metastore.sh clean --delete true oom

Posted by Ge Silas <go...@live.cn>.
Hi Fei,

Maybe you can try the below solution -

create file {KYLIN_HOME}/bin/setenv-tool.sh
add export KYLIN_EXTRA_START_OPTS="-Xmx1024M" to file {KYLIN_HOME}/bin/setenv-tool.sh
rerun command bin/metastore.sh clean

Thanks,
Silas

> On 4 Dec 2017, at 11:14 AM, Fei Yi <yi...@gmail.com> wrote:
> 
> Hi,
> Some days I did not cleanup the metadata,when i run metastore.sh clean --delete true  shows the following error,i set jvm param -Xmx=32g
> 
> 2017-12-04 10:25:08,506 INFO  [main] cube.CubeManager:795 : Loaded 18 cubes, fail on 0 cubes
> 2017-12-04 10:26:19,921 INFO  [main] dao.ExecutableDao:75 : Using metadata url: kylin_metadata@hbase
> java.lang.OutOfMemoryError: Java heap space
> Dumping heap to java_pid95910.hprof ...
> Heap dump file created [561523635 bytes in 2.433 secs]
> #
> # java.lang.OutOfMemoryError: Java heap space
> # -XX:OnOutOfMemoryError="kill -9 %p"
> #   Executing /bin/sh -c "kill -9 95910"...
> /app/apache-kylin-2.1.0-bin-cdh57/bin/metastore.sh: line 109: 95910 Killed                  ${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.MetadataCleanupJob "${@:2}"
> 
> 
> 
>