You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by MrWell <hu...@foxmail.com> on 2019/11/22 08:24:27 UTC
回复: metastore clean OutOfMemoryError
Hi Mrac Wu,
Thanks, I have tried it, but it failed.
------------------ 原始邮件 ------------------
发件人: "Marc Wu -X (mawu2 - Insigma Hengtian at Cisco)"<mawu2@cisco.com>;
发送时间: 2019年11月22日(星期五) 下午3:16
收件人: "user@kylin.apache.org"<user@kylin.apache.org>;
主题: Re: metastore clean OutOfMemoryError
Hi MrWell,
You can try to create a file named setenv-tool.sh in the $KYLIN_HOME/conf directory, and put the following content in the file, then execute your command. It may solve your issues.
#!/bin/bash
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
export KYLIN_EXTRA_START_OPTS="-Xmx3072M"
From: MrWell <huangpeng_scut@foxmail.com>
Reply-To: "user@kylin.apache.org" <user@kylin.apache.org>
Date: Friday, November 22, 2019 at 15:01
To: user <user@kylin.apache.org>
Subject: metastore clean OutOfMemoryError
Hi, Kylin Team.
When I execute "bin/metastore.sh clean --delete true" , I get a "OutOfMemoryError" like this
java.lang.OutOfMemoryError: Java heap space
Dumping heap to java_pid4839.hprof ...
Heap dump file created [317991670 bytes in 2.120 secs]
#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError="kill -9 %p"
# Executing /bin/sh -c "kill -9 4839"...
bin/metastore.sh: line 109: 4839 Killed ${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.MetadataCleanupJob "${@:2}"
I have set 'setenv.sh' file, like this
export KYLIN_JVM_SETTINGS="-Xms16g -Xmx16g -XX:MaxPermSize=512m -XX:NewSize=3g -XX:MaxNewSize=3g -XX:SurvivorRatio=4 -XX:+CMSClassUnloadingEnabled -XX:+CMSParallelRemarkEnabled -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+DisableExplicitGC -XX:+HeapDumpOnOutOfMemoryError -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:$KYLIN_HOME/logs/kylin.gc.$$ -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M"
Dose it means heap memory is still small?
回复: 回复: metastore clean OutOfMemoryError
Posted by MrWell <hu...@foxmail.com>.
Thanks!!! it dose work!
------------------ 原始邮件 ------------------
发件人: "Marc Wu -X (mawu2 - Insigma Hengtian at Cisco)"<mawu2@cisco.com>;
发送时间: 2019年11月22日(星期五) 下午4:40
收件人: "user@kylin.apache.org"<user@kylin.apache.org>;
主题: Re: 回复: metastore clean OutOfMemoryError
Sorry for my mistake, can you move the setenv-tool.sh to the $KYLIN_HOME/bin and try again?
From: MrWell <huangpeng_scut@foxmail.com>
Reply-To: "user@kylin.apache.org" <user@kylin.apache.org>
Date: Friday, November 22, 2019 at 16:24
To: user <user@kylin.apache.org>
Subject: 回复: metastore clean OutOfMemoryError
Hi Mrac Wu,
Thanks, I have tried it, but it failed.
------------------ 原始邮件 ------------------
发件人: "Marc Wu -X (mawu2 - Insigma Hengtian at Cisco)"<mawu2@cisco.com>;
发送时间: 2019年11月22日(星期五) 下午3:16
收件人: "user@kylin.apache.org"<user@kylin.apache.org>;
主题: Re: metastore clean OutOfMemoryError
Hi MrWell,
You can try to create a file named setenv-tool.sh in the $KYLIN_HOME/conf directory, and put the following content in the file, then execute your command. It may solve your issues.
#!/bin/bash
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
export KYLIN_EXTRA_START_OPTS="-Xmx3072M"
From: MrWell <huangpeng_scut@foxmail.com>
Reply-To: "user@kylin.apache.org" <user@kylin.apache.org>
Date: Friday, November 22, 2019 at 15:01
To: user <user@kylin.apache.org>
Subject: metastore clean OutOfMemoryError
Hi, Kylin Team.
When I execute "bin/metastore.sh clean --delete true" , I get a "OutOfMemoryError" like this
java.lang.OutOfMemoryError: Java heap space
Dumping heap to java_pid4839.hprof ...
Heap dump file created [317991670 bytes in 2.120 secs]
#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError="kill -9 %p"
# Executing /bin/sh -c "kill -9 4839"...
bin/metastore.sh: line 109: 4839 Killed ${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.MetadataCleanupJob "${@:2}"
I have set 'setenv.sh' file, like this
export KYLIN_JVM_SETTINGS="-Xms16g -Xmx16g -XX:MaxPermSize=512m -XX:NewSize=3g -XX:MaxNewSize=3g -XX:SurvivorRatio=4 -XX:+CMSClassUnloadingEnabled -XX:+CMSParallelRemarkEnabled -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+DisableExplicitGC -XX:+HeapDumpOnOutOfMemoryError -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:$KYLIN_HOME/logs/kylin.gc.$$ -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M"
Dose it means heap memory is still small?
Re: 回复: metastore clean OutOfMemoryError
Posted by "Marc Wu -X (mawu2 - Insigma Hengtian at Cisco)" <ma...@cisco.com>.
Sorry for my mistake, can you move the setenv-tool.sh to the $KYLIN_HOME/bin and try again?
From: MrWell <hu...@foxmail.com>
Reply-To: "user@kylin.apache.org" <us...@kylin.apache.org>
Date: Friday, November 22, 2019 at 16:24
To: user <us...@kylin.apache.org>
Subject: 回复: metastore clean OutOfMemoryError
Hi Mrac Wu,
Thanks, I have tried it, but it failed.
------------------ 原始邮件 ------------------
发件人: "Marc Wu -X (mawu2 - Insigma Hengtian at Cisco)"<ma...@cisco.com>;
发送时间: 2019年11月22日(星期五) 下午3:16
收件人: "user@kylin.apache.org"<us...@kylin.apache.org>;
主题: Re: metastore clean OutOfMemoryError
Hi MrWell,
You can try to create a file named setenv-tool.sh in the $KYLIN_HOME/conf directory, and put the following content in the file, then execute your command. It may solve your issues.
#!/bin/bash
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
export KYLIN_EXTRA_START_OPTS="-Xmx3072M"
From: MrWell <hu...@foxmail.com>
Reply-To: "user@kylin.apache.org" <us...@kylin.apache.org>
Date: Friday, November 22, 2019 at 15:01
To: user <us...@kylin.apache.org>
Subject: metastore clean OutOfMemoryError
Hi, Kylin Team.
When I execute "bin/metastore.sh clean --delete true" , I get a "OutOfMemoryError" like this
java.lang.OutOfMemoryError: Java heap space
Dumping heap to java_pid4839.hprof ...
Heap dump file created [317991670 bytes in 2.120 secs]
#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError="kill -9 %p"
# Executing /bin/sh -c "kill -9 4839"...
bin/metastore.sh: line 109: 4839 Killed ${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.MetadataCleanupJob "${@:2}"
I have set 'setenv.sh' file, like this
export KYLIN_JVM_SETTINGS="-Xms16g -Xmx16g -XX:MaxPermSize=512m -XX:NewSize=3g -XX:MaxNewSize=3g -XX:SurvivorRatio=4 -XX:+CMSClassUnloadingEnabled -XX:+CMSParallelRemarkEnabled -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+DisableExplicitGC -XX:+HeapDumpOnOutOfMemoryError -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:$KYLIN_HOME/logs/kylin.gc.$$ -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M"
Dose it means heap memory is still small?