回复： 回复： metastore clean OutOfMemoryError

[MrWell <hu...@foxmail.com>]

Thanks!!!  it dose work! 




------------------ 原始邮件 ------------------
发件人:&nbsp;"Marc Wu -X (mawu2 - Insigma Hengtian at Cisco)"<mawu2@cisco.com&gt;;
发送时间:&nbsp;2019年11月22日(星期五) 下午4:40
收件人:&nbsp;"user@kylin.apache.org"<user@kylin.apache.org&gt;;

主题:&nbsp;Re: 回复： metastore clean OutOfMemoryError



  
Sorry for my mistake, can you move the setenv-tool.sh to the $KYLIN_HOME/bin and try again?
 
&nbsp;
 
&nbsp;
  
From: MrWell <huangpeng_scut@foxmail.com&gt;
 Reply-To: "user@kylin.apache.org" <user@kylin.apache.org&gt;
 Date: Friday, November 22, 2019 at 16:24
 To: user <user@kylin.apache.org&gt;
 Subject: 回复： metastore clean OutOfMemoryError
 
  
&nbsp;
 
  
Hi Mrac Wu,
 
  
&nbsp;
 
  
Thanks, I have tried it, but it failed. 
 
   
&nbsp;
 
  
&nbsp;
 
  
------------------ 原始邮件&nbsp;------------------
 
   
发件人:&nbsp;"Marc Wu -X (mawu2 - Insigma Hengtian  at Cisco)"<mawu2@cisco.com&gt;;
 
  
发送时间:&nbsp;2019年11月22日(星期五) 下午3:16
 
  
收件人:&nbsp;"user@kylin.apache.org"<user@kylin.apache.org&gt;;
 
  
主题:&nbsp;Re: metastore clean OutOfMemoryError
 
 
  
&nbsp;
 
  
Hi MrWell, 
 
&nbsp;
 
You can try to create a file named setenv-tool.sh in the $KYLIN_HOME/conf directory, and put the following content in the file, then execute your command. It may solve your issues.
 
#!/bin/bash
 
#
 
# Licensed to the Apache Software Foundation (ASF) under one or more
 
# contributor license agreements.&nbsp; See the NOTICE file distributed with
 
# this work for additional information regarding copyright ownership.
 
# The ASF licenses this file to You under the Apache License, Version 2.0
 
# (the "License"); you may not use this file except in compliance with
 
# the License.&nbsp; You may obtain a copy of the License at
 
#
 
#&nbsp; &nbsp; http://www.apache.org/licenses/LICENSE-2.0
 
#
 
# Unless required by applicable law or agreed to in writing, software
 
# distributed under the License is distributed on an "AS IS" BASIS,
 
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 
# See the License for the specific language governing permissions and
 
# limitations under the License.
 
# 
 
export KYLIN_EXTRA_START_OPTS="-Xmx3072M"
 
&nbsp;
 
&nbsp;
  
From: MrWell <huangpeng_scut@foxmail.com&gt;
 Reply-To: "user@kylin.apache.org" <user@kylin.apache.org&gt;
 Date: Friday, November 22, 2019 at 15:01
 To: user <user@kylin.apache.org&gt;
 Subject: metastore clean OutOfMemoryError
 
  
&nbsp;
 
  
Hi, Kylin Team. 
  
&nbsp;
 
  
When I execute "bin/metastore.sh clean --delete true" , I get a "OutOfMemoryError" like this
 
  
&nbsp;
 
 
&nbsp;
   
java.lang.OutOfMemoryError: Java heap space
 
  
Dumping heap to java_pid4839.hprof ...
 
  
Heap dump file created [317991670 bytes in 2.120 secs]
 
  
#
 
  
# java.lang.OutOfMemoryError: Java heap space
 
  
# -XX:OnOutOfMemoryError="kill -9 %p"
 
  
#&nbsp; &nbsp;Executing /bin/sh -c "kill -9 4839"...
 
  
bin/metastore.sh: line 109:&nbsp; 4839 Killed&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; ${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.MetadataCleanupJob "${@:2}"
 
 
  
&nbsp;
 
  
&nbsp;
 
  
I have set 'setenv.sh' file, like this
 
  
&nbsp;
 
  
export KYLIN_JVM_SETTINGS="-Xms16g -Xmx16g -XX:MaxPermSize=512m -XX:NewSize=3g -XX:MaxNewSize=3g -XX:SurvivorRatio=4 -XX:+CMSClassUnloadingEnabled -XX:+CMSParallelRemarkEnabled  -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -XX:CMSInitiatingOccupancyFraction=70 -XX:+UseCMSInitiatingOccupancyOnly -XX:+DisableExplicitGC -XX:+HeapDumpOnOutOfMemoryError -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:$KYLIN_HOME/logs/kylin.gc.$$  -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M"
 
  
&nbsp;
 
  
Dose it means heap memory is still small?