You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 我是天才 <50...@qq.com> on 2020/05/07 01:47:05 UTC
回复:erros on building cube in kylin
if i want to add "kylin.engine.mr.config-override" in the front of them.
MY config below as:
kylin_job_conf.xml
<property>
<name>mapreduce.map.java.opts.max.heap</name>
<value>204800</value>
</property>
<property>
<name>mapreduce.reduce.java.opts.max.heap</name>
<value>204800</value>
</property>
<property>
<name>mapreduce.map.java.opts</name>
<value>-Xmx8000m -XX:OnOutOfMemoryError='kill -9 %p'</value>
<description></description>
</property>
<property>
<name>mapreduce.reduce.java.opts</name>
<value>-Xmx8000m -XX:OnOutOfMemoryError='kill -9 %p'</value>
<description></description>
</property>
<property>
<name>mapred.child.java.opt</name>
<value>-Xmx8000m -XX:OnOutOfMemoryError='kill -9 %p'</value>
<description></description>
kylin_job_conf_inmem.xml
<property>
<name>mapreduce.map.memory.mb</name>
<value>8192</value>
<description></description>
</property>
<property>
<name>mapreduce.map.java.opts</name>
<value>-Xmx12g -XX:OnOutOfMemoryError='kill -9 %p'</value>
<description></description>
</property>
<property>
<name>mapreduce.task.io.sort.mb</name>
<value>20</value>
<description></description>
</property>
------------------ 原始邮件 ------------------
发件人: "Xiaoxiang Yu"<xxyu@apache.org>;
发送时间: 2020年5月6日(星期三) 晚上7:57
收件人: "user"<user@kylin.apache.org>;"我是天才"<50308969@qq.com>;
主题: Re:erros on building cube in kylin
Hi,
Have you ever check this doc : http://kylin.apache.org/docs/install/configuration.html#mr-config-override and increase the heap of Mapper or Reducer?
--
Best wishes to you !
From :Xiaoxiang Yu
At 2020-05-06 19:45:43, "我是天才" <50308969@qq.com> wrote:
Hello:
I have a table and it has three columns,it has 5736604 rows,the three columns distinct value counts is 1843696 5736485 1742356.I build cube and got a error on 3rd step,it said:"Error: Java heap space",the step name is " Extract Fact Table Distinct Columns".
Can you help me? thanks!