You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by ｜明の <13...@qq.com> on 2019/01/21 03:32:38 UTC

2.6.0 Build cube failed by #4 Build Dimension Dictionary

Hi all~
The reason for using the new version is the need to complete the construction of high cardinal global dictionary.
But it was doesn't work.




data: [numFiles=6, numRows=5835351, totalSize=118588431, rawDataSize=448219626]


two count(disinct) column cardinality




kylin.log





gc.log



#4 Step Name: Build Dimension Dictionary





My env:

    kylin 2.6.0


config:
kylin.engine.spark.rdd-partition-cut-mb = 32
kylin.storage.hbase.region-cut-gb = 1


jvm:
export KYLIN_JVM_SETTINGS="-Xms10240M -Xmx20480M -Xss1024K -XX:MaxPermSize=512M -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:$KYLIN_HOME/logs/kylin.gc.$$ -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M"








Aron-Chung

答复: 2.6.0 Build cube failed by #4 Build Dimension Dictionary

Posted by Na Zhai <na...@kyligence.io>.
Hi, ｜明の.
       I can not see your pic, you can try to add this in the attachment.
       Best wishes!

发送自 Windows 10 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>应用

________________________________
发件人: ｜明の <13...@qq.com>
发送时间: Monday, January 21, 2019 11:32:38 AM
收件人: dev
主题: 2.6.0 Build cube failed by #4 Build Dimension Dictionary

Hi all~
The reason for using the new version is the need to complete the construction of high cardinal global dictionary.
But it was doesn't work.


data: [numFiles=6, numRows=5835351, totalSize=118588431, rawDataSize=448219626]

two count(disinct) column cardinality
[cid:5762EBCD@9699A634.563D455C]
[cid:7E8A1645@0E723654.563D455C]

kylin.log
[cid:F24120F8@21E73540.563D455C]


gc.log
[cid:B25FE6C2@054B8E1D.563D455C]

#4 Step Name: Build Dimension Dictionary
[cid:268D4D51@2744944E.563D455C]


My env:
 kylin 2.6.0

config:
kylin.engine.spark.rdd-partition-cut-mb = 32
kylin.storage.hbase.region-cut-gb = 1

jvm:
export KYLIN_JVM_SETTINGS="-Xms10240M -Xmx20480M -Xss1024K -XX:MaxPermSize=512M -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:$KYLIN_HOME/logs/kylin.gc.$$ -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M"




Aron-Chung