You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2015/11/30 03:39:10 UTC

[jira] [Created] (KYLIN-1178) Build dictionary out of job engine

Shaofeng SHI created KYLIN-1178:
-----------------------------------

             Summary: Build dictionary out of job engine
                 Key: KYLIN-1178
                 URL: https://issues.apache.org/jira/browse/KYLIN-1178
             Project: Kylin
          Issue Type: Improvement
          Components: Job Engine
            Reporter: Shaofeng SHI
            Assignee: ZhouQianhao


Kylin build dictionary in job engine node, usually this is okay. But if there is some high cardinality dimentions, the JVM heap couldn't fit in all distinct values, then job engine instance will crash with OOM error.

Need to enhance on this, move the dictionary building to another process or a hadoop node.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)