You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2015/11/30 03:40:10 UTC

[jira] [Updated] (KYLIN-1178) Build dictionary out of job engine

     [ https://issues.apache.org/jira/browse/KYLIN-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shaofeng SHI updated KYLIN-1178:
--------------------------------
    Assignee: Shaofeng SHI  (was: ZhouQianhao)

> Build dictionary out of job engine
> ----------------------------------
>
>                 Key: KYLIN-1178
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1178
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Job Engine
>            Reporter: Shaofeng SHI
>            Assignee: Shaofeng SHI
>
> Kylin build dictionary in job engine node, usually this is okay. But if there is some high cardinality dimentions, the JVM heap couldn't fit in all distinct values, then job engine instance will crash with OOM error.
> Need to enhance on this, move the dictionary building to another process or a hadoop node.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)