You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "Richard Calaba (JIRA)" <ji...@apache.org> on 2016/07/07 15:49:11 UTC

[jira] [Created] (KYLIN-1857) Show available memory on UI - in System Tab (and other runtime statistics)

Richard Calaba created KYLIN-1857:
-------------------------------------

             Summary: Show available memory on UI - in System Tab (and other runtime statistics)
                 Key: KYLIN-1857
                 URL: https://issues.apache.org/jira/browse/KYLIN-1857
             Project: Kylin
          Issue Type: Improvement
    Affects Versions: v1.5.2, v1.5.2.1
            Reporter: Richard Calaba
            Priority: Minor


I have run into situation that Kylin dies (exception in log says heap out of memory) if I try to run 3 parallel cubes with high-cardinality dimensions. It is reproduceable scenario. I have set max snapshot size to 2GB and -Xmx to 16GB. 

If I run the cube build one-by-one -> Kylin doesn't die. 

As we have have no idea about memory requirements before we start building the cube(s) then for now it would be beneficial at least to monitor basic Kylin VM statistics, i.e.:

 -- current memory occupied by snaphots
 -- total memory allocation & total free memory 
 -- how many (and which) temporary (intermediate) objects (in hive/hbase/filesystem) are created ... 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)