You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "Dayue Gao (JIRA)" <ji...@apache.org> on 2017/02/08 07:45:42 UTC

[jira] [Created] (KYLIN-2436) add a configuration knob to disable spilling of aggregation cache

Dayue Gao created KYLIN-2436:
--------------------------------

             Summary: add a configuration knob to disable spilling of aggregation cache
                 Key: KYLIN-2436
                 URL: https://issues.apache.org/jira/browse/KYLIN-2436
             Project: Kylin
          Issue Type: Improvement
          Components: Storage - HBase
    Affects Versions: v1.6.0
            Reporter: Dayue Gao
            Assignee: Dayue Gao


Kylin's aggregation operator can spill intermediate results to disk when its estimated memory usage exceeds some threshold (kylin.query.coprocessor.mem.gb to be specific). While it's a useful feature in general to prevent RegionServer from OOM, there are times when aborting this kind of memory-hungry query immediately is a more suitable choice to users.

To accommodate this requirement, I suggest adding a new configuration named "kylin.storage.hbase.coprocessor-spill-enabled". The default value would be true, which will keep the same behavior as before. If changed to false, query that uses more aggregation memory than threshold will fail immediately.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)