You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "Liu Shaohui (JIRA)" <ji...@apache.org> on 2019/03/27 09:09:00 UTC

[jira] [Created] (KYLIN-3917) Add max segment merge span to cleanup intermediate data of cube building

Liu Shaohui created KYLIN-3917:
----------------------------------

             Summary: Add max segment merge span to cleanup intermediate data of cube building 
                 Key: KYLIN-3917
                 URL: https://issues.apache.org/jira/browse/KYLIN-3917
             Project: Kylin
          Issue Type: Improvement
            Reporter: Liu Shaohui


Currently the intermediate data of building cube can not be deleted for it maybe used for later cubing merging. But it result in double space used in HDFS.

In actual scenario, we only need month-level segment span in maximum.

So if a span of segment is larger than a month, we think it don't need be merged and the intermediate data can be deleted.

So we can add a config kylin.cube.max-segment-merge.span,  default is -1.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)