You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "Liu Shaohui (JIRA)" <ji...@apache.org> on 2019/03/27 09:09:00 UTC
[jira] [Created] (KYLIN-3917) Add max segment merge span to cleanup
intermediate data of cube building
Liu Shaohui created KYLIN-3917:
----------------------------------
Summary: Add max segment merge span to cleanup intermediate data of cube building
Key: KYLIN-3917
URL: https://issues.apache.org/jira/browse/KYLIN-3917
Project: Kylin
Issue Type: Improvement
Reporter: Liu Shaohui
Currently the intermediate data of building cube can not be deleted for it maybe used for later cubing merging. But it result in double space used in HDFS.
In actual scenario, we only need month-level segment span in maximum.
So if a span of segment is larger than a month, we think it don't need be merged and the intermediate data can be deleted.
So we can add a config kylin.cube.max-segment-merge.span, default is -1.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)