You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2017/11/30 13:57:00 UTC
[jira] [Commented] (KYLIN-3066) cleanup job's intermediate hdfs
file belong to very old segment
[ https://issues.apache.org/jira/browse/KYLIN-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272691#comment-16272691 ]
Shaofeng SHI commented on KYLIN-3066:
-------------------------------------
+1
The top level segments (like yearly) won't be merged, keeping the cuboid files on HDFS is wasteful.
> cleanup job's intermediate hdfs file belong to very old segment
> ---------------------------------------------------------------
>
> Key: KYLIN-3066
> URL: https://issues.apache.org/jira/browse/KYLIN-3066
> Project: Kylin
> Issue Type: Improvement
> Reporter: Yang Hao
>
> Currently, the job intermediate file won't be deleted if it belongs to a segment which is 1 year ago . It is very waste. We should supply a config to define old seg and which cannot be merged , so the old seg can be deleted
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)