You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2017/09/28 05:51:00 UTC

[jira] [Created] (KYLIN-2912) Remove "hfile" folder after bulk load to HBase

Shaofeng SHI created KYLIN-2912:
-----------------------------------

             Summary: Remove "hfile" folder after bulk load to HBase
                 Key: KYLIN-2912
                 URL: https://issues.apache.org/jira/browse/KYLIN-2912
             Project: Kylin
          Issue Type: Improvement
          Components: Job Engine
            Reporter: Shaofeng SHI
            Assignee: Dong Li


Kylin generates HFile with MR, and then bulk load to HBase, which is a mv operation. But if blob storage like S3 is used, the old HFile won't be deleted.

Suggestion: automatically removes the hfile sub folder of that job in the garbage collection step. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)