[jira] [Updated] (KYLIN-978) GarbageCollectionStep dropped Hive Intermediate Table but didn't drop external hdfs path

["Yerui Sun (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KYLIN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yerui Sun updated KYLIN-978:
----------------------------
    Attachment: KYLIN-978-1.x-staging-v2.patch

Patch for 1.x branch posted.

This patch based on KYLIN-968, should be merged after KYLIN-968 patch merged.

I'll post the patch for 0.8/2.x branch next week.

> GarbageCollectionStep dropped Hive Intermediate Table but didn't drop external hdfs path
> ----------------------------------------------------------------------------------------
>
>                 Key: KYLIN-978
>                 URL: https://issues.apache.org/jira/browse/KYLIN-978
>             Project: Kylin
>          Issue Type: Bug
>          Components: Job Engine
>    Affects Versions: v0.7.2
>            Reporter: Yerui Sun
>            Assignee: Shaofeng SHI
>         Attachments: KYLIN-978-1.x-staging-v2.patch
>
>
> In GarbageCollectionStep, the hive intermediate table created in step 1 was dropped. 
> As the table is external table, data was stored in a external hdfs path, like '.../kylin-$\{jobId\}/kylin_intermediate_...', which didn't deleted when drop hive table.
> Considering the purpose of GarbageCollectionStep, the external data path should also be deleted.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)