[jira] [Updated] (KYLIN-1847) Cleanup of Intermediate tables not working well

["Richard Calaba (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KYLIN-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Richard Calaba updated KYLIN-1847:
----------------------------------
    Description: 
I have realized that Hive tables kylin_intermediate_<cubename>_<snapshotdates> after cancelling all pending build jobs and dropping the cube are not cleaned properly. 

It could be that I didn't execute Purge before Dropping the cube ... just a theory, not 100% sure.

I also suspect that on hdfs in the /kylin/kylin_metadata/ directory I have too many uncleaned data ... considering that I have just now only 1 cube having a pending build job I see too many subdirectories there ...

There might be some relation to he JIRA I already reported as well ... https://issues.apache.org/jira/browse/KYLIN-1828 - but again not 100% sure this is the sole reason.

My impression is that the cleanup logic after the Drop cube needs to be re-checked.

  was:
I have realized that Hive tables kylin_intermediate_<cubename>_<snapshotdates> after cancelling all pending build jobs and dropping the cube are no cleaned properly. 

It could be that I didn't execute Purge befor Dropping the cube ... just a theory, not 100% sure.

I also suspect that on hdfs in the /kylin/kylin_metadata/ directory I have too many uncleaned data ... considering that I have just now only 1 cube wih pending build job I see too many subdirectories there ...

There might be some relation to he JIRA I already reported as well ... https://issues.apache.org/jira/browse/KYLIN-1828 - but again not 100% sure this is the sole reason.

My impression is that the cleanup logic after the Drop cube needs to be re-checked.


> Cleanup of Intermediate tables not working well
> -----------------------------------------------
>
>                 Key: KYLIN-1847
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1847
>             Project: Kylin
>          Issue Type: Bug
>    Affects Versions: v1.5.2, v1.5.2.1
>            Reporter: Richard Calaba
>
> I have realized that Hive tables kylin_intermediate_<cubename>_<snapshotdates> after cancelling all pending build jobs and dropping the cube are not cleaned properly. 
> It could be that I didn't execute Purge before Dropping the cube ... just a theory, not 100% sure.
> I also suspect that on hdfs in the /kylin/kylin_metadata/ directory I have too many uncleaned data ... considering that I have just now only 1 cube having a pending build job I see too many subdirectories there ...
> There might be some relation to he JIRA I already reported as well ... https://issues.apache.org/jira/browse/KYLIN-1828 - but again not 100% sure this is the sole reason.
> My impression is that the cleanup logic after the Drop cube needs to be re-checked.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)