You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Jie Tao (JIRA)" <ji...@apache.org> on 2016/06/22 14:24:58 UTC

[jira] [Updated] (KYLIN-1813) intermediate table in Hive not cleaned up

     [ https://issues.apache.org/jira/browse/KYLIN-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jie Tao updated KYLIN-1813:
---------------------------
    Description: 
after the cube building with ERROR I discarded the cube, but the cube is not marked as discarded like other jobs that I discarded during the cube building was running (see job.png: the job is not black colour marked but has only one choice "diagnose"). Hence, as I manually clean up intermediate data, I got info like: 

Remove intermediate hive table with job id 493fd20b-3074-403e-9963-fe4fb7ff7c65 with job status ERROR
2016-06-17 09:37:12,648 INFO  [main StorageCleanupJob:262]: Remove
intermediate hive table with job id 8a377e30-e3ba-4fe2-be12-e7d412afec5ewith job status ERROR

In this case the intermediate tables were not removed from hive (see hive.png). In addition, in my Hive other intermediate tables exist that can not be cleaned up. I feel taht one intermediate table was kept in Hive for each cube building. Not sure if they are still usefull. The json is also attached json.txt

  was:
after the cube building with ERROR I discarded the cube, but the cube is not marked as discarded like other jobs that I discarded during the cube building wa srunning (see job.png: the job is not black colour marked but has only one choice "diagnose"). Hence, as I manually clean up intermediate data, I got info like: 

Remove intermediate hive table with job id 493fd20b-3074-403e-9963-fe4fb7ff7c65 with job status ERROR
2016-06-17 09:37:12,648 INFO  [main StorageCleanupJob:262]: Remove
intermediate hive table with job id 8a377e30-e3ba-4fe2-be12-e7d412afec5ewith job status ERROR

In this case the intermediate tables were not removed from hive (see hive.png). The json is also attached json.txt


> intermediate table in Hive not cleaned up
> -----------------------------------------
>
>                 Key: KYLIN-1813
>                 URL: https://issues.apache.org/jira/browse/KYLIN-1813
>             Project: Kylin
>          Issue Type: Bug
>          Components: General
>    Affects Versions: v1.5.2
>         Environment: linux
>            Reporter: Jie Tao
>            Priority: Minor
>
> after the cube building with ERROR I discarded the cube, but the cube is not marked as discarded like other jobs that I discarded during the cube building was running (see job.png: the job is not black colour marked but has only one choice "diagnose"). Hence, as I manually clean up intermediate data, I got info like: 
> Remove intermediate hive table with job id 493fd20b-3074-403e-9963-fe4fb7ff7c65 with job status ERROR
> 2016-06-17 09:37:12,648 INFO  [main StorageCleanupJob:262]: Remove
> intermediate hive table with job id 8a377e30-e3ba-4fe2-be12-e7d412afec5ewith job status ERROR
> In this case the intermediate tables were not removed from hive (see hive.png). In addition, in my Hive other intermediate tables exist that can not be cleaned up. I feel taht one intermediate table was kept in Hive for each cube building. Not sure if they are still usefull. The json is also attached json.txt



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)