You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Yaqian Zhang (Jira)" <ji...@apache.org> on 2019/09/16 11:46:00 UTC

[jira] [Comment Edited] (KYLIN-4121) Cleanup hive view intermediate tables after job be finished

    [ https://issues.apache.org/jira/browse/KYLIN-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16930447#comment-16930447 ] 

Yaqian Zhang edited comment on KYLIN-4121 at 9/16/19 11:45 AM:
---------------------------------------------------------------

Verified.

Test Evidence:

1、Use hive view table:fact table KYLIN_SALES_VIEW and lokkup table KYLIN_CAL_DT_VIEW create model and build cube.Two intermediate tables were generated during the construction process.

!image-2019-09-16-19-18-59-663.png|width=483,height=460!

2、The intermediate table is deleted after the build is completed.

!image-2019-09-16-19-26-31-446.png|width=434,height=579!


was (Author: zhangyaqian):
Verified.

Test Evidence:

1、Use hive view table:fact table KYLIN_SALES_VIEW and lokkup table KYLIN_CAL_DT_VIEW create model and build cube.Two intermediate tables were generated during the construction process.

!image-2019-09-16-19-18-59-663.png!

2、The intermediate table is deleted after the build is completed.

!image-2019-09-16-19-26-31-446.png!

> Cleanup hive view intermediate tables after job be finished
> -----------------------------------------------------------
>
>                 Key: KYLIN-4121
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4121
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Job Engine
>            Reporter: Shaofeng SHI
>            Assignee: wangrupeng
>            Priority: Major
>             Fix For: v3.0.0-beta
>
>         Attachments: image-2019-09-16-19-18-59-663.png, image-2019-09-16-19-26-31-446.png
>
>
> Reported by community user:
> I have a cube with a fact table join a lookup table  in hive, and both are hive view. I submit a job one time per hour.
>  
> Kylin can drop the intermediate fact table , but doesn't drop the intermediate lookup table .
>  
> I check the source code , and find out that , at '13 step: Hive Cleanup' ,  the source code has been commented.
>  
>  
> It is a legacy issue. Now KYLIN-3515 has fixed that, so the cleanup can be enabled.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)