You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "nichunen (JIRA)" <ji...@apache.org> on 2019/07/29 02:35:00 UTC
[jira] [Closed] (KYLIN-4002) Cleanup job does not delete Hive
intermediate VIEW tables
[ https://issues.apache.org/jira/browse/KYLIN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
nichunen closed KYLIN-4002.
---------------------------
Resolution: Fixed
> Cleanup job does not delete Hive intermediate VIEW tables
> ----------------------------------------------------------
>
> Key: KYLIN-4002
> URL: https://issues.apache.org/jira/browse/KYLIN-4002
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine
> Affects Versions: v2.6.1
> Reporter: Iñigo Martinez
> Priority: Minor
>
> Kylin org.apache.kylin.tool.StorageCleanupJob does not delete hive intermediate tables if they are view based.
> After several weeks running Kylin 2.6.1 after a successful upgrade from 2.4.1, we have a lot of temporary tables that have not been deleted. All of them come from a VIEW.
> However, those tables built directly from a table and not from a view, are properly deleted.
> Tables from view not deleted: 263079
> Tables not form view not deleted: 0
>
> At log level, we can see:
> {code:java}
> 2019-05-14 08:10:00,293 DEBUG [main] job.StorageCleanupJob:326 : Checking if table is garbage -- kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986
> 2019-05-14 10:17:53,235 INFO [main] job.StorageCleanupJob:407 : Deleting Hive table kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986
> drop table if exists kylin_intermediate_dw_di_paises_view_238e3004_13e8_2be6_5f0e_df545b481986;{code}
> So, it's properly detected and drop sentence properly created. But it's not executed and table is still there.
> We have launched the 263079 drop sentences via script and all are being removed.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)