You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Anant Mittal (Jira)" <ji...@apache.org> on 2019/10/21 18:20:00 UTC
[jira] [Updated] (HIVE-18922) Hive is not cleaning up staging
directories
[ https://issues.apache.org/jira/browse/HIVE-18922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anant Mittal updated HIVE-18922:
--------------------------------
Description:
Hive is creating hdfs folders with format <table_location>/.hive-staging_hive_<date>_<time>-xx/-ext-xxxxx
These are not being cleaned up even after long duration. The folder is used to load to the table. Example:
Loading data to table default.tablename from hdfs://clustermachine/apps/hive/warehouse/tablename/.hive-staging_hive_2018-01-31_11-45-14_005_1129336997995057804-51/-ext-10000
This might be covered to some extent by HIVE-11940 but, want to make sure all cases are addressed.
Update: It seems HIVE-11940 did not cover this as the issue is seen in later versions too.
was:
Hive is creating hdfs folders with format <table_location>/.hive-staging_hive_<date>_<time>-xx/-ext-xxxxx
These are not being cleaned up even after long duration. The folder is used to load to the table. Example:
Loading data to table default.tablename from hdfs://clustermachine/apps/hive/warehouse/tablename/.hive-staging_hive_2018-01-31_11-45-14_005_1129336997995057804-51/-ext-10000
This might be covered to some extent by HIVE-11940 but, want to make sure all cases are addressed.
> Hive is not cleaning up staging directories
> --------------------------------------------
>
> Key: HIVE-18922
> URL: https://issues.apache.org/jira/browse/HIVE-18922
> Project: Hive
> Issue Type: Bug
> Reporter: Anant Mittal
> Priority: Major
>
> Hive is creating hdfs folders with format <table_location>/.hive-staging_hive_<date>_<time>-xx/-ext-xxxxx
> These are not being cleaned up even after long duration. The folder is used to load to the table. Example:
> Loading data to table default.tablename from hdfs://clustermachine/apps/hive/warehouse/tablename/.hive-staging_hive_2018-01-31_11-45-14_005_1129336997995057804-51/-ext-10000
>
> This might be covered to some extent by HIVE-11940 but, want to make sure all cases are addressed.
> Update: It seems HIVE-11940 did not cover this as the issue is seen in later versions too.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)