You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Matt McCline (Jira)" <ji...@apache.org> on 2021/08/24 17:39:00 UTC
[jira] [Created] (HIVE-25478) Temp file left over after ANALYZE
TABLE .. COMPUTE STATISTICS FOR COLUMNS
Matt McCline created HIVE-25478:
-----------------------------------
Summary: Temp file left over after ANALYZE TABLE .. COMPUTE STATISTICS FOR COLUMNS
Key: HIVE-25478
URL: https://issues.apache.org/jira/browse/HIVE-25478
Project: Hive
Issue Type: Bug
Affects Versions: 3.1.0
Reporter: Matt McCline
Assignee: Matt McCline
The dot staging file (".hive-staging") file is not removed at the end of the ANALYZE TABLE .. COMPUTE STATISTICS FOR COLUMNS operation as it is for say an INSERT that does automatic statistics collection. I expected it would be deleted after the Stats Work stage.
Any ideas where in the code to add automatic deletion (hook)?
hdfs dfs -ls <omitted>/hive/warehouse/managed/table_orc
Found 2 items
drwxr-xr-x - hive supergroup 0 2021-08-24 17:19 <omitted>/hive/warehouse/managed/table_orc/.hive-staging_hive_2021-08-24_17-19-17_228_4856027533912221506-7
drwxr-xr-x - hive supergroup 0 2021-08-24 07:17 <omitted>/hive/warehouse/managed/table_orc/delta_0000001_0000001_0000
--
This message was sent by Atlassian Jira
(v8.3.4#803005)