You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Matt McCline (Jira)" <ji...@apache.org> on 2021/08/24 17:39:00 UTC

[jira] [Created] (HIVE-25478) Temp file left over after ANALYZE TABLE .. COMPUTE STATISTICS FOR COLUMNS

Matt McCline created HIVE-25478:
-----------------------------------

             Summary: Temp file left over after ANALYZE TABLE .. COMPUTE STATISTICS FOR COLUMNS
                 Key: HIVE-25478
                 URL: https://issues.apache.org/jira/browse/HIVE-25478
             Project: Hive
          Issue Type: Bug
    Affects Versions: 3.1.0
            Reporter: Matt McCline
            Assignee: Matt McCline


The dot staging file (".hive-staging") file is not removed at the end of the ANALYZE TABLE .. COMPUTE STATISTICS FOR COLUMNS operation as it is for say an INSERT that does automatic statistics collection. I expected it would be deleted after the Stats Work stage.

Any ideas where in the code to add automatic deletion (hook)?

hdfs dfs -ls <omitted>/hive/warehouse/managed/table_orc
Found 2 items
drwxr-xr-x   - hive supergroup          0 2021-08-24 17:19 <omitted>/hive/warehouse/managed/table_orc/.hive-staging_hive_2021-08-24_17-19-17_228_4856027533912221506-7
drwxr-xr-x   - hive supergroup          0 2021-08-24 07:17 <omitted>/hive/warehouse/managed/table_orc/delta_0000001_0000001_0000



--
This message was sent by Atlassian Jira
(v8.3.4#803005)