You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Yida Wu (Jira)" <ji...@apache.org> on 2025/02/26 01:21:00 UTC

[jira] [Created] (IMPALA-13798) Cleanup of host-level remote scratch dir on exit

Yida Wu created IMPALA-13798:
--------------------------------

             Summary: Cleanup of host-level remote scratch dir on exit
                 Key: IMPALA-13798
                 URL: https://issues.apache.org/jira/browse/IMPALA-13798
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 4.5.0
            Reporter: Yida Wu
            Assignee: Yida Wu


IMPALA-13677 introduces a way to clean up remote scratch files on startup, ensuring that leftover files from abnormal shutdowns are removed. It also introduces a host-level directory to do easier cleanup.

An empty host-level directory in remote storage does not use resources, but it can stay there forever if a host goes offline permanently. To improve this, this task is to remove the remote host-level temporary directory on shutdown after the shutdown deadline. This helps prevent too many empty directories left in the remote scratch path, especially for hosts that never restart.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)