[jira] [Created] (IMPALA-13069) Consider not throwing errors during deleting staging files after insertion

["Yida Wu (Jira)" <ji...@apache.org>]

Yida Wu created IMPALA-13069:
--------------------------------

             Summary: Consider not throwing errors during deleting staging files after insertion
                 Key: IMPALA-13069
                 URL: https://issues.apache.org/jira/browse/IMPALA-13069
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
            Reporter: Yida Wu


When inserting data, we often use staging files in the cloud storage as temporary files. Once the insertion is done, we typically clear out these staging files. Currently, our approach involves deleting these files individually and raising errors if any deletion fails. However, at this stage, the insertion process is already complete, and there might be occasional instability with the cloud provider. It may be not optimal to fail a query for such errors during clearing temporary files. Perhaps worth considering a softer way to handle this case.
https://github.com/apache/impala/blob/7ad94006563b88d9221b4ac978dbf5b4fc0a3ca1/be/src/runtime/dml-exec-state.cc#L343



--
This message was sent by Atlassian Jira
(v8.20.10#820010)