[jira] [Created] (IMPALA-15409) Fix file paths in OPTIMIZE and deprecate ContentFile.path()

["Noémi Pap-Takács (Jira)" <ji...@apache.org>]

Noémi Pap-Takács created IMPALA-15409:
-----------------------------------------

             Summary: Fix file paths in OPTIMIZE and deprecate ContentFile.path()
                 Key: IMPALA-15409
                 URL: https://issues.apache.org/jira/browse/IMPALA-15409
             Project: IMPALA
          Issue Type: Bug
            Reporter: Noémi Pap-Takács
            Assignee: Noémi Pap-Takács


OptimizeStmt with file filtering sends the paths of the selected data files to the catalog, which matches them against the DataFile locations to decide which files need to be replaced.

With a partition value containing '/', '"' or '=', no path matches and OPTIMIZE fails with "Files to delete cannot be empty". It was a hidden bug because every existing OPTIMIZE test uses plain ASCII partition values.

Using ContentFile.location() to retrieve the file paths can fix this issue.

Also, we should replace the now deprecated Iceberg ContentFile.path() calls with ContentFile.location() throughout the frontend. It is not expected to impact performance because we call .toString() on ContentFile.path() anyway.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)