[jira] [Updated] (IMPALA-15409) Fix file paths in OPTIMIZE and replace deprecated ContentFile.path()

["Noémi Pap-Takács (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Noémi Pap-Takács updated IMPALA-15409:
--------------------------------------
    Summary: Fix file paths in OPTIMIZE and replace deprecated ContentFile.path()  (was: Fix file paths in OPTIMIZE and deprecate ContentFile.path())

> Fix file paths in OPTIMIZE and replace deprecated ContentFile.path()
> --------------------------------------------------------------------
>
>                 Key: IMPALA-15409
>                 URL: https://issues.apache.org/jira/browse/IMPALA-15409
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Noémi Pap-Takács
>            Assignee: Noémi Pap-Takács
>            Priority: Major
>
> OptimizeStmt with file filtering sends the paths of the selected data files to the catalog, which matches them against the DataFile locations to decide which files need to be replaced.
> With a partition value containing '/', '"' or '=', no path matches and OPTIMIZE fails with "Files to delete cannot be empty". It was a hidden bug because every existing OPTIMIZE test uses plain ASCII partition values.
> Using ContentFile.location() to retrieve the file paths can fix this issue.
> Also, we should replace the now deprecated Iceberg ContentFile.path() calls with ContentFile.location() throughout the frontend. It is not expected to impact performance because we call .toString() on ContentFile.path() anyway.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org