You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2024/04/15 06:26:00 UTC

[jira] [Created] (IMPALA-13002) Iceberg V2 tables with Avro delete files aren't read properly

Zoltán Borók-Nagy created IMPALA-13002:
------------------------------------------

             Summary: Iceberg V2 tables with Avro delete files aren't read properly
                 Key: IMPALA-13002
                 URL: https://issues.apache.org/jira/browse/IMPALA-13002
             Project: IMPALA
          Issue Type: Bug
          Components: Backend
            Reporter: Zoltán Borók-Nagy


If the Iceberg table has Avro delete files (e.g. by setting 'write.delete.format.default'='avro') then Impala won't be able to read the contents of the delete files properly.

Therefore delete records won't be applied to the Iceberg table during reads. The new Iceberg V2 operator will raise errors in this case, but if it is disabled via 'set disable_optimized_iceberg_v2_read=true' then Impala won't be able to detect invalid delete records.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)