You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2022/06/23 13:02:00 UTC
[jira] [Created] (IMPALA-11388) Add support for equality-based deletes
Zoltán Borók-Nagy created IMPALA-11388:
------------------------------------------
Summary: Add support for equality-based deletes
Key: IMPALA-11388
URL: https://issues.apache.org/jira/browse/IMPALA-11388
Project: IMPALA
Issue Type: New Feature
Components: Frontend
Reporter: Zoltán Borók-Nagy
Iceberg V2 adds support for row-level modifications.
One way to implement this is via equality based delete files:
https://iceberg.apache.org/spec/#equality-delete-files
https://iceberg.apache.org/spec/#scan-planning
We could implement this via doing ANTI HASH JOIN between data and delete files. Similarly to what we do for Hive full ACID tables:
https://github.com/apache/impala/blob/f5fc08573352d0a1943296209791a4db17268086/fe/src/main/java/org/apache/impala/planner/SingleNodePlanner.java#L1729-L1735
The complexity comes when different delete files use different set of columns. In that case we will need multiple ANTI HASH JOINs on top of each other.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org