You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Tamas Mate (Code Review)" <ge...@cloudera.org> on 2022/07/01 07:43:45 UTC

[Impala-ASF-CR] IMPALA-11377: Handle concurrent Iceberg INSERT OVERWRITEs

Tamas Mate has uploaded a new patch set (#4). ( http://gerrit.cloudera.org:8080/18648 )

Change subject: IMPALA-11377: Handle concurrent Iceberg INSERT OVERWRITEs
......................................................................

IMPALA-11377: Handle concurrent Iceberg INSERT OVERWRITEs

Iceberg now supports validations in the ReplacePartitions API, an
initial snapshot id can be configured for the operation and Iceberg
will validate at commit if there were any conflicting change while the
ReplacePartitions was running.

This commit utilizes this new functionality, the Coordinator sends the
initial snapshot id to the Catalog, so the Catalog can validate the
operation.

Testing:
 - Added e2e tests.

Change-Id: I812d19736c8e563541b038970786de7710b59f31
---
M be/src/service/client-request-state.cc
M common/thrift/CatalogService.thrift
M common/thrift/Query.thrift
M fe/src/main/java/org/apache/impala/service/Frontend.java
M fe/src/main/java/org/apache/impala/service/IcebergCatalogOpExecutor.java
M tests/query_test/test_iceberg.py
6 files changed, 61 insertions(+), 5 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/48/18648/4
-- 
To view, visit http://gerrit.cloudera.org:8080/18648
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I812d19736c8e563541b038970786de7710b59f31
Gerrit-Change-Number: 18648
Gerrit-PatchSet: 4
Gerrit-Owner: Tamas Mate <tm...@apache.org>
Gerrit-Reviewer: Gabor Kaszab <ga...@cloudera.com>
Gerrit-Reviewer: Gergely Fürnstáhl <gf...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tamas Mate <tm...@apache.org>
Gerrit-Reviewer: Zoltan Borok-Nagy <bo...@cloudera.com>