You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by et...@apache.org on 2023/08/22 05:53:58 UTC
[iceberg] branch master updated: Docs: Add notes on Spark writes support (#8362)
This is an automated email from the ASF dual-hosted git repository.
etudenhoefner pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git
The following commit(s) were added to refs/heads/master by this push:
new 7cc7a1e6f7 Docs: Add notes on Spark writes support (#8362)
7cc7a1e6f7 is described below
commit 7cc7a1e6f70854c75fcad4789b402477c503f9b4
Author: Manu Zhang <Ow...@gmail.com>
AuthorDate: Tue Aug 22 13:53:52 2023 +0800
Docs: Add notes on Spark writes support (#8362)
---
docs/spark-writes.md | 20 ++++++++++----------
1 file changed, 10 insertions(+), 10 deletions(-)
diff --git a/docs/spark-writes.md b/docs/spark-writes.md
index 29c1e22447..ea62c4b333 100644
--- a/docs/spark-writes.md
+++ b/docs/spark-writes.md
@@ -34,16 +34,16 @@ Some plans are only available when using [Iceberg SQL extensions](../spark-confi
Iceberg uses Apache Spark's DataSourceV2 API for data source and catalog implementations. Spark DSv2 is an evolving API with different levels of support in Spark versions:
-| Feature support | Spark 3 | Notes |
-|--------------------------------------------------|-----------|----------------------------------------------|
-| [SQL insert into](#insert-into) | ✔️ | |
-| [SQL merge into](#merge-into) | ✔️ | ⚠ Requires Iceberg Spark extensions |
-| [SQL insert overwrite](#insert-overwrite) | ✔️ | |
-| [SQL delete from](#delete-from) | ✔️ | ⚠ Row-level delete requires Spark extensions |
-| [SQL update](#update) | ✔️ | ⚠ Requires Iceberg Spark extensions |
-| [DataFrame append](#appending-data) | ✔️ | |
-| [DataFrame overwrite](#overwriting-data) | ✔️ | |
-| [DataFrame CTAS and RTAS](#creating-tables) | ✔️ | |
+| Feature support | Spark 3 | Notes |
+|--------------------------------------------------|-----------|-----------------------------------------------------------------------------|
+| [SQL insert into](#insert-into) | ✔️ | ⚠ Requires `spark.sql.storeAssignmentPolicy=ANSI` (default since Spark 3.0) |
+| [SQL merge into](#merge-into) | ✔️ | ⚠ Requires Iceberg Spark extensions |
+| [SQL insert overwrite](#insert-overwrite) | ✔️ | ⚠ Requires `spark.sql.storeAssignmentPolicy=ANSI` (default since Spark 3.0) |
+| [SQL delete from](#delete-from) | ✔️ | ⚠ Row-level delete requires Iceberg Spark extensions |
+| [SQL update](#update) | ✔️ | ⚠ Requires Iceberg Spark extensions |
+| [DataFrame append](#appending-data) | ✔️ | |
+| [DataFrame overwrite](#overwriting-data) | ✔️ | |
+| [DataFrame CTAS and RTAS](#creating-tables) | ✔️ | ⚠ Requires DSv2 API |
## Writing with SQL