You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by ru...@apache.org on 2022/12/07 15:12:18 UTC

[iceberg] branch master updated: Docs: Update Zorder spark support versions. (#6360)

This is an automated email from the ASF dual-hosted git repository.

russellspitzer pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git


The following commit(s) were added to refs/heads/master by this push:
     new 8a76b4bf68 Docs: Update Zorder spark support versions. (#6360)
8a76b4bf68 is described below

commit 8a76b4bf681c9d245b6825d7b3b920f15e48bf97
Author: Ajantha Bhat <aj...@gmail.com>
AuthorDate: Wed Dec 7 20:42:12 2022 +0530

    Docs: Update Zorder spark support versions. (#6360)
    
    Some users are using Zorder with spark-3.1 and facing a confusing error message.
    Hence, updating the document.
    
    Also thought about updating the code to throw the unsupported exception.
    But maybe not required to modify the code as it is only the older versions.
---
 docs/spark-procedures.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/docs/spark-procedures.md b/docs/spark-procedures.md
index 7631f271b6..75e7ca601e 100644
--- a/docs/spark-procedures.md
+++ b/docs/spark-procedures.md
@@ -271,7 +271,7 @@ Iceberg can compact data files in parallel using Spark with the `rewriteDataFile
 |---------------|-----------|------|-------------|
 | `table`       | ✔️  | string | Name of the table to update |
 | `strategy`    |    | string | Name of the strategy - binpack or sort. Defaults to binpack strategy |
-| `sort_order`  |    | string | If Zorder, then comma separated column names within zorder() text. Example: zorder(c1,c2,c3). <br/>Else, Comma separated sort_order_column. Where sort_order_column is a space separated sort order info per column (ColumnName SortDirection NullOrder). <br/> SortDirection can be ASC or DESC. NullOrder can be NULLS FIRST or NULLS LAST |
+| `sort_order`  |    | string | For Zorder use a comma separated list of columns within zorder(). (Supported in Spark 3.2 and Above) Example: zorder(c1,c2,c3). <br/>Else, Comma separated sort orders in the format (ColumnName SortDirection NullOrder). <br/>Where SortDirection can be ASC or DESC. NullOrder can be NULLS FIRST or NULLS LAST. <br/>Defaults to the table's sort order |
 | `options`     | ️   | map<string, string> | Options to be used for actions|
 | `where`       | ️   | string | predicate as a string used for filtering the files. Note that all files that may contain data matching the filter will be selected for rewriting|