You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by ao...@apache.org on 2020/03/31 14:23:22 UTC
[incubator-iceberg] branch master updated: Update docs with
read.split.metadata-target-size property (#883)
This is an automated email from the ASF dual-hosted git repository.
aokolnychyi pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-iceberg.git
The following commit(s) were added to refs/heads/master by this push:
new 2338d45 Update docs with read.split.metadata-target-size property (#883)
2338d45 is described below
commit 2338d458be1952f1613ff4bc2bc535b7dc0d47ce
Author: jun-he <ju...@users.noreply.github.com>
AuthorDate: Tue Mar 31 07:23:12 2020 -0700
Update docs with read.split.metadata-target-size property (#883)
---
site/docs/configuration.md | 13 +++++++------
1 file changed, 7 insertions(+), 6 deletions(-)
diff --git a/site/docs/configuration.md b/site/docs/configuration.md
index 14d3b35..874b0e3 100644
--- a/site/docs/configuration.md
+++ b/site/docs/configuration.md
@@ -23,11 +23,12 @@ Iceberg tables support table properties to configure table behavior, like the de
### Read properties
-| Property | Default | Description |
-| ---------------------------- | ------------------ | ------------------------------------------------------ |
-| read.split.target-size | 134217728 (128 MB) | Target size when combining input splits |
-| read.split.planning-lookback | 10 | Number of bins to consider when combining input splits |
-| read.split.open-file-cost | 4194304 (4 MB) | The estimated cost to open a file, used as a minimum weight when combining splits. |
+| Property | Default | Description |
+| --------------------------------- | ------------------ | ------------------------------------------------------ |
+| read.split.target-size | 134217728 (128 MB) | Target size when combining data input splits |
+| read.split.metadata-target-size | 33554432 (32 MB) | Target size when combining metadata input splits |
+| read.split.planning-lookback | 10 | Number of bins to consider when combining input splits |
+| read.split.open-file-cost | 4194304 (4 MB) | The estimated cost to open a file, used as a minimum weight when combining splits. |
### Write properties
@@ -91,7 +92,7 @@ spark.read
| --------------- | --------------------- | ----------------------------------------------------------------------------------------- |
| snapshot-id | (latest) | Snapshot ID of the table snapshot to read |
| as-of-timestamp | (latest) | A timestamp in milliseconds; the snapshot used will be the snapshot current at this time. |
-| split-size | As per table property | Overrides this table's read.split.target-size |
+| split-size | As per table property | Overrides this table's read.split.target-size and read.split.metadata-target-size |
| lookback | As per table property | Overrides this table's read.split.planning-lookback |
| file-open-cost | As per table property | Overrides this table's read.split.open-file-cost |