You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by gi...@apache.org on 2022/07/07 20:00:17 UTC
[iceberg-docs] branch asf-site updated: deploy: 1d95e5e31b1a645df9db86a3d98b0e26bb28a0bd
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/iceberg-docs.git
The following commit(s) were added to refs/heads/asf-site by this push:
new f12e5b93 deploy: 1d95e5e31b1a645df9db86a3d98b0e26bb28a0bd
f12e5b93 is described below
commit f12e5b934b400404f903f6bea2c3ea14473a290f
Author: rdblue <rd...@users.noreply.github.com>
AuthorDate: Thu Jul 7 20:00:12 2022 +0000
deploy: 1d95e5e31b1a645df9db86a3d98b0e26bb28a0bd
---
docs/0.13.2/api/index.html | 14 +++++++-------
docs/0.13.2/aws/index.html | 14 +++++++-------
docs/0.13.2/configuration/index.html | 14 +++++++-------
docs/0.13.2/custom-catalog/index.html | 14 +++++++-------
docs/0.13.2/evolution/index.html | 14 +++++++-------
docs/0.13.2/flink-connector/index.html | 14 +++++++-------
docs/0.13.2/flink/index.html | 14 +++++++-------
docs/0.13.2/getting-started/index.html | 14 +++++++-------
docs/0.13.2/hive/index.html | 14 +++++++-------
docs/0.13.2/index.html | 12 ++++++------
docs/0.13.2/java-api-quickstart/index.html | 14 +++++++-------
docs/0.13.2/jdbc/index.html | 14 +++++++-------
docs/0.13.2/maintenance/index.html | 14 +++++++-------
docs/0.13.2/nessie/index.html | 14 +++++++-------
docs/0.13.2/partitioning/index.html | 14 +++++++-------
docs/0.13.2/performance/index.html | 12 ++++++------
docs/0.13.2/python-api-intro/index.html | 14 +++++++-------
docs/0.13.2/python-feature-support/index.html | 12 ++++++------
docs/0.13.2/python-quickstart/index.html | 14 +++++++-------
docs/0.13.2/reliability/index.html | 12 ++++++------
docs/0.13.2/schemas/index.html | 12 ++++++------
docs/0.13.2/spark-configuration/index.html | 14 +++++++-------
docs/0.13.2/spark-ddl/index.html | 14 +++++++-------
docs/0.13.2/spark-procedures/index.html | 14 +++++++-------
docs/0.13.2/spark-queries/index.html | 14 +++++++-------
docs/0.13.2/spark-structured-streaming/index.html | 14 +++++++-------
docs/0.13.2/spark-writes/index.html | 14 +++++++-------
27 files changed, 184 insertions(+), 184 deletions(-)
diff --git a/docs/0.13.2/api/index.html b/docs/0.13.2/api/index.html
index 21a4486e..1a743851 100644
--- a/docs/0.13.2/api/index.html
+++ b/docs/0.13.2/api/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a id=active href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a id=active href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
</span></span></code></pre></div><p>To configure a scan, call <code>filter</code> and <code>select</code> on the <code>TableScan</code> to get a new <code>TableScan</code> with those changes.</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-java data-lang=java><span style=display:flex><span>TableScan filteredScan <span style=color:#f92672>=</span> scan<span style=color:#f92672>.</span><span [...]
</span></span></code></pre></div><p>Calls to configuration methods create a new <code>TableScan</code> so that each <code>TableScan</code> is immutable and won’t change unexpectedly if shared across threads.</p><p>When a scan is configured, <code>planFiles</code>, <code>planTasks</code>, and <code>schema</code> are used to return files, tasks, and the read projection.</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4; [...]
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>filter</span><span style=color:#f92672>(</span>Expressions<span style=color:#f92672>.</span><span style=color:#a6e22e>equal</span><span style=color:#f92672>(</span><span style=color:#e6db74>"id"</span><span style=color:#f92672>,</span> 5<span style=color:#f92672>))</span>
@@ -56,8 +56,8 @@
</span></span></code></pre></div><h2 id=expressions>Expressions</h2><p>Iceberg’s expressions are used to configure table scans. To create expressions, use the factory methods in <a href=../../../javadoc/0.13.2/index.html?org/apache/iceberg/expressions/Expressions.html><code>Expressions</code></a>.</p><p>Supported predicate expressions are:</p><ul><li><code>isNull</code></li><li><code>notNull</code></li><li><code>equal</code></li><li><code>notEqual</code></li><li><code>lessThan</cod [...]
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>filter</span><span style=color:#f92672>(</span>Expressions<span style=color:#f92672>.</span><span style=color:#a6e22e>greaterThanOrEqual</span><span style=color:#f92672>(</span><span style=color:#e6db74>"x"</span><span style=color:#f92672>,</span> 5<span style=color:#f92672>))</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>filter</span><span style=color:#f92672>(</span>Expressions<span style=color:#f92672>.</span><span style=color:#a6e22e>lessThan</span><span style=color:#f92672>(</span><span style=color:#e6db74>"x"</span><span style=color:#f92672>,</span> 10<span style=color:#f92672>))</span>
-</span></span></code></pre></div><h2 id=modules>Modules</h2><p>Iceberg table support is organized in library modules:</p><ul><li><code>iceberg-common</code> contains utility classes used in other modules</li><li><code>iceberg-api</code> contains the public Iceberg API, including expressions, types, tables, and operations</li><li><code>iceberg-arrow</code> is an implementation of the Iceberg type system for reading and writing data stored in Iceberg tables using Apache Arrow as the in-mem [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><h2 id=modules>Modules</h2><p>Iceberg table support is organized in library modules:</p><ul><li><code>iceberg-common</code> contains utility classes used in other modules</li><li><code>iceberg-api</code> contains the public Iceberg API, including expressions, types, tables, and operations</li><li><code>iceberg-arrow</code> is an implementation of the Iceberg type system for reading and writing data stored in Iceberg tables using Apache Arrow as the in-mem [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/aws/index.html b/docs/0.13.2/aws/index.html
index f793429a..3220bb16 100644
--- a/docs/0.13.2/aws/index.html
+++ b/docs/0.13.2/aws/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class="collapse in"><ul class=sub-menu><li><a id=active href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
This section describes how to use Iceberg with AWS.</p><h2 id=enabling-aws-integration>Enabling AWS Integration</h2><p>The <code>iceberg-aws</code> module is bundled with Spark and Flink engine runtimes for all versions from <code>0.11.0</code> onwards.
However, the AWS clients are not bundled so that you can use the same client version as your application.
You will need to provide the AWS v2 SDK because that is what Iceberg depends on.
@@ -256,8 +256,8 @@ Please refer to the <a href=https://docs.aws.amazon.com/emr/latest/ReleaseGuide/
</span></span><span style=display:flex><span>install_dependencies $LIB_PATH $AWS_MAVEN_URL $AWS_SDK_VERSION <span style=color:#e6db74>"</span><span style=color:#e6db74>${</span>AWS_PACKAGES[@]<span style=color:#e6db74>}</span><span style=color:#e6db74>"</span>
</span></span></code></pre></div><h3 id=aws-eks>AWS EKS</h3><p><a href=https://aws.amazon.com/eks/>AWS Elastic Kubernetes Service (EKS)</a> can be used to start any Spark, Flink, Hive, Presto or Trino clusters to work with Iceberg.
Search the <a href=../../../blogs>Iceberg blogs</a> page for tutorials around running Iceberg with Docker and Kubernetes.</p><h3 id=amazon-kinesis>Amazon Kinesis</h3><p><a href=https://aws.amazon.com/about-aws/whats-new/2019/11/you-can-now-run-fully-managed-apache-flink-applications-with-apache-kafka/>Amazon Kinesis Data Analytics</a> provides a platform
-to run fully managed Apache Flink applications. You can include Iceberg in your application Jar and run it in the platform.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#enabling-aws-integration>Enabling AWS Integration</a><ul><li><a href=#spark>Spark</a></li><li><a href=#flink>Flink</a></li><li><a href=#hive>Hive</a></li></ul></li><li><a href=#catalogs>Catalogs</a><ul><li><a href=#glue-catalog>Glue Catalog</a></li><li><a href=#dynamodb-ca [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+to run fully managed Apache Flink applications. You can include Iceberg in your application Jar and run it in the platform.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#enabling-aws-integration>Enabling AWS Integration</a><ul><li><a href=#spark>Spark</a></li><li><a href=#flink>Flink</a></li><li><a href=#hive>Hive</a></li></ul></li><li><a href=#catalogs>Catalogs</a><ul><li><a href=#glue-catalog>Glue Catalog</a></li><li><a href=#dynamodb-ca [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/configuration/index.html b/docs/0.13.2/configuration/index.html
index 0f51d39d..e37c6823 100644
--- a/docs/0.13.2/configuration/index.html
+++ b/docs/0.13.2/configuration/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse in"><ul class=sub-menu><li><a id=active href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data [...]
<i class="fa fa-chevron-right"></i>
@@ -13,15 +13,15 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
The value of these properties are not persisted as a part of the table metadata.</p><table><thead><tr><th>Property</th><th>Default</th><th>Description</th></tr></thead><tbody><tr><td>format-version</td><td>1</td><td>Table’s format version (can be 1 or 2) as defined in the <a href=../../../spec/#format-versioning>Spec</a>.</td></tr></tbody></table><h3 id=compatibility-flags>Compatibility flags</h3><table><thead><tr><th>Property</th><th>Default</th><th>Description</th></tr></thead><t [...]
Any other custom catalog can access the properties by implementing <code>Catalog.initialize(catalogName, catalogProperties)</code>.
The properties can be manually constructed or passed in from a compute engine like Spark or Flink.
Spark uses its session properties as catalog properties, see more details in the <a href=../spark-configuration#catalog-configuration>Spark configuration</a> section.
Flink passes in catalog properties through <code>CREATE CATALOG</code> statement, see more details in the <a href=../flink/#creating-catalogs-and-using-catalogs>Flink</a> section.</p><h3 id=lock-catalog-properties>Lock catalog properties</h3><p>Here are the catalog properties related to locking. They are used by some catalog implementations to control the locking behavior during commits.</p><table><thead><tr><th>Property</th><th>Default</th><th>Description</th></tr></thead><tbody><tr><td [...]
of the Hive Metastore (<code>hive.txn.timeout</code> or <code>metastore.txn.timeout</code> in the newer versions). Otherwise, the heartbeats on the lock (which happens during the lock checks) would end up expiring in the
-Hive Metastore before the lock is retried from Iceberg.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#table-properties>Table properties</a><ul><li><a href=#read-properties>Read properties</a></li><li><a href=#write-properties>Write properties</a></li><li><a href=#table-behavior-properties>Table behavior properties</a></li><li><a href=#reserved-table-properties>Reserved table properties</a></li><li><a href=#compatibility-flags>Compatibility [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+Hive Metastore before the lock is retried from Iceberg.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#table-properties>Table properties</a><ul><li><a href=#read-properties>Read properties</a></li><li><a href=#write-properties>Write properties</a></li><li><a href=#table-behavior-properties>Table behavior properties</a></li><li><a href=#reserved-table-properties>Reserved table properties</a></li><li><a href=#compatibility-flags>Compatibility [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/custom-catalog/index.html b/docs/0.13.2/custom-catalog/index.html
index 9ebdbe9e..045c098c 100644
--- a/docs/0.13.2/custom-catalog/index.html
+++ b/docs/0.13.2/custom-catalog/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a id=active href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a id=active href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
</span></span><span style=display:flex><span> <span style=color:#66d9ef>private</span> String dbName<span style=color:#f92672>;</span>
</span></span><span style=display:flex><span> <span style=color:#66d9ef>private</span> String tableName<span style=color:#f92672>;</span>
</span></span><span style=display:flex><span> <span style=color:#66d9ef>private</span> Configuration conf<span style=color:#f92672>;</span>
@@ -201,8 +201,8 @@ To use a different custom location provider for a specific table, specify the im
</span></span><span style=display:flex><span> <span style=color:#66d9ef>return</span> catalog<span style=color:#f92672>.</span><span style=color:#a6e22e>loadTable</span><span style=color:#f92672>(</span>tableIdentifier<span style=color:#f92672>);</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>}</span>
</span></span><span style=display:flex><span><span style=color:#f92672>}</span>
-</span></span></code></pre></div><p>Register the <code>CustomIcebergSource</code> by updating <code>META-INF/services/org.apache.spark.sql.sources.DataSourceRegister</code> with its fully qualified name</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><ul><li><a href=#custom-table-operations-implementation>Custom table operations implementation</a></li><li><a href=#custom-catalog-implementation-1>Custom catalog implementation</a></li><li><a href=#cust [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><p>Register the <code>CustomIcebergSource</code> by updating <code>META-INF/services/org.apache.spark.sql.sources.DataSourceRegister</code> with its fully qualified name</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><ul><li><a href=#custom-table-operations-implementation>Custom table operations implementation</a></li><li><a href=#custom-catalog-implementation-1>Custom catalog implementation</a></li><li><a href=#cust [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/evolution/index.html b/docs/0.13.2/evolution/index.html
index 83993095..18133702 100644
--- a/docs/0.13.2/evolution/index.html
+++ b/docs/0.13.2/evolution/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse in"><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a id=active href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
<em>The data for 2008 is partitioned by month. Starting from 2009 the table is updated so that the data is instead partitioned by day. Both partitioning layouts are able to coexist in the same table.</em></p><p>Iceberg uses <a href=../partitioning>hidden partitioning</a>, so you don’t <em>need</em> to write queries for a specific partition layout to be fast. Instead, you can write queries that select the data you need, and Iceberg automatically prunes out files that don’t con [...]
For example, the following code could be used to update the partition spec to add a new partition field that places <code>id</code> column values into 8 buckets and remove an existing partition field <code>category</code>:</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-java data-lang=java><span style=display:flex><span>Table sampleTable <span style=color:#f92672>=</span> <span style=color: [...]
</span></span><span style=display:flex><span>sampleTable<span style=color:#f92672>.</span><span style=color:#a6e22e>updateSpec</span><span style=color:#f92672>()</span>
@@ -30,8 +30,8 @@ and <code>category</code> column sorted in descending order with nulls first:</p
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>asc</span><span style=color:#f92672>(</span><span style=color:#e6db74>"id"</span><span style=color:#f92672>,</span> NullOrder<span style=color:#f92672>.</span><span style=color:#a6e22e>NULLS_LAST</span><span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>dec</span><span style=color:#f92672>(</span><span style=color:#e6db74>"category"</span><span style=color:#f92672>,</span> NullOrder<span style=color:#f92672>.</span><span style=color:#a6e22e>NULL_FIRST</span><span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>commit</span><span style=color:#f92672>();</span>
-</span></span></code></pre></div><p>Spark supports updating sort order through its <code>ALTER TABLE</code> SQL statement, see more details in <a href=../spark-ddl/#alter-table--write-ordered-by>Spark SQL</a>.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#schema-evolution>Schema evolution</a><ul><li><a href=#correctness>Correctness</a></li></ul></li><li><a href=#partition-evolution>Partition evolution</a></li><li><a href=#sort-order-evolut [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><p>Spark supports updating sort order through its <code>ALTER TABLE</code> SQL statement, see more details in <a href=../spark-ddl/#alter-table--write-ordered-by>Spark SQL</a>.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#schema-evolution>Schema evolution</a><ul><li><a href=#correctness>Correctness</a></li></ul></li><li><a href=#partition-evolution>Partition evolution</a></li><li><a href=#sort-order-evolut [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/flink-connector/index.html b/docs/0.13.2/flink-connector/index.html
index f0bc8f50..afbb7f94 100644
--- a/docs/0.13.2/flink-connector/index.html
+++ b/docs/0.13.2/flink-connector/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
which is just mapping to the underlying iceberg table instead of maintaining iceberg table directly in current Flink catalog.</p><p>To create the table in Flink SQL by using SQL syntax <code>CREATE TABLE test (..) WITH ('connector'='iceberg', ...)</code>, Flink iceberg connector provides the following table properties:</p><ul><li><code>connector</code>: Use the constant <code>iceberg</code>.</li><li><code>catalog-name</code>: User-specified catalog name. It’s required because the c [...]
</span></span><span style=display:flex><span> id BIGINT,
</span></span><span style=display:flex><span> <span style=color:#66d9ef>data</span> STRING
@@ -78,8 +78,8 @@ which is just mapping to the underlying iceberg table instead of maintaining ice
</span></span><span style=display:flex><span><span style=color:#f92672>|</span> <span style=color:#ae81ff>3</span> <span style=color:#f92672>|</span> CCC <span style=color:#f92672>|</span>
</span></span><span style=display:flex><span><span style=color:#f92672>+</span><span style=color:#75715e>----+------+
</span></span></span><span style=display:flex><span><span style=color:#75715e></span><span style=color:#ae81ff>3</span> <span style=color:#66d9ef>rows</span> <span style=color:#66d9ef>in</span> <span style=color:#66d9ef>set</span>
-</span></span></code></pre></div><p>For more details, please refer to the Iceberg <a href=../flink>Flink document</a>.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#table-managed-in-hive-catalog>Table managed in Hive catalog.</a></li><li><a href=#table-managed-in-hadoop-catalog>Table managed in hadoop catalog</a></li><li><a href=#table-managed-in-custom-catalog>Table managed in custom catalog</a></li><li><a href=#a-complete-example>A compl [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><p>For more details, please refer to the Iceberg <a href=../flink>Flink document</a>.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#table-managed-in-hive-catalog>Table managed in Hive catalog.</a></li><li><a href=#table-managed-in-hadoop-catalog>Table managed in hadoop catalog</a></li><li><a href=#table-managed-in-custom-catalog>Table managed in custom catalog</a></li><li><a href=#a-complete-example>A compl [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/flink/index.html b/docs/0.13.2/flink/index.html
index 93b30b13..0081b007 100644
--- a/docs/0.13.2/flink/index.html
+++ b/docs/0.13.2/flink/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
</span></span><span style=display:flex><span>SCALA_VERSION<span style=color:#f92672>=</span>2.12
</span></span><span style=display:flex><span>APACHE_FLINK_URL<span style=color:#f92672>=</span>archive.apache.org/dist/flink/
</span></span><span style=display:flex><span>wget <span style=color:#e6db74>${</span>APACHE_FLINK_URL<span style=color:#e6db74>}</span>/flink-<span style=color:#e6db74>${</span>FLINK_VERSION<span style=color:#e6db74>}</span>/flink-<span style=color:#e6db74>${</span>FLINK_VERSION<span style=color:#e6db74>}</span>-bin-scala_<span style=color:#e6db74>${</span>SCALA_VERSION<span style=color:#e6db74>}</span>.tgz
@@ -238,8 +238,8 @@ For an unpartitioned iceberg table, its data will be completely overwritten by <
</span></span><span style=display:flex><span>RewriteDataFilesActionResult result <span style=color:#f92672>=</span> Actions<span style=color:#f92672>.</span><span style=color:#a6e22e>forTable</span><span style=color:#f92672>(</span>table<span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>rewriteDataFiles</span><span style=color:#f92672>()</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>execute</span><span style=color:#f92672>();</span>
-</span></span></code></pre></div><p>For more doc about options of the rewrite files action, please see <a href=../../../javadoc/0.13.2/org/apache/iceberg/flink/actions/RewriteDataFilesAction.html>RewriteDataFilesAction</a></p><h2 id=future-improvement>Future improvement.</h2><p>There are some features that we do not yet support in the current flink iceberg integration work:</p><ul><li>Don’t support creating iceberg table with hidden partitioning. <a href=http://mail-archives.apache [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><p>For more doc about options of the rewrite files action, please see <a href=../../../javadoc/0.13.2/org/apache/iceberg/flink/actions/RewriteDataFilesAction.html>RewriteDataFilesAction</a></p><h2 id=future-improvement>Future improvement.</h2><p>There are some features that we do not yet support in the current flink iceberg integration work:</p><ul><li>Don’t support creating iceberg table with hidden partitioning. <a href=http://mail-archives.apache [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/getting-started/index.html b/docs/0.13.2/getting-started/index.html
index fc7fd5aa..9fe95979 100644
--- a/docs/0.13.2/getting-started/index.html
+++ b/docs/0.13.2/getting-started/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
We recommend you to get started with Spark to understand Iceberg concepts and features with examples.
You can also view documentations of using Iceberg with other compute engine under the <strong>Engines</strong> tab.</p><h2 id=using-iceberg-in-spark-3>Using Iceberg in Spark 3</h2><p>To use Iceberg in a Spark shell, use the <code>--packages</code> option:</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-sh data-lang=sh><span style=display:flex><span>spark-shell --packages org.apache.iceberg: [...]
</span></span></code></pre></div><div class=info>If you want to include Iceberg in your Spark installation, add the <a href=spark-runtime-jar><code>iceberg-spark-runtime-3.2_2.12</code> Jar</a> to Spark’s <code>jars</code> folder.</div><h3 id=adding-catalogs>Adding catalogs</h3><p>Iceberg comes with <a href=../spark-configuration#catalogs>catalogs</a> that enable SQL commands to manage tables and load them by name. Catalogs are configured using properties under <code>spark.sql.cata [...]
@@ -46,8 +46,8 @@ You can also view documentations of using Iceberg with other compute engine unde
+-------------------------+----------------+-----------+-----------+----------------------------------------------------+-----+
</code></pre><p><a href=../spark-queries#querying-with-dataframes>DataFrame reads</a> are supported and can now reference tables by name using <code>spark.table</code>:</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-scala data-lang=scala><span style=display:flex><span><span style=color:#66d9ef>val</span> df <span style=color:#66d9ef>=</span> spark<span style=color:#f92672>.</span>table<spa [...]
</span></span><span style=display:flex><span>df<span style=color:#f92672>.</span>count<span style=color:#f92672>()</span>
-</span></span></code></pre></div><h3 id=next-steps>Next steps</h3><p>Next, you can learn more about Iceberg tables in Spark:</p><ul><li><a href=../spark-ddl>DDL commands</a>: <code>CREATE</code>, <code>ALTER</code>, and <code>DROP</code></li><li><a href=../spark-queries>Querying data</a>: <code>SELECT</code> queries and metadata tables</li><li><a href=../spark-writes>Writing data</a>: <code>INSERT INTO</code> and <code>MERGE INTO</code></li><li><a href=../spark-procedures>Maintaining tab [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><h3 id=next-steps>Next steps</h3><p>Next, you can learn more about Iceberg tables in Spark:</p><ul><li><a href=../spark-ddl>DDL commands</a>: <code>CREATE</code>, <code>ALTER</code>, and <code>DROP</code></li><li><a href=../spark-queries>Querying data</a>: <code>SELECT</code> queries and metadata tables</li><li><a href=../spark-writes>Writing data</a>: <code>INSERT INTO</code> and <code>MERGE INTO</code></li><li><a href=../spark-procedures>Maintaining tab [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/hive/index.html b/docs/0.13.2/hive/index.html
index e67fbc01..7d192949 100644
--- a/docs/0.13.2/hive/index.html
+++ b/docs/0.13.2/hive/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
Here is the current compatibility matrix for Iceberg Hive support:</p><table><thead><tr><th>Feature</th><th>Hive 2.x</th><th>Hive 3.1.2</th></tr></thead><tbody><tr><td>CREATE EXTERNAL TABLE</td><td>✔️</td><td>✔️</td></tr><tr><td>CREATE TABLE</td><td>✔️</td><td>✔️</td></tr><tr><td>DROP TABLE</td><td>✔️</td><td>✔️</td></tr><tr><td>SELECT</td><td>✔️ (MapReduce and Tez)</td><td>✔️ (MapReduce and Tez)</td></tr><tr><td>INSERT INTO</td><td>✔️ (MapReduce only)️</td><td>✔️ (MapReduce only)</td></ [...]
These are provided by the <code>iceberg-hive-runtime</code> jar file.
For example, if using the Hive shell, this can be achieved by issuing a statement like so:</p><pre tabindex=0><code>add jar /path/to/iceberg-hive-runtime.jar;
@@ -94,8 +94,8 @@ This is a limitation on Hive 3.1.2 because the <code>HiveMetaHook</code> doesn&r
</span></span></code></pre></div><h2 id=type-compatibility>Type compatibility</h2><p>Hive and Iceberg support different set of types. Iceberg can perform type conversion automatically, but not for all combinations,
so you may want to understand the type conversion in Iceberg in prior to design the types of columns in your tables.
You can enable auto-conversion through Hadoop configuration (not enabled by default):</p><table><thead><tr><th>Config key</th><th>Default</th><th>Description</th></tr></thead><tbody><tr><td>iceberg.mr.schema.auto.conversion</td><td>false</td><td>if Hive should perform type auto-conversion</td></tr></tbody></table><h3 id=hive-type-to-iceberg-type>Hive type to Iceberg type</h3><p>This type conversion table describes how Hive types are converted to the Iceberg types.
-The conversion applies on both creating Iceberg table and writing to Iceberg table via Hive.</p><table><thead><tr><th>Hive</th><th>Iceberg</th><th>Notes</th></tr></thead><tbody><tr><td>boolean</td><td>boolean</td><td></td></tr><tr><td>short</td><td>integer</td><td>auto-conversion</td></tr><tr><td>byte</td><td>integer</td><td>auto-conversion</td></tr><tr><td>integer</td><td>integer</td><td></td></tr><tr><td>long</td><td>long</td><td></td></tr><tr><td>float</td><td>float</td><td></td></tr> [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+The conversion applies on both creating Iceberg table and writing to Iceberg table via Hive.</p><table><thead><tr><th>Hive</th><th>Iceberg</th><th>Notes</th></tr></thead><tbody><tr><td>boolean</td><td>boolean</td><td></td></tr><tr><td>short</td><td>integer</td><td>auto-conversion</td></tr><tr><td>byte</td><td>integer</td><td>auto-conversion</td></tr><tr><td>integer</td><td>integer</td><td></td></tr><tr><td>long</td><td>long</td><td></td></tr><tr><td>float</td><td>float</td><td></td></tr> [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/index.html b/docs/0.13.2/index.html
index 8bf184ad..ab8d400b 100644
--- a/docs/0.13.2/index.html
+++ b/docs/0.13.2/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=./configuration/>Configuration</a></li><li><a href=./evolution/>Evolution</a></li><li><a href=./maintenance/>Maintenance</a></li><li><a href=./partitioning/>Partitioning</a></li><li><a href=./performance/>Performance</a></li><li><a href=./reliability/>Reliability</a></li><li><a href=./schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data- [...]
<i class="fa fa-chevron-right"></i>
@@ -13,8 +13,8 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=./aws/>AWS</a></li><li><a href=./jdbc/>JDBC</a></li><li><a href=./nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=./java-api-quickstart/>Java Quickstart</a></li><li><a href=./api/>Java API</a></li><li><a href=./custom-catalog/>Java Custom Catalog</a></li><li><a href=./python-quickstart/>Python Quickstart</a></li><li><a href=./python-api-intro/>Python API</a></li><li><a href=./python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../../java [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=./java-api-quickstart/>Java Quickstart</a></li><li><a href=./api/>Java API</a></li><li><a href=./custom-catalog/>Java Custom Catalog</a></li><li><a href=./python-quickstart/>Python Quickstart</a></li><li><a href=./python-api-intro/>Python API</a></li><li><a href=./python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../../jav [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/java-api-quickstart/index.html b/docs/0.13.2/java-api-quickstart/index.html
index f2bddb6a..81ab526e 100644
--- a/docs/0.13.2/java-api-quickstart/index.html
+++ b/docs/0.13.2/java-api-quickstart/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a id=active href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a id=active href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
You can initialize a Hive catalog with a name and some properties.
(see: <a href=../configuration/#catalog-properties>Catalog properties</a>)</p><p><strong>Note:</strong> Currently, <code>setConf</code> is always required for hive catalogs, but this will change in the future.</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-java data-lang=java><span style=display:flex><span><span style=color:#f92672>import</span> org.apache.iceberg.hive.HiveCatalog<span sty [...]
</span></span><span style=display:flex><span>
@@ -81,8 +81,8 @@ You can initialize a Hive catalog with a name and some properties.
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>hour</span><span style=color:#f92672>(</span><span style=color:#e6db74>"event_time"</span><span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>identity</span><span style=color:#f92672>(</span><span style=color:#e6db74>"level"</span><span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>build</span><span style=color:#f92672>();</span>
-</span></span></code></pre></div><p>For more information on the different partition transforms that Iceberg offers, visit <a href=../../../spec#partitioning>this page</a>.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#create-a-table>Create a table</a><ul><li><a href=#using-a-hive-catalog>Using a Hive catalog</a></li><li><a href=#using-a-hadoop-catalog>Using a Hadoop catalog</a></li><li><a href=#using-hadoop-tables>Using Hadoop tables</a></ [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><p>For more information on the different partition transforms that Iceberg offers, visit <a href=../../../spec#partitioning>this page</a>.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#create-a-table>Create a table</a><ul><li><a href=#using-a-hive-catalog>Using a Hive catalog</a></li><li><a href=#using-a-hadoop-catalog>Using a Hadoop catalog</a></li><li><a href=#using-hadoop-tables>Using Hadoop tables</a></ [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/jdbc/index.html b/docs/0.13.2/jdbc/index.html
index 87db4de4..9ae9f170 100644
--- a/docs/0.13.2/jdbc/index.html
+++ b/docs/0.13.2/jdbc/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class="collapse in"><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a id=active href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
The database that JDBC connects to must support atomic transaction to allow the JDBC catalog implementation to
properly support atomic Iceberg table commits and read serializable isolation.</p><h3 id=configurations>Configurations</h3><p>Because each database and database service provider might require different configurations,
the JDBC catalog allows arbitrary configurations through:</p><table><thead><tr><th>Property</th><th>Default</th><th>Description</th></tr></thead><tbody><tr><td>uri</td><td></td><td>the JDBC connection string</td></tr><tr><td>jdbc.<property_key></td><td></td><td>any key value pairs to configure the JDBC connection</td></tr></tbody></table><h3 id=examples>Examples</h3><h4 id=spark>Spark</h4><p>You can start a Spark session with a MySQL JDBC connection using the following configurations: [...]
@@ -34,8 +34,8 @@ the JDBC catalog allows arbitrary configurations through:</p><table><thead><tr><
</span></span><span style=display:flex><span>properties<span style=color:#f92672>.</span><span style=color:#a6e22e>put</span><span style=color:#f92672>(</span>CatalogProperties<span style=color:#f92672>.</span><span style=color:#a6e22e>WAREHOUSE_LOCATION</span><span style=color:#f92672>,</span> <span style=color:#e6db74>"s3://warehouse/path"</span><span style=color:#f92672>);</span>
</span></span><span style=display:flex><span>Configuration hadoopConf <span style=color:#f92672>=</span> <span style=color:#66d9ef>new</span> Configuration<span style=color:#f92672>();</span> <span style=color:#75715e>// configs if you use HadoopFileIO
</span></span></span><span style=display:flex><span><span style=color:#75715e></span>JdbcCatalog catalog <span style=color:#f92672>=</span> CatalogUtil<span style=color:#f92672>.</span><span style=color:#a6e22e>buildIcebergCatalog</span><span style=color:#f92672>(</span><span style=color:#e6db74>"test_jdbc_catalog"</span><span style=color:#f92672>,</span> properties<span style=color:#f92672>,</span> hadoopConf<span style=color:#f92672>);</span>
-</span></span></code></pre></div></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#jdbc-catalog>JDBC Catalog</a><ul><li><a href=#configurations>Configurations</a></li><li><a href=#examples>Examples</a></li></ul></li></ul></nav></div></div></div></div></section></body><script src=https://iceberg.apache.org/docs/0.13.2/js/jquery-1.11.0.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#jdbc-catalog>JDBC Catalog</a><ul><li><a href=#configurations>Configurations</a></li><li><a href=#examples>Examples</a></li></ul></li></ul></nav></div></div></div></div></section></body><script src=https://iceberg.apache.org/docs/0.13.2//js/jquery-1.11.0.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/maintenance/index.html b/docs/0.13.2/maintenance/index.html
index d9c80076..7d520608 100644
--- a/docs/0.13.2/maintenance/index.html
+++ b/docs/0.13.2/maintenance/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse in"><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a id=active href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
</span></span><span style=display:flex><span><span style=color:#66d9ef>long</span> tsToExpire <span style=color:#f92672>=</span> System<span style=color:#f92672>.</span><span style=color:#a6e22e>currentTimeMillis</span><span style=color:#f92672>()</span> <span style=color:#f92672>-</span> <span style=color:#f92672>(</span>1000 <span style=color:#f92672>*</span> 60 <span style=color:#f92672>*</span> 60 <span style=color:#f92672>*</span> 24<span style=color:#f92672>);</span> <span style=co [...]
</span></span></span><span style=display:flex><span><span style=color:#75715e></span>table<span style=color:#f92672>.</span><span style=color:#a6e22e>expireSnapshots</span><span style=color:#f92672>()</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>expireOlderThan</span><span style=color:#f92672>(</span>tsToExpire<span style=color:#f92672>)</span>
@@ -48,8 +48,8 @@ FileSystem API to avoid unintentional deletion.</div><h2 id=optional-maintenance
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>rewriteManifests</span><span style=color:#f92672>(</span>table<span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span><span style=color:#a6e22e>rewriteIf</span><span style=color:#f92672>(</span>file <span style=color:#f92672>-></span> file<span style=color:#f92672>.</span><span style=color:#a6e22e>length</span><span style=color:#f92672>()</span> <span style=color:#f92672><</span> 10 <span style=color:#f92672>*</span> 1024 <span style=color:#f92672>*</span> 1024<span style=color:#f92672>)</span> <span style=color:#75 [...]
</span></span></span><span style=display:flex><span><span style=color:#75715e></span> <span style=color:#f92672>.</span><span style=color:#a6e22e>execute</span><span style=color:#f92672>();</span>
-</span></span></code></pre></div><p>See the <a href=../../../javadoc/0.13.2/org/apache/iceberg/actions/RewriteManifests.html><code>RewriteManifests</code> Javadoc</a> to see more configuration options.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#recommended-maintenance>Recommended Maintenance</a><ul><li><a href=#expire-snapshots>Expire Snapshots</a></li><li><a href=#remove-old-metadata-files>Remove old metadata files</a></li><li><a href= [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><p>See the <a href=../../../javadoc/0.13.2/org/apache/iceberg/actions/RewriteManifests.html><code>RewriteManifests</code> Javadoc</a> to see more configuration options.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#recommended-maintenance>Recommended Maintenance</a><ul><li><a href=#expire-snapshots>Expire Snapshots</a></li><li><a href=#remove-old-metadata-files>Remove old metadata files</a></li><li><a href= [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/nessie/index.html b/docs/0.13.2/nessie/index.html
index a4d591d3..353f0a46 100644
--- a/docs/0.13.2/nessie/index.html
+++ b/docs/0.13.2/nessie/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class="collapse in"><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a id=active href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
This section describes how to use Iceberg with Nessie. Nessie provides several key features on top of Iceberg:</p><ul><li>multi-table transactions</li><li>git-like operations (eg branches, tags, commits)</li><li>hive-like metastore capabilities</li></ul><p>See <a href=https://projectnessie.org>Project Nessie</a> for more information on Nessie. Nessie requires a server to run, see
<a href=https://projectnessie.org/try/>Getting Started</a> to start a Nessie server.</p><h2 id=enabling-nessie-catalog>Enabling Nessie Catalog</h2><p>The <code>iceberg-nessie</code> module is bundled with Spark and Flink runtimes for all versions from <code>0.11.0</code>. To get started
with Nessie and Iceberg simply add the Iceberg runtime to your process. Eg: <code>spark-sql --packages org.apache.iceberg:iceberg-spark3-runtime:0.13.2</code>.</p><h2 id=spark-sql-extensions>Spark SQL Extensions</h2><p>From Spark 3.0, Nessie SQL extensions can be used to manage the Nessie repo as shown below.</p><pre tabindex=0><code>bin/spark-sql
@@ -75,8 +75,8 @@ incorrect or not performant the branch can be dropped without being merged.</p><
Nessie features.</p><div class=danger>Regular table maintenance in Iceberg is complicated when using nessie. Please consult
<a href=https://projectnessie.org/features/management/>Management Services</a> before performing any
<a href=../maintenance>table maintenance</a>.</div><h2 id=example>Example</h2><p>Please have a look at the <a href=https://github.com/projectnessie/nessie-demos>Nessie Demos repo</a>
-for different examples of Nessie and Iceberg in action together.</p><h2 id=future-improvements>Future Improvements</h2><ul><li>Iceberg multi-table transactions. Changes to multiple Iceberg tables in the same transaction, isolation levels etc</li></ul></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#enabling-nessie-catalog>Enabling Nessie Catalog</a></li><li><a href=#spark-sql-extensions>Spark SQL Extensions</a></li><li><a href=#nessie-catalog>Ne [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+for different examples of Nessie and Iceberg in action together.</p><h2 id=future-improvements>Future Improvements</h2><ul><li>Iceberg multi-table transactions. Changes to multiple Iceberg tables in the same transaction, isolation levels etc</li></ul></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#enabling-nessie-catalog>Enabling Nessie Catalog</a></li><li><a href=#spark-sql-extensions>Spark SQL Extensions</a></li><li><a href=#nessie-catalog>Ne [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/partitioning/index.html b/docs/0.13.2/partitioning/index.html
index 003556cc..d334ea30 100644
--- a/docs/0.13.2/partitioning/index.html
+++ b/docs/0.13.2/partitioning/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse in"><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a id=active href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
</span></span><span style=display:flex><span><span style=color:#66d9ef>WHERE</span> event_time <span style=color:#66d9ef>BETWEEN</span> <span style=color:#e6db74>'2018-12-01 10:00:00'</span> <span style=color:#66d9ef>AND</span> <span style=color:#e6db74>'2018-12-01 12:00:00'</span>
</span></span></code></pre></div><p>Configuring the <code>logs</code> table to partition by the date of <code>event_time</code> will group log events into files with the same event date. Iceberg keeps track of that date and will use it to skip files for other dates that don’t have useful data.</p><p>Iceberg can partition timestamps by year, month, day, and hour granularity. It can also use a categorical column, like <code>level</code> in this logs example, to store rows together an [...]
</span></span><span style=display:flex><span> <span style=color:#66d9ef>SELECT</span> <span style=color:#66d9ef>level</span>, message, event_time, format_time(event_time, <span style=color:#e6db74>'YYYY-MM-dd'</span>)
@@ -21,8 +21,8 @@
</span></span></code></pre></div><p>Similarly, queries that search through the <code>logs</code> table must have an <code>event_date</code> filter in addition to an <code>event_time</code> filter.</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-sql data-lang=sql><span style=display:flex><span><span style=color:#66d9ef>SELECT</span> <span style=color:#66d9ef>level</span>, <span style=color:# [...]
</span></span><span style=display:flex><span><span style=color:#66d9ef>WHERE</span> event_time <span style=color:#66d9ef>BETWEEN</span> <span style=color:#e6db74>'2018-12-01 10:00:00'</span> <span style=color:#66d9ef>AND</span> <span style=color:#e6db74>'2018-12-01 12:00:00'</span>
</span></span><span style=display:flex><span> <span style=color:#66d9ef>AND</span> event_date <span style=color:#f92672>=</span> <span style=color:#e6db74>'2018-12-01'</span>
-</span></span></code></pre></div><p>If the <code>event_date</code> filter were missing, Hive would scan through every file in the table because it doesn’t know that the <code>event_time</code> column is related to the <code>event_date</code> column.</p><h3 id=problems-with-hive-partitioning>Problems with Hive partitioning</h3><p>Hive must be given partition values. In the logs example, it doesn’t know the relationship between <code>event_time</code> and <code>event_date</code [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><p>If the <code>event_date</code> filter were missing, Hive would scan through every file in the table because it doesn’t know that the <code>event_time</code> column is related to the <code>event_date</code> column.</p><h3 id=problems-with-hive-partitioning>Problems with Hive partitioning</h3><p>Hive must be given partition values. In the logs example, it doesn’t know the relationship between <code>event_time</code> and <code>event_date</code [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/performance/index.html b/docs/0.13.2/performance/index.html
index eea89c1e..5cbf2fea 100644
--- a/docs/0.13.2/performance/index.html
+++ b/docs/0.13.2/performance/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse in"><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a id=active href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data [...]
<i class="fa fa-chevron-right"></i>
@@ -13,8 +13,8 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/python-api-intro/index.html b/docs/0.13.2/python-api-intro/index.html
index d7ce8028..e5611770 100644
--- a/docs/0.13.2/python-api-intro/index.html
+++ b/docs/0.13.2/python-api-intro/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a id=active href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a id=active href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
</span></span><span style=display:flex><span>
</span></span><span style=display:flex><span><span style=color:#75715e># instantiate Hive Tables</span>
</span></span><span style=display:flex><span>conf <span style=color:#f92672>=</span> {<span style=color:#e6db74>"hive.metastore.uris"</span>: <span style=color:#e6db74>'thrift://</span><span style=color:#e6db74>{hms_host}</span><span style=color:#e6db74>:</span><span style=color:#e6db74>{hms_port}</span><span style=color:#e6db74>'</span>,
@@ -54,8 +54,8 @@
</span></span><span style=display:flex><span> <span style=color:#ae81ff>2</span>, StringType<span style=color:#f92672>.</span>get())
</span></span></code></pre></div><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-python data-lang=python><span style=display:flex><span><span style=color:#75715e># array<1 element: int></span>
</span></span><span style=display:flex><span>list_var <span style=color:#f92672>=</span> ListType<span style=color:#f92672>.</span>of_required(<span style=color:#ae81ff>1</span>, IntegerType<span style=color:#f92672>.</span>get());
-</span></span></code></pre></div><h2 id=expressions>Expressions</h2><p>Iceberg’s <code>Expressions</code> are used to configure table scans. To create <code>Expressions</code>, use the factory methods in <code>Expressions</code>.</p><p>Supported <code>Predicate</code> expressions are:</p><ul><li><code>is_null</code></li><li><code>not_null</code></li><li><code>equal</code></li><li><code>not_equal</code></li><li><code>less_than</code></li><li><code>less_than_or_equal</code></li><li><code>g [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><h2 id=expressions>Expressions</h2><p>Iceberg’s <code>Expressions</code> are used to configure table scans. To create <code>Expressions</code>, use the factory methods in <code>Expressions</code>.</p><p>Supported <code>Predicate</code> expressions are:</p><ul><li><code>is_null</code></li><li><code>not_null</code></li><li><code>equal</code></li><li><code>not_equal</code></li><li><code>less_than</code></li><li><code>less_than_or_equal</code></li><li><code>g [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/python-feature-support/index.html b/docs/0.13.2/python-feature-support/index.html
index 5d360424..3f7de361 100644
--- a/docs/0.13.2/python-feature-support/index.html
+++ b/docs/0.13.2/python-feature-support/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,8 +13,8 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a id=active href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a id=active href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/python-quickstart/index.html b/docs/0.13.2/python-quickstart/index.html
index bedebf78..ae3a2a90 100644
--- a/docs/0.13.2/python-quickstart/index.html
+++ b/docs/0.13.2/python-quickstart/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a id=active href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class="collapse in"><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a id=active href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/ [...]
cd iceberg/python
pip install -e .
</code></pre><h2 id=testing>Testing</h2><p>Testing is done using tox. The config can be found in <code>tox.ini</code> within the python directory of the iceberg project.</p><pre tabindex=0><code># simply run tox from within the python dir
@@ -36,8 +36,8 @@ tox
</span></span><span style=display:flex><span><span style=color:#75715e># get table level record count</span>
</span></span><span style=display:flex><span><span style=color:#f92672>from</span> pprint <span style=color:#f92672>import</span> pprint
</span></span><span style=display:flex><span>pprint(int(tbl<span style=color:#f92672>.</span>current_snapshot()<span style=color:#f92672>.</span>summary<span style=color:#f92672>.</span>get(<span style=color:#e6db74>"total-records"</span>)))
-</span></span></code></pre></div></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#installation>Installation</a></li><li><a href=#testing>Testing</a></li></ul><ul><li><a href=#inspect-table-metadata>Inspect Table Metadata</a></li></ul></nav></div></div></div></div></section></body><script src=https://iceberg.apache.org/docs/0.13.2/js/jquery-1.11.0.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#installation>Installation</a></li><li><a href=#testing>Testing</a></li></ul><ul><li><a href=#inspect-table-metadata>Inspect Table Metadata</a></li></ul></nav></div></div></div></div></section></body><script src=https://iceberg.apache.org/docs/0.13.2//js/jquery-1.11.0.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/reliability/index.html b/docs/0.13.2/reliability/index.html
index d431f07f..929b9ce2 100644
--- a/docs/0.13.2/reliability/index.html
+++ b/docs/0.13.2/reliability/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse in"><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a id=active href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data [...]
<i class="fa fa-chevron-right"></i>
@@ -13,8 +13,8 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/schemas/index.html b/docs/0.13.2/schemas/index.html
index 598f91c6..0d8b79aa 100644
--- a/docs/0.13.2/schemas/index.html
+++ b/docs/0.13.2/schemas/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class="collapse in"><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a id=active href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data [...]
<i class="fa fa-chevron-right"></i>
@@ -13,8 +13,8 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/spark-configuration/index.html b/docs/0.13.2/spark-configuration/index.html
index 3a1521ee..5cbb073e 100644
--- a/docs/0.13.2/spark-configuration/index.html
+++ b/docs/0.13.2/spark-configuration/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collaps [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
</span></span><span style=display:flex><span>spark.sql.catalog.hive_prod.type = hive
</span></span><span style=display:flex><span>spark.sql.catalog.hive_prod.uri = thrift://metastore-host:port
</span></span><span style=display:flex><span># omit uri to use the same URI as Spark: hive.metastore.uris in hive-site.xml
@@ -38,8 +38,8 @@
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span>option<span style=color:#f92672>(</span><span style=color:#e6db74>"write-format"</span><span style=color:#f92672>,</span> <span style=color:#e6db74>"avro"</span><span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span>option<span style=color:#f92672>(</span><span style=color:#e6db74>"snapshot-property.key"</span><span style=color:#f92672>,</span> <span style=color:#e6db74>"value"</span><span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span>insertInto<span style=color:#f92672>(</span><span style=color:#e6db74>"catalog.db.table"</span><span style=color:#f92672>)</span>
-</span></span></code></pre></div><table><thead><tr><th>Spark option</th><th>Default</th><th>Description</th></tr></thead><tbody><tr><td>write-format</td><td>Table write.format.default</td><td>File format to use for this write operation; parquet, avro, or orc</td></tr><tr><td>target-file-size-bytes</td><td>As per table property</td><td>Overrides this table’s write.target-file-size-bytes</td></tr><tr><td>check-nullability</td><td>true</td><td>Sets the nullable check on fields</td></t [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div><table><thead><tr><th>Spark option</th><th>Default</th><th>Description</th></tr></thead><tbody><tr><td>write-format</td><td>Table write.format.default</td><td>File format to use for this write operation; parquet, avro, or orc</td></tr><tr><td>target-file-size-bytes</td><td>As per table property</td><td>Overrides this table’s write.target-file-size-bytes</td></tr><tr><td>check-nullability</td><td>true</td><td>Sets the nullable check on fields</td></t [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/spark-ddl/index.html b/docs/0.13.2/spark-ddl/index.html
index 95170efa..fc26a04b 100644
--- a/docs/0.13.2/spark-ddl/index.html
+++ b/docs/0.13.2/spark-ddl/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
</span></span><span style=display:flex><span> id bigint <span style=color:#66d9ef>COMMENT</span> <span style=color:#e6db74>'unique id'</span>,
</span></span><span style=display:flex><span> <span style=color:#66d9ef>data</span> string)
</span></span><span style=display:flex><span><span style=color:#66d9ef>USING</span> iceberg
@@ -117,8 +117,8 @@ For example, if you partition by days and move to partitioning by hours, overwri
</span></span></code></pre></div><p>To order within each task, not across tasks, use <code>LOCALLY ORDERED BY</code>:</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-sql data-lang=sql><span style=display:flex><span><span style=color:#66d9ef>ALTER</span> <span style=color:#66d9ef>TABLE</span> prod.db.sample <span style=color:#66d9ef>WRITE</span> LOCALLY ORDERED <span style=color:#66d9ef>BY</ [...]
</span></span></code></pre></div><h3 id=alter-table--write-distributed-by-partition><code>ALTER TABLE ... WRITE DISTRIBUTED BY PARTITION</code></h3><p><code>WRITE DISTRIBUTED BY PARTITION</code> will request that each partition is handled by one writer, the default implementation is hash distribution.</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-sql data-lang=sql><span style=display:flex [...]
</span></span></code></pre></div><p><code>DISTRIBUTED BY PARTITION</code> and <code>LOCALLY ORDERED BY</code> may be used together, to distribute by partition and locally order rows within each task.</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-sql data-lang=sql><span style=display:flex><span><span style=color:#66d9ef>ALTER</span> <span style=color:#66d9ef>TABLE</span> prod.db.sample <sp [...]
-</span></span></code></pre></div></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#create-table><code>CREATE TABLE</code></a><ul><li><a href=#partitioned-by><code>PARTITIONED BY</code></a></li></ul></li><li><a href=#create-table--as-select><code>CREATE TABLE ... AS SELECT</code></a></li><li><a href=#replace-table--as-select><code>REPLACE TABLE ... AS SELECT</code></a></li><li><a href=#drop-table><code>DROP TABLE</code></a></li><li><a href=#alter- [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#create-table><code>CREATE TABLE</code></a><ul><li><a href=#partitioned-by><code>PARTITIONED BY</code></a></li></ul></li><li><a href=#create-table--as-select><code>CREATE TABLE ... AS SELECT</code></a></li><li><a href=#replace-table--as-select><code>REPLACE TABLE ... AS SELECT</code></a></li><li><a href=#drop-table><code>DROP TABLE</code></a></li><li><a href=#alter- [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/spark-procedures/index.html b/docs/0.13.2/spark-procedures/index.html
index 2a5ecdb5..9c6bc6a6 100644
--- a/docs/0.13.2/spark-procedures/index.html
+++ b/docs/0.13.2/spark-procedures/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
</span></span></code></pre></div><h3 id=positional-arguments>Positional arguments</h3><p>When passing arguments by position, only the ending arguments may be omitted if they are optional.</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-sql data-lang=sql><span style=display:flex><span><span style=color:#66d9ef>CALL</span> <span style=color:#66d9ef>catalog_name</span>.<span style=color:#66d9e [...]
</span></span></code></pre></div><h2 id=snapshot-management>Snapshot management</h2><h3 id=rollback_to_snapshot><code>rollback_to_snapshot</code></h3><p>Roll back a table to a specific snapshot ID.</p><p>To roll back to a specific time, use <a href=#rollback_to_timestamp><code>rollback_to_timestamp</code></a>.</p><div class=info>This procedure invalidates all cached Spark plans that reference the affected table.</div><h4 id=usage-1>Usage</h4><table><thead><tr><th>Argument Name</th><th>Re [...]
</span></span></code></pre></div><h3 id=rollback_to_timestamp><code>rollback_to_timestamp</code></h3><p>Roll back a table to the snapshot that was current at some time.</p><div class=info>This procedure invalidates all cached Spark plans that reference the affected table.</div><h4 id=usage-2>Usage</h4><table><thead><tr><th>Argument Name</th><th>Required?</th><th>Type</th><th>Description</th></tr></thead><tbody><tr><td><code>table</code></td><td>✔️</td><td>string</td><td>Name of the table [...]
@@ -71,8 +71,8 @@ files regardless of what partition they belong to.</p><div class=highlight><pre
D as an argument would return A-> B -> C -> D</p></blockquote><h4 id=output-10>Output</h4><table><thead><tr><th>Output Name</th><th>Type</th><th>Description</th></tr></thead><tbody><tr><td><code>snapshot_id</code></td><td>long</td><td>the ancestor snapshot id</td></tr><tr><td><code>timestamp</code></td><td>long</td><td>snapshot creation time</td></tr></tbody></table><h4 id=examples-8>Examples</h4><p>Get all the snapshot ancestors of current snapshots(default)</p><div class=highlight><pre [...]
</span></span></code></pre></div><p>Get all the snapshot ancestors by a particular snapshot</p><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-sql data-lang=sql><span style=display:flex><span><span style=color:#66d9ef>CALL</span> spark_catalog.<span style=color:#66d9ef>system</span>.ancestors_of(<span style=color:#e6db74>'db.tbl'</span>, <span style=color:#ae81ff>1</span>)
</span></span><span style=display:flex><span><span style=color:#66d9ef>CALL</span> spark_catalog.<span style=color:#66d9ef>system</span>.ancestors_of(snapshot_id <span style=color:#f92672>=></span> <span style=color:#ae81ff>1</span>, <span style=color:#66d9ef>table</span> <span style=color:#f92672>=></span> <span style=color:#e6db74>'db.tbl'</span>)
-</span></span></code></pre></div></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#usage>Usage</a><ul><li><a href=#named-arguments>Named arguments</a></li><li><a href=#positional-arguments>Positional arguments</a></li></ul></li><li><a href=#snapshot-management>Snapshot management</a><ul><li><a href=#rollback_to_snapshot><code>rollback_to_snapshot</code></a></li><li><a href=#rollback_to_timestamp><code>rollback_to_timestamp</code></a></li><li><a h [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#usage>Usage</a><ul><li><a href=#named-arguments>Named arguments</a></li><li><a href=#positional-arguments>Positional arguments</a></li></ul></li><li><a href=#snapshot-management>Snapshot management</a><ul><li><a href=#rollback_to_snapshot><code>rollback_to_snapshot</code></a></li><li><a href=#rollback_to_timestamp><code>rollback_to_timestamp</code></a></li><li><a h [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/spark-queries/index.html b/docs/0.13.2/spark-queries/index.html
index 4763ad5f..fcf82c30 100644
--- a/docs/0.13.2/spark-queries/index.html
+++ b/docs/0.13.2/spark-queries/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
</span></span></span></code></pre></div><p>Metadata tables, like <code>history</code> and <code>snapshots</code>, can use the Iceberg table name as a namespace.</p><p>For example, to read from the <code>files</code> metadata table for <code>prod.db.table</code>:</p><pre tabindex=0><code>SELECT * FROM prod.db.table.files
</code></pre><table><thead><tr><th>content</th><th>file_path</th><th>file_format</th><th>spec_id</th><th>partition</th><th>record_count</th><th>file_size_in_bytes</th><th>column_sizes</th><th>value_counts</th><th>null_value_counts</th><th>nan_value_counts</th><th>lower_bounds</th><th>upper_bounds</th><th>key_metadata</th><th>split_offsets</th><th>equality_ids</th><th>sort_order_id</th></tr></thead><tbody><tr><td>0</td><td>s3:/…/table/data/00000-3-8d6d60e8-d427-4809-bcf0-f5d45a4aad96 [...]
</span></span></code></pre></div><h3 id=catalogs-with-dataframereader>Catalogs with DataFrameReader</h3><p>Iceberg 0.11.0 adds multi-catalog support to <code>DataFrameReader</code> in both Spark 3.x and 2.4.</p><p>Paths and table names can be loaded with Spark’s <code>DataFrameReader</code> interface. How tables are loaded depends on how
@@ -69,8 +69,8 @@ This usually occurs when reading from V1 table, where <code>contains_nan</code>
</span></span></span><span style=display:flex><span><span style=color:#75715e></span>spark<span style=color:#f92672>.</span>read<span style=color:#f92672>.</span>format<span style=color:#f92672>(</span><span style=color:#e6db74>"iceberg"</span><span style=color:#f92672>).</span>load<span style=color:#f92672>(</span><span style=color:#e6db74>"db.table.files"</span><span style=color:#f92672>).</span>show<span style=color:#f92672>(</span>truncate <span style=color:#66d9ef>=< [...]
</span></span><span style=display:flex><span><span style=color:#75715e>// Hadoop path table
</span></span></span><span style=display:flex><span><span style=color:#75715e></span>spark<span style=color:#f92672>.</span>read<span style=color:#f92672>.</span>format<span style=color:#f92672>(</span><span style=color:#e6db74>"iceberg"</span><span style=color:#f92672>).</span>load<span style=color:#f92672>(</span><span style=color:#e6db74>"hdfs://nn:8020/path/to/table#files"</span><span style=color:#f92672>).</span>show<span style=color:#f92672>(</span>truncate <span st [...]
-</span></span></code></pre></div></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#querying-with-sql>Querying with SQL</a></li><li><a href=#querying-with-dataframes>Querying with DataFrames</a><ul><li><a href=#catalogs-with-dataframereader>Catalogs with DataFrameReader</a></li><li><a href=#time-travel>Time travel</a></li><li><a href=#incremental-read>Incremental read</a></li><li><a href=#spark-24>Spark 2.4</a></li></ul></li><li><a href=#inspectin [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+</span></span></code></pre></div></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#querying-with-sql>Querying with SQL</a></li><li><a href=#querying-with-dataframes>Querying with DataFrames</a><ul><li><a href=#catalogs-with-dataframereader>Catalogs with DataFrameReader</a></li><li><a href=#time-travel>Time travel</a></li><li><a href=#incremental-read>Incremental read</a></li><li><a href=#spark-24>Spark 2.4</a></li></ul></li><li><a href=#inspectin [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/spark-structured-streaming/index.html b/docs/0.13.2/spark-structured-streaming/index.html
index 2ba750f3..bd9d3f86 100644
--- a/docs/0.13.2/spark-structured-streaming/index.html
+++ b/docs/0.13.2/spark-structured-streaming/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
with different levels of support in Spark versions.</p><p>As of Spark 3.0, DataFrame reads and writes are supported.</p><table><thead><tr><th>Feature support</th><th>Spark 3.0</th><th>Spark 2.4</th><th>Notes</th></tr></thead><tbody><tr><td><a href=#streaming-writes>DataFrame write</a></td><td>✔</td><td>✔</td><td></td></tr></tbody></table><h2 id=streaming-reads>Streaming Reads</h2><p>Iceberg supports processing incremental data in spark structured streaming jobs which starts from a histor [...]
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span>format<span style=color:#f92672>(</span><span style=color:#e6db74>"iceberg"</span><span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span>option<span style=color:#f92672>(</span><span style=color:#e6db74>"stream-from-timestamp"</span><span style=color:#f92672>,</span> <span style=color:#a6e22e>Long</span><span style=color:#f92672>.</span>toString<span style=color:#f92672>(</span>streamStartTimestamp<span style=color:#f92672>))</span>
@@ -46,8 +46,8 @@ Maintaining metadata by tuning the rate of commits, expiring old snapshots, and
is highly recommended.</p><h3 id=tune-the-rate-of-commits>Tune the rate of commits</h3><p>Having high rate of commits would produce lots of data files, manifests, and snapshots which leads the table hard
to maintain. We encourage having trigger interval 1 minute at minimum, and increase the interval if needed.</p><p>The triggers section in <a href=https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#triggers>Structured Streaming Programming Guide</a>
documents how to configure the interval.</p><h3 id=expire-old-snapshots>Expire old snapshots</h3><p>Each micro-batch written to a table produces a new snapshot, which are tracked in table metadata until they are expired to remove the metadata and any data files that are no longer needed. Snapshots accumulate quickly with frequent commits, so it is highly recommended that tables written by streaming queries are <a href=../maintenance#expire-snapshots>regularly maintained</a>.</p><h3 id=co [...]
-This could lead lots of small manifest files. Manifests can be <a href=../maintenance#rewrite-manifests>rewritten to optimize queries and to compact</a>.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#streaming-reads>Streaming Reads</a></li><li><a href=#streaming-writes>Streaming Writes</a><ul><li><a href=#writing-against-partitioned-table>Writing against partitioned table</a></li></ul></li><li><a href=#maintenance-for-streaming-tables>Main [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+This could lead lots of small manifest files. Manifests can be <a href=../maintenance#rewrite-manifests>rewritten to optimize queries and to compact</a>.</p></div><div id=toc class=markdown-body><div id=full><nav id=TableOfContents><ul><li><a href=#streaming-reads>Streaming Reads</a></li><li><a href=#streaming-writes>Streaming Writes</a><ul><li><a href=#writing-against-partitioned-table>Writing against partitioned table</a></li></ul></li><li><a href=#maintenance-for-streaming-tables>Main [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file
diff --git a/docs/0.13.2/spark-writes/index.html b/docs/0.13.2/spark-writes/index.html
index d66685f1..e0bef82a 100644
--- a/docs/0.13.2/spark-writes/index.html
+++ b/docs/0.13.2/spark-writes/index.html
@@ -3,7 +3,7 @@
<span class=icon-bar></span>
<span class=icon-bar></span>
<span class=icon-bar></span></button>
-<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2/img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=https [...]
+<a class="page-scroll navbar-brand" href=https://iceberg.apache.org/docs/0.13.2/><img class=top-navbar-logo src=https://iceberg.apache.org/docs/0.13.2//img/iceberg-logo-icon.png> Apache Iceberg</a></div><div><input type=search class=form-control id=search-input placeholder=Search... maxlength=64 data-hotkeys=s/></div><div class=versions-dropdown><span>0.13.2</span> <i class="fa fa-chevron-down"></i><div class=versions-dropdown-content><ul><li class=versions-dropdown-selection><a href=htt [...]
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Tables class=collapse><ul class=sub-menu><li><a href=../configuration/>Configuration</a></li><li><a href=../evolution/>Evolution</a></li><li><a href=../maintenance/>Maintenance</a></li><li><a href=../partitioning/>Partitioning</a></li><li><a href=../performance/>Performance</a></li><li><a href=../reliability/>Reliability</a></li><li><a href=../schemas/>Schemas</a></li></ul></div><li><a class=chevron-toggle data-toggle=collapse data-paren [...]
<i class="fa fa-chevron-right"></i>
@@ -13,7 +13,7 @@
<i class="fa fa-chevron-right"></i>
<i class="fa fa-chevron-down"></i></a></li><div id=Integrations class=collapse><ul class=sub-menu><li><a href=../aws/>AWS</a></li><li><a href=../jdbc/>JDBC</a></li><li><a href=../nessie/>Nessie</a></li></ul></div><li><a class="chevron-toggle collapsed" data-toggle=collapse data-parent=full href=#API><span>API</span>
<i class="fa fa-chevron-right"></i>
-<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2../. [...]
+<i class="fa fa-chevron-down"></i></a></li><div id=API class=collapse><ul class=sub-menu><li><a href=../java-api-quickstart/>Java Quickstart</a></li><li><a href=../api/>Java API</a></li><li><a href=../custom-catalog/>Java Custom Catalog</a></li><li><a href=../python-quickstart/>Python Quickstart</a></li><li><a href=../python-api-intro/>Python API</a></li><li><a href=../python-feature-support/>Python Feature Support</a></li></ul></div><li><a href=https://iceberg.apache.org/docs/0.13.2/../ [...]
</span></span></code></pre></div><div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-sql data-lang=sql><span style=display:flex><span><span style=color:#66d9ef>INSERT</span> <span style=color:#66d9ef>INTO</span> prod.db.<span style=color:#66d9ef>table</span> <span style=color:#66d9ef>SELECT</span> ...
</span></span></code></pre></div><h3 id=merge-into><code>MERGE INTO</code></h3><p>Spark 3 added support for <code>MERGE INTO</code> queries that can express row-level updates.</p><p>Iceberg supports <code>MERGE INTO</code> by rewriting data files that contain rows that need to be updated in an <code>overwrite</code> commit.</p><p><strong><code>MERGE INTO</code> is recommended instead of <code>INSERT OVERWRITE</code></strong> because Iceberg can replace only the affected data files, and b [...]
</span></span></span><span style=display:flex><span><span style=color:#75715e></span><span style=color:#66d9ef>USING</span> (<span style=color:#66d9ef>SELECT</span> ...) s <span style=color:#75715e>-- the source updates
@@ -121,8 +121,8 @@ which can be used in query.</div><p>Here we just registered the bucket function
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span>writeTo<span style=color:#f92672>(</span><span style=color:#e6db74>"prod.db.sample"</span><span style=color:#f92672>)</span>
</span></span><span style=display:flex><span> <span style=color:#f92672>.</span>append<span style=color:#f92672>()</span>
</span></span></code></pre></div><h2 id=type-compatibility>Type compatibility</h2><p>Spark and Iceberg support different set of types. Iceberg does the type conversion automatically, but not for all combinations,
-so you may want to understand the type conversion in Iceberg in prior to design the types of columns in your tables.</p><h3 id=spark-type-to-iceberg-type>Spark type to Iceberg type</h3><p>This type conversion table describes how Spark types are converted to the Iceberg types. The conversion applies on both creating Iceberg table and writing to Iceberg table via Spark.</p><table><thead><tr><th>Spark</th><th>Iceberg</th><th>Notes</th></tr></thead><tbody><tr><td>boolean</td><td>boolean</td> [...]
-<script src=https://iceberg.apache.org/docs/0.13.2/js/jquery.easing.min.js></script>
-<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2/js/search.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/bootstrap.min.js></script>
-<script src=https://iceberg.apache.org/docs/0.13.2/js/iceberg-theme.js></script></html>
\ No newline at end of file
+so you may want to understand the type conversion in Iceberg in prior to design the types of columns in your tables.</p><h3 id=spark-type-to-iceberg-type>Spark type to Iceberg type</h3><p>This type conversion table describes how Spark types are converted to the Iceberg types. The conversion applies on both creating Iceberg table and writing to Iceberg table via Spark.</p><table><thead><tr><th>Spark</th><th>Iceberg</th><th>Notes</th></tr></thead><tbody><tr><td>boolean</td><td>boolean</td> [...]
+<script src=https://iceberg.apache.org/docs/0.13.2//js/jquery.easing.min.js></script>
+<script type=text/javascript src=https://iceberg.apache.org/docs/0.13.2//js/search.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/bootstrap.min.js></script>
+<script src=https://iceberg.apache.org/docs/0.13.2//js/iceberg-theme.js></script></html>
\ No newline at end of file