You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by gi...@apache.org on 2022/02/16 01:52:32 UTC
[iceberg-docs] branch asf-site updated: deploy: a425c1dcaff08adf0a6a0c05d4be90e1c7fa623e
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/iceberg-docs.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 0380868 deploy: a425c1dcaff08adf0a6a0c05d4be90e1c7fa623e
0380868 is described below
commit 038086805a27f3664231f7849e0cab7b3b57674e
Author: jackye1995 <ja...@users.noreply.github.com>
AuthorDate: Wed Feb 16 01:52:24 2022 +0000
deploy: a425c1dcaff08adf0a6a0c05d4be90e1c7fa623e
---
common/index.xml | 17 +--
community/index.html | 9 +-
contribute/index.html | 230 +++++++++++++++++++++++++++++++++++++
how-to-release/index.html | 46 ++++++++
how-to-verify-a-release/index.html | 16 +--
index.xml | 17 +--
multi-engine-support/index.html | 65 ++++++++---
releases/index.html | 63 +++++++---
sitemap.xml | 2 +-
spec/index.html | 4 +-
10 files changed, 406 insertions(+), 63 deletions(-)
diff --git a/common/index.xml b/common/index.xml
index 73b3a2a..385acf4 100644
--- a/common/index.xml
+++ b/common/index.xml
@@ -1,17 +1,18 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Commons on Apache Iceberg</title><link>https://iceberg.apache.org/common/</link><description>Recent content in Commons on Apache Iceberg</description><generator>Hugo -- gohugo.io</generator><language>en-us</language><atom:link href="https://iceberg.apache.org/common/index.xml" rel="self" type="application/rss+xml"/><item><title/><link>https://iceberg.apache.o [...]
-Community discussions happen primarily on the dev mailing list, on apache-iceberg Slack workspace, and on specific GitHub issues.
-Contributing The Iceberg Project is hosted on Github at https://github.com/apache/iceberg.
-The Iceberg community prefers to receive contributions as Github pull requests.
-View open pull requests Learn about pull requests Issues Issues are tracked in GitHub:</description></item><item><title/><link>https://iceberg.apache.org/blogs/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/blogs/</guid><description>Iceberg Blogs Here is a list of company blogs that talk about Iceberg. The blogs are ordered from most recent to oldest.
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Commons on Apache Iceberg</title><link>https://iceberg.apache.org/common/</link><description>Recent content in Commons on Apache Iceberg</description><generator>Hugo -- gohugo.io</generator><language>en-us</language><atom:link href="https://iceberg.apache.org/common/index.xml" rel="self" type="application/rss+xml"/><item><title/><link>https://iceberg.apache.o [...]
+0.13.1 source tar.gz &ndash; signature &ndash; sha512 0.13.1 Spark 3.2 runtime Jar 0.13.1 Spark 3.1 runtime Jar 0.13.1 Spark 3.0 runtime Jar 0.13.1 Spark 2.4 runtime Jar 0.13.1 Flink 1.14 runtime Jar 0.13.1 Flink 1.13 runtime Jar 0.13.1 Flink 1.12 runtime Jar 0.13.1 Hive runtime Jar To use Iceberg in Spark or Flink, download the runtime JAR for your engine version and add it to the jars folder of your installation.</description></item><item><title/><link>https://iceberg.apache.or [...]
Docker, Spark, and Iceberg: The Fastest Way to Try Iceberg! Date: February 2nd, 2022, Company: Tabular
Author: Sam Redai, Kyle Bendickson
Iceberg FileIO: Cloud Native Tables Date: December 16th, 2021, Company: Tabular
Author: Daniel Weeks
-Using Spark in EMR with Apache Iceberg Date: December 10th, 2021, Company: Tabular</description></item><item><title/><link>https://iceberg.apache.org/talks/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/talks/</guid><description>Iceberg Talks Here is a list of talks and other videos related to Iceberg.
+Using Spark in EMR with Apache Iceberg Date: December 10th, 2021, Company: Tabular</description></item><item><title/><link>https://iceberg.apache.org/contribute/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/contribute/</guid><description>Contributing In this page, you will find some guidelines on contributing to Apache Iceberg. Please keep in mind that none of these are hard rules and they&rsquo;re meant as a collection of helpful suggestio [...]
+If you are thinking of contributing but first would like to discuss the change you wish to make, we welcome you to head over to the Community page on the official Iceberg documentation site to find a number of ways to connect with the community, including slack and our mailing lists.</description></item><item><title/><link>https://iceberg.apache.org/community/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/community/</guid><description>Welcome! A [...]
+Community discussions happen primarily on the dev mailing list, on apache-iceberg Slack workspace, and on specific GitHub issues.
+Contribute See Contributing for more details on how to contribute to Iceberg.
+Issues Issues are tracked in GitHub:
+View open issues Open a new issue Slack We use the Apache Iceberg workspace on Slack. To be invited, follow this invite link.</description></item><item><title/><link>https://iceberg.apache.org/talks/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/talks/</guid><description>Iceberg Talks Here is a list of talks and other videos related to Iceberg.
Expert Roundtable: The Future of Metadata After Hive Metastore Date: November 15, 2021, Authors: Lior Ebel, Seshu Adunuthula, Ryan Blue &amp; Oz Katz
Spark and Iceberg at Apple&rsquo;s Scale - Leveraging differential files for efficient upserts and deletes Date: October 21, 2020, Author: Anton
-Apache Iceberg - A Table Format for Huge Analytic Datasets Date: October 21, 2020, Author: Ryan Blue</description></item><item><title/><link>https://iceberg.apache.org/releases/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/releases/</guid><description>Downloads The latest version of Iceberg is 0.13.0.
-0.13.0 source tar.gz &ndash; signature &ndash; sha512 0.13.0 Spark 3.2 runtime Jar 0.13.0 Spark 3.1 runtime Jar 0.13.0 Spark 3.0 runtime Jar 0.13.0 Spark 2.4 runtime Jar 0.13.0 Flink 1.14 runtime Jar 0.13.0 Flink 1.13 runtime Jar 0.13.0 Flink 1.12 runtime Jar 0.13.0 Hive runtime Jar To use Iceberg in Spark or Flink, download the runtime JAR for your engine version and add it to the jars folder of your installation.</description></item><item><title/><link>https://iceberg.apache.or [...]
+Apache Iceberg - A Table Format for Huge Analytic Datasets Date: October 21, 2020, Author: Ryan Blue</description></item><item><title/><link>https://iceberg.apache.org/spec/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/spec/</guid><description>Iceberg Table Spec This is a specification for the Iceberg table format that is designed to manage a large, slow-changing collection of files in a distributed file system or key-value store as a table.
Format Versioning Versions 1 and 2 of the Iceberg spec are complete and adopted by the community.
The format version number is incremented when new features are added that will break forward-compatibility&mdash;that is, when older readers would not read newer table features correctly.</description></item><item><title/><link>https://iceberg.apache.org/terms/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/terms/</guid><description>Terms Snapshot A snapshot is the state of a table at some time.
Each snapshot lists all of the data files that make up the table&rsquo;s contents at the time of the snapshot. Data files are stored across multiple manifest files, and the manifests for a snapshot are listed in a single manifest list file.
diff --git a/community/index.html b/community/index.html
index 62c0248..313c153 100644
--- a/community/index.html
+++ b/community/index.html
@@ -74,13 +74,8 @@
<h1 id=welcome>Welcome!</h1>
<p>Apache Iceberg tracks issues in GitHub and prefers to receive contributions as pull requests.</p>
<p>Community discussions happen primarily on the dev mailing list, on apache-iceberg Slack workspace, and on specific GitHub issues.</p>
-<h2 id=contributing>Contributing</h2>
-<p>The Iceberg Project is hosted on Github at <a href=https://github.com/apache/iceberg>https://github.com/apache/iceberg</a>.</p>
-<p>The Iceberg community prefers to receive contributions as <a href=https://help.github.com/articles/about-pull-requests/>Github pull requests</a>.</p>
-<ul>
-<li><a href=https://github.com/apache/iceberg/pulls>View open pull requests</a></li>
-<li><a href=https://help.github.com/articles/about-pull-requests/>Learn about pull requests</a></li>
-</ul>
+<h2 id=contribute>Contribute</h2>
+<p>See <a href=../../../contribute>Contributing</a> for more details on how to contribute to Iceberg.</p>
<h2 id=issues>Issues</h2>
<p>Issues are tracked in GitHub:</p>
<ul>
diff --git a/contribute/index.html b/contribute/index.html
new file mode 100644
index 0000000..0ac73d8
--- /dev/null
+++ b/contribute/index.html
@@ -0,0 +1,230 @@
+<!doctype html><html>
+<head>
+<meta charset=utf-8>
+<meta http-equiv=x-ua-compatible content="IE=edge">
+<meta name=viewport content="width=device-width,initial-scale=1">
+<meta name=description content>
+<meta name=author content>
+<base href=https://iceberg.apache.org/>
+<title></title>
+<link href=https://iceberg.apache.org//css/bootstrap.css rel=stylesheet>
+<link href=https://iceberg.apache.org//css/landing-page.css rel=stylesheet>
+<link href=https://iceberg.apache.org//css/markdown.css rel=stylesheet>
+<link href=https://iceberg.apache.org//css/katex.min.css rel=stylesheet>
+<link rel=stylesheet href=https://iceberg.apache.org//css/pricing.css>
+<link href=https://iceberg.apache.org//font-awesome-4.7.0/css/font-awesome.min.css rel=stylesheet type=text/css>
+<link href="//fonts.googleapis.com/css?family=Lato:300,400,700,300italic,400italic,700italic" rel=stylesheet type=text/css>
+<link href=https://iceberg.apache.org//css/termynal.css rel=stylesheet>
+</head>
+<body>
+<head>
+<link href=https://iceberg.apache.org//css/markdown.css rel=stylesheet>
+<link href=https://iceberg.apache.org//css/katex.min.css rel=stylesheet>
+</head>
+<nav class="navbar navbar-default navbar-fixed-top" role=navigation>
+<div class=container>
+<div class="navbar-header page-scroll">
+<button type=button class=navbar-toggle data-toggle=collapse data-target=#bs-example-navbar-collapse-1>
+<span class=sr-only>Toggle navigation</span>
+<span class=icon-bar></span>
+<span class=icon-bar></span>
+<span class=icon-bar></span>
+</button>
+<a class="page-scroll navbar-brand" href=#intro><img class=top-navbar-logo src=https://iceberg.apache.org//img/iceberg-logo-icon.png> Apache Iceberg</a>
+</div>
+<div class="collapse navbar-collapse" id=bs-example-navbar-collapse-1>
+<ul class="nav navbar-nav navbar-right">
+<li>
+<a class=page-scroll href=https://iceberg.apache.org/docs/latest>Docs</a>
+</li>
+<li>
+<a class=page-scroll href=https://iceberg.apache.org/docs/latest/getting-started/>Spark</a>
+</li>
+<li>
+<a class=page-scroll href=https://iceberg.apache.org/docs/latest/flink/>Flink</a>
+</li>
+<li>
+<a class=page-scroll href=https://trino.io/docs/current/connector/iceberg.html target=_blank>Trino</a>
+</li>
+<li>
+<a class=page-scroll href=https://prestodb.io/docs/current/connector/iceberg.html target=_blank>Presto</a>
+</li>
+<li>
+<a class=page-scroll href=https://iceberg.apache.org/releases>Releases</a>
+</li>
+<li>
+<a class=page-scroll href=https://iceberg.apache.org/roadmap>Roadmap</a>
+</li>
+<li>
+<a class=page-scroll href=https://iceberg.apache.org/community>Community</a>
+</li>
+<li>
+<a class=page-scroll href=https://iceberg.apache.org/blogs>Blogs</a>
+</li>
+<li>
+<a class=page-scroll href=https://iceberg.apache.org/talks>Talks</a>
+</li>
+</ul>
+</div>
+</div>
+</nav>
+<div class=pad-for-navbar></div>
+<body dir=" ltr">
+<div class=markdown-body>
+<h1 id=contributing>Contributing</h1>
+<p>In this page, you will find some guidelines on contributing to Apache Iceberg. Please keep in mind that none of
+these are hard rules and they’re meant as a collection of helpful suggestions to make contributing as seamless of an
+experience as possible.</p>
+<p>If you are thinking of contributing but first would like to discuss the change you wish to make, we welcome you to
+head over to the <a href=https://iceberg.apache.org/community/>Community</a> page on the official Iceberg documentation site
+to find a number of ways to connect with the community, including slack and our mailing lists. Of course, always feel
+free to just open a <a href=https://github.com/apache/iceberg/issues/new>new issue</a> in the GitHub repo.</p>
+<p>The Iceberg Project is hosted on GitHub at <a href=https://github.com/apache/iceberg>https://github.com/apache/iceberg</a>.</p>
+<h2 id=pull-request-process>Pull Request Process</h2>
+<p>The Iceberg community prefers to receive contributions as <a href=https://help.github.com/articles/about-pull-requests/>Github pull requests</a>.</p>
+<p><a href=https://github.com/apache/iceberg/pulls>View open pull requests</a></p>
+<ul>
+<li>PRs are automatically labeled based on the content by our github-actions labeling action</li>
+<li>It’s helpful to include a prefix in the summary that provides context to PR reviewers, such as <code>Build:</code>, <code>Docs:</code>, <code>Spark:</code>, <code>Flink:</code>, <code>Core:</code>, <code>API:</code></li>
+<li>If a PR is related to an issue, adding <code>Closes #1234</code> in the PR description will automatically close the issue and helps keep the project clean</li>
+<li>If a PR is posted for visibility and isn’t necessarily ready for review or merging, be sure to convert the PR to a draft</li>
+</ul>
+<h2 id=building-the-project-locally>Building the Project Locally</h2>
+<p>Iceberg is built using Gradle with Java 8 or Java 11.</p>
+<ul>
+<li>To invoke a build and run tests: <code>./gradlew build</code></li>
+<li>To skip tests: <code>./gradlew build -x test -x integrationTest</code></li>
+</ul>
+<p>Iceberg table support is organized in library modules:</p>
+<ul>
+<li><code>iceberg-common</code> contains utility classes used in other modules</li>
+<li><code>iceberg-api</code> contains the public Iceberg API</li>
+<li><code>iceberg-core</code> contains implementations of the Iceberg API and support for Avro data files, <strong>this is what processing engines should depend on</strong></li>
+<li><code>iceberg-parquet</code> is an optional module for working with tables backed by Parquet files</li>
+<li><code>iceberg-arrow</code> is an optional module for reading Parquet into Arrow memory</li>
+<li><code>iceberg-orc</code> is an optional module for working with tables backed by ORC files</li>
+<li><code>iceberg-hive-metastore</code> is an implementation of Iceberg tables backed by the Hive metastore Thrift client</li>
+<li><code>iceberg-data</code> is an optional module for working with tables directly from JVM applications</li>
+</ul>
+<p>This project Iceberg also has modules for adding Iceberg support to processing engines:</p>
+<ul>
+<li><code>iceberg-spark2</code> is an implementation of Spark’s Datasource V2 API in 2.4 for Iceberg (use iceberg-spark-runtime for a shaded version)</li>
+<li><code>iceberg-spark3</code> is an implementation of Spark’s Datasource V2 API in 3.0 for Iceberg (use iceberg-spark3-runtime for a shaded version)</li>
+<li><code>iceberg-flink</code> contains classes for integrating with Apache Flink (use iceberg-flink-runtime for a shaded version)</li>
+<li><code>iceberg-mr</code> contains an InputFormat and other classes for integrating with Apache Hive</li>
+<li><code>iceberg-pig</code> is an implementation of Pig’s LoadFunc API for Iceberg</li>
+</ul>
+<h2 id=iceberg-code-contribution-guidelines>Iceberg Code Contribution Guidelines</h2>
+<h3 id=style>Style</h3>
+<p>For Java styling, check out the section
+<a href=https://iceberg.apache.org/community/#setting-up-ide-and-code-style>Setting up IDE and Code Style</a> from the
+documentation site.</p>
+<p>For Python, please use the tox command <code>tox -e format</code> to apply autoformatting to the project.</p>
+<h3 id=java-style-guidelines>Java style guidelines</h3>
+<h4 id=line-breaks>Line breaks</h4>
+<p>Continuation indents are 2 indents (4 spaces) from the start of the previous line.</p>
+<p>Try to break long lines at the same semantic level to make code more readable.</p>
+<ul>
+<li>Don’t use the same level of indentation for arguments to different methods</li>
+<li>Don’t use the same level of indentation for arguments and chained methods</li>
+</ul>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-java data-lang=java> <span style=color:#75715e>// BAD: hard to see arguments passed to the same method
+</span><span style=color:#75715e></span> doSomething<span style=color:#f92672>(</span><span style=color:#66d9ef>new</span> ArgumentClass<span style=color:#f92672>(</span>1<span style=color:#f92672>,</span>
+ 2<span style=color:#f92672>),</span>
+ 3<span style=color:#f92672>);</span>
+
+ <span style=color:#75715e>// GOOD: break lines at the same semantic level
+</span><span style=color:#75715e></span> doSomething<span style=color:#f92672>(</span>
+ <span style=color:#66d9ef>new</span> ArgumentClass<span style=color:#f92672>(</span>1<span style=color:#f92672>,</span> 2<span style=color:#f92672>),</span>
+ 3<span style=color:#f92672>);</span>
+
+ <span style=color:#75715e>// BAD: arguments and chained methods mixed
+</span><span style=color:#75715e></span> SomeObject myNewObject <span style=color:#f92672>=</span> SomeObject<span style=color:#f92672>.</span><span style=color:#a6e22e>builder</span><span style=color:#f92672>(</span>schema<span style=color:#f92672>,</span> partitionSpec<span style=color:#f92672>,</span>
+ sortOrder<span style=color:#f92672>)</span>
+ <span style=color:#f92672>.</span><span style=color:#a6e22e>withProperty</span><span style=color:#f92672>(</span><span style=color:#e6db74>"x"</span><span style=color:#f92672>,</span> <span style=color:#e6db74>"1"</span><span style=color:#f92672>)</span>
+ <span style=color:#f92672>.</span><span style=color:#a6e22e>build</span><span style=color:#f92672>()</span>
+
+ <span style=color:#75715e>// GOOD: method calls at the same level, arguments indented
+</span><span style=color:#75715e></span> SomeObject myNewObject <span style=color:#f92672>=</span> SomeObject
+ <span style=color:#f92672>.</span><span style=color:#a6e22e>builder</span><span style=color:#f92672>(</span>schema<span style=color:#f92672>,</span> partitionSpec<span style=color:#f92672>,</span>
+ sortOrder<span style=color:#f92672>)</span>
+ <span style=color:#f92672>.</span><span style=color:#a6e22e>withProperty</span><span style=color:#f92672>(</span><span style=color:#e6db74>"x"</span><span style=color:#f92672>,</span> <span style=color:#e6db74>"1"</span><span style=color:#f92672>)</span>
+ <span style=color:#f92672>.</span><span style=color:#a6e22e>build</span><span style=color:#f92672>()</span>
+</code></pre></div><h4 id=method-naming>Method naming</h4>
+<ol>
+<li>Make method names as short as possible, while being clear. Omit needless words.</li>
+<li>Avoid <code>get</code> in method names, unless an object must be a Java bean.
+<ul>
+<li>In most cases, replace <code>get</code> with a more specific verb that describes what is happening in the method, like <code>find</code> or <code>fetch</code>.</li>
+<li>If there isn’t a more specific verb or the method is a getter, omit <code>get</code> because it isn’t helpful to readers and makes method names longer.</li>
+</ul>
+</li>
+<li>Where possible, use words and conjugations that form correct sentences in English when read
+<ul>
+<li>For example, <code>Transform.preservesOrder()</code> reads correctly in an if statement: <code>if (transform.preservesOrder()) { ... }</code></li>
+</ul>
+</li>
+</ol>
+<h4 id=boolean-arguments>Boolean arguments</h4>
+<p>Avoid boolean arguments to methods that are not <code>private</code> to avoid confusing invocations like <code>sendMessage(false)</code>. It is better to create two methods with names and behavior, even if both are implemented by one internal method.</p>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-java data-lang=java> <span style=color:#75715e>// prefer exposing suppressFailure in method names
+</span><span style=color:#75715e></span> <span style=color:#66d9ef>public</span> <span style=color:#66d9ef>void</span> <span style=color:#a6e22e>sendMessageIgnoreFailure</span><span style=color:#f92672>()</span> <span style=color:#f92672>{</span>
+ sendMessageInternal<span style=color:#f92672>(</span><span style=color:#66d9ef>true</span><span style=color:#f92672>);</span>
+ <span style=color:#f92672>}</span>
+
+ <span style=color:#66d9ef>public</span> <span style=color:#66d9ef>void</span> <span style=color:#a6e22e>sendMessage</span><span style=color:#f92672>()</span> <span style=color:#f92672>{</span>
+ sendMessageInternal<span style=color:#f92672>(</span><span style=color:#66d9ef>false</span><span style=color:#f92672>);</span>
+ <span style=color:#f92672>}</span>
+
+ <span style=color:#66d9ef>private</span> <span style=color:#66d9ef>void</span> <span style=color:#a6e22e>sendMessageInternal</span><span style=color:#f92672>(</span><span style=color:#66d9ef>boolean</span> suppressFailure<span style=color:#f92672>)</span> <span style=color:#f92672>{</span>
+ <span style=color:#f92672>...</span>
+ <span style=color:#f92672>}</span>
+</code></pre></div><p>When passing boolean arguments to existing or external methods, use inline comments to help the reader understand actions without an IDE.</p>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-java data-lang=java> <span style=color:#75715e>// BAD: it is not clear what false controls
+</span><span style=color:#75715e></span> dropTable<span style=color:#f92672>(</span>identifier<span style=color:#f92672>,</span> <span style=color:#66d9ef>false</span><span style=color:#f92672>);</span>
+
+ <span style=color:#75715e>// GOOD: these uses of dropTable are clear to the reader
+</span><span style=color:#75715e></span> dropTable<span style=color:#f92672>(</span>identifier<span style=color:#f92672>,</span> <span style=color:#66d9ef>true</span> <span style=color:#75715e>/* purge data */</span><span style=color:#f92672>);</span>
+ dropTable<span style=color:#f92672>(</span>identifier<span style=color:#f92672>,</span> purge<span style=color:#f92672>);</span>
+</code></pre></div><h4 id=config-naming>Config naming</h4>
+<ol>
+<li>Use <code>-</code> to link words in one concept
+<ul>
+<li>For example, preferred convection <code>access-key-id</code> rather than <code>access.key.id</code></li>
+</ul>
+</li>
+<li>Use <code>.</code> to create a hierarchy of config groups
+<ul>
+<li>For example, <code>s3</code> in <code>s3.access-key-id</code>, <code>s3.secret-access-key</code></li>
+</ul>
+</li>
+</ol>
+<h2 id=website-and-documentation-updates>Website and Documentation Updates</h2>
+<p>Currently, there is an <a href=https://github.com/apache/iceberg-docs>iceberg-docs</a> repository
+which contains the HTML/CSS and other files needed for the <a href=https://iceberg.apache.org/>Iceberg website</a>.
+The <a href=https://github.com/apache/iceberg/tree/master/docs>docs folder</a> in the Iceberg repository contains
+the markdown content for the documentation site. All markdown changes should still be made
+to this repository.</p>
+<h3 id=submitting-pull-requests>Submitting Pull Requests</h3>
+<p>Changes to the markdown contents should be submitted directly to this repository.</p>
+<p>Changes to the website appearance (e.g. HTML, CSS changes) should be submitted to the <a href=https://github.com/apache/iceberg-docs>iceberg-docs repository</a> against the <code>main</code> branch.</p>
+<p>Changes to the documentation of old Iceberg versions should be submitted to the <a href=https://github.com/apache/iceberg-docs>iceberg-docs repository</a> against the specific version branch.</p>
+<h3 id=reporting-issues>Reporting Issues</h3>
+<p>All issues related to the doc website should still be submitted to the <a href=https://github.com/apache/iceberg>Iceberg repository</a>.
+The GitHub Issues feature of the <a href=https://github.com/apache/iceberg-docs>iceberg-docs repository</a> is disabled.</p>
+<h3 id=running-locally>Running Locally</h3>
+<p>Clone the <a href=https://github.com/apache/iceberg-docs>iceberg-docs</a> repository to run the website locally:</p>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-shell data-lang=shell>git clone git@github.com:apache/iceberg-docs.git
+cd iceberg-docs
+</code></pre></div><p>To start the landing page site locally, run:</p>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-shell data-lang=shell>cd landing-page <span style=color:#f92672>&&</span> hugo serve
+</code></pre></div><p>To start the documentation site locally, run:</p>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-shell data-lang=shell>cd docs <span style=color:#f92672>&&</span> hugo serve
+</code></pre></div><p>If you would like to see how the latest website looks based on the documentation in the Iceberg repository, you can copy docs to the iceberg-docs repository by:</p>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-shell data-lang=shell>rm -rf docs/content/docs
+rm -rf landing-page/content/common
+cp -r <path to iceberg repo>/docs/versioned docs/content/docs
+cp -r <path to iceberg repo>/docs/common landing-page/content/common
+</code></pre></div></div>
+</body>
+</html>
\ No newline at end of file
diff --git a/how-to-release/index.html b/how-to-release/index.html
index 505cf02..4f753a4 100644
--- a/how-to-release/index.html
+++ b/how-to-release/index.html
@@ -94,6 +94,9 @@ mavenPassword=SomePassword
<pre tabindex=0><code>signing.gnupg.keyName=Your Name (CODE SIGNING KEY)
</code></pre><p>To use <code>gpg</code> instead of <code>gpg2</code>, also set <code>signing.gnupg.executable=gpg</code></p>
<p>For more information, see the Gradle <a href=https://docs.gradle.org/current/userguide/signing_plugin.html#sec:signatory_credentials>signing documentation</a>.</p>
+<h3 id=apache-repository>Apache repository</h3>
+<p>The release should be executed against <code>https://github.com/apache/iceberg.git</code> instead of any fork.
+Set it as remote with name <code>apache</code> for release if it is not already set up.</p>
<h2 id=creating-a-release-candidate>Creating a release candidate</h2>
<h3 id=build-the-source-release>Build the source release</h3>
<p>To create the source release artifacts, run the <code>source-release.sh</code> script with the release version and release candidate number:</p>
@@ -238,6 +241,49 @@ This release can be downloaded from: https://www.apache.org/dyn/closer.cgi/icebe
Java artifacts are available from Maven Central.
Thanks to everyone for contributing!
+</code></pre></div><h3 id=documentation-release>Documentation Release</h3>
+<p>Documentation needs to be updated as a part of Iceberg release after a release candidate is passed.
+The commands described below assume the <code>iceberg-docs</code> repository and <code>iceberg</code> repository are in the same parent directory locally,
+and the release manager is executing commands in the <code>iceberg</code> repository.
+Adjust the commands accordingly if it is not the case.</p>
+<h4 id=iceberg-repository-preparations>iceberg repository preparations</h4>
+<p>A PR needs to be published in <code>iceberg</code> repository with the following changes:</p>
+<ol>
+<li>Mark the current latest release notes to past releases</li>
+<li>Update the latest artifact links in the release notes page</li>
+<li>Add release notes for the new release version</li>
+<li>Create new folder called <code>docs/versioned/releases/<VERSION NUMBER></code> with a <code>_index.md</code> file. See the existing folders under <code>docs/versioned/releases</code> for more details.</li>
+</ol>
+<h4 id=iceberg-docs-repository-preparations>iceberg-docs repository preparations</h4>
+<p>A PR needs to be published in <code>iceberg-docs</code> repository with the following changes:</p>
+<ol>
+<li>Update variable <code>latestVersions.iceberg</code> to the new release version in <code>landing-page/config.toml</code></li>
+<li>Update variable <code>latestVersions.iceberg</code> to the new release version in <code>docs/config.toml</code></li>
+</ol>
+<h4 id=documentation-update>Documentation update</h4>
+<p>To start the release process, run the following steps in the <code>iceberg-docs</code> repository to copy docs over:</p>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-shell data-lang=shell>rm -rf ../iceberg-docs/docs/content/docs
+rm -rf ../iceberg-docs/landing-page/content/common
+cp -r docs/versioned ../iceberg-docs/docs/content/docs
+cp -r docs/common ../iceberg-docs/landing-page/content/common
+</code></pre></div><p>The resulted changes in <code>iceberg-docs</code> should be approved in a separate PR.</p>
+<h4 id=javadoc-update>Javadoc update</h4>
+<p>In the <code>iceberg</code> repository, generate the javadoc for your release and copy it to the <code>javadoc</code> folder in <code>iceberg-docs</code> repo:</p>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-shell data-lang=shell>./gradlew refreshJavadoc
+rm -rf ../iceberg-docs/javadoc
+cp site/docs/javadoc/<VERSION NUMBER> ../iceberg-docs/javadoc
+</code></pre></div><p>This resulted changes in <code>iceberg-docs</code> should be approved in a separate PR.</p>
+<h4 id=cut-a-new-version-branch>Cut a new version branch</h4>
+<p>Once completed, go to the <code>iceberg-docs</code> repository to cut a new branch using the version number as the branch name.
+For example, to cut a new versioned doc for release <code>0.13.0</code>:</p>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-shell data-lang=shell>git checkout -b 0.13.0
+git push --set-upstream apache 0.13.0
+</code></pre></div><h4 id=update-the-latest-branch>Update the latest branch</h4>
+<p>The last step is to point the <code>latest</code> branch to the latest version.
+Because <code>main</code> is currently the same as the version branch, simply rebase <code>latest</code> branch against <code>main</code>:</p>
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-shell data-lang=shell>git checkout latest
+git rebase main
+git push apache latest
</code></pre></div></div>
</body>
</html>
\ No newline at end of file
diff --git a/how-to-verify-a-release/index.html b/how-to-verify-a-release/index.html
index 4b61271..16465bd 100644
--- a/how-to-verify-a-release/index.html
+++ b/how-to-verify-a-release/index.html
@@ -95,13 +95,13 @@ verify signatures, checksums, and documentation.</p>
<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>curl https://dist.apache.org/repos/dist/dev/iceberg/KEYS -o KEYS
gpg --import KEYS
</code></pre></div><p>Next, verify the <code>.asc</code> file.</p>
-<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>gpg --verify apache-iceberg-0.13.0.tar.gz.asc
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>gpg --verify apache-iceberg-0.13.1.tar.gz.asc
</code></pre></div><h3 id=verifying-checksums>Verifying Checksums</h3>
-<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>shasum -a <span style=color:#ae81ff>512</span> --check apache-iceberg-0.13.0.tar.gz.sha512
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>shasum -a <span style=color:#ae81ff>512</span> --check apache-iceberg-0.13.1.tar.gz.sha512
</code></pre></div><h3 id=verifying-license-documentation>Verifying License Documentation</h3>
<p>Untar the archive and change into the source directory.</p>
-<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>tar xzf apache-iceberg-0.13.0.tar.gz
-cd apache-iceberg-0.13.0
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>tar xzf apache-iceberg-0.13.1.tar.gz
+cd apache-iceberg-0.13.1
</code></pre></div><p>Run RAT checks to validate license headers.</p>
<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>dev/check-license
</code></pre></div><h3 id=verifying-build-and-test>Verifying Build and Test</h3>
@@ -134,7 +134,7 @@ Replace <code>${MAVEN_URL}</code> with the URL provided in the release announcem
spark-runtime jar for the Spark installation):</p>
<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>spark-shell <span style=color:#ae81ff>\
</span><span style=color:#ae81ff></span> --conf spark.jars.repositories<span style=color:#f92672>=</span><span style=color:#e6db74>${</span>MAVEN_URL<span style=color:#e6db74>}</span> <span style=color:#ae81ff>\
-</span><span style=color:#ae81ff></span> --packages org.apache.iceberg:iceberg-spark3-runtime:0.13.0 <span style=color:#ae81ff>\
+</span><span style=color:#ae81ff></span> --packages org.apache.iceberg:iceberg-spark3-runtime:0.13.1 <span style=color:#ae81ff>\
</span><span style=color:#ae81ff></span> --conf spark.sql.extensions<span style=color:#f92672>=</span>org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions <span style=color:#ae81ff>\
</span><span style=color:#ae81ff></span> --conf spark.sql.catalog.local<span style=color:#f92672>=</span>org.apache.iceberg.spark.SparkCatalog <span style=color:#ae81ff>\
</span><span style=color:#ae81ff></span> --conf spark.sql.catalog.local.type<span style=color:#f92672>=</span>hadoop <span style=color:#ae81ff>\
@@ -143,17 +143,17 @@ spark-runtime jar for the Spark installation):</p>
</span><span style=color:#ae81ff></span> --conf spark.sql.defaultCatalog<span style=color:#f92672>=</span>local
</code></pre></div><h3 id=verifying-with-flink>Verifying with Flink</h3>
<p>To verify using Flink, start a Flink SQL Client with the following command:</p>
-<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>wget <span style=color:#e6db74>${</span>MAVEN_URL<span style=color:#e6db74>}</span>/iceberg-flink-runtime/0.13.0/iceberg-flink-runtime-0.13.0.jar
+<div class=highlight><pre tabindex=0 style=color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4><code class=language-bash data-lang=bash>wget <span style=color:#e6db74>${</span>MAVEN_URL<span style=color:#e6db74>}</span>/iceberg-flink-runtime/0.13.1/iceberg-flink-runtime-0.13.1.jar
sql-client.sh embedded <span style=color:#ae81ff>\
-</span><span style=color:#ae81ff></span> -j iceberg-flink-runtime-0.13.0.jar <span style=color:#ae81ff>\
+</span><span style=color:#ae81ff></span> -j iceberg-flink-runtime-0.13.1.jar <span style=color:#ae81ff>\
</span><span style=color:#ae81ff></span> -j <span style=color:#e6db74>${</span>FLINK_CONNECTOR_PACKAGE<span style=color:#e6db74>}</span>-<span style=color:#e6db74>${</span>HIVE_VERSION<span style=color:#e6db74>}</span>_<span style=color:#e6db74>${</span>SCALA_VERSION<span style=color:#e6db74>}</span>-<span style=color:#e6db74>${</span>FLINK_VERSION<span style=color:#e6db74>}</span>.jar <span style=color:#ae81ff>\
</span><span style=color:#ae81ff></span> shell
</code></pre></div><h2 id=voting>Voting</h2>
<p>Votes are cast by replying to the release candidate announcement email on the dev mailing list
with either <code>+1</code>, <code>0</code>, or <code>-1</code>.</p>
<blockquote>
-<p>[ ] +1 Release this as Apache Iceberg 0.13.0
+<p>[ ] +1 Release this as Apache Iceberg 0.13.1
[ ] +0
[ ] -1 Do not release this because…</p>
</blockquote>
diff --git a/index.xml b/index.xml
index ebda09f..786882e 100644
--- a/index.xml
+++ b/index.xml
@@ -1,17 +1,18 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Iceberg</title><link>https://iceberg.apache.org/</link><description>Recent content on Apache Iceberg</description><generator>Hugo -- gohugo.io</generator><language>en-us</language><atom:link href="https://iceberg.apache.org/index.xml" rel="self" type="application/rss+xml"/><item><title>Expressive SQL</title><link>https://iceberg.apache.org/services/exp [...]
-Community discussions happen primarily on the dev mailing list, on apache-iceberg Slack workspace, and on specific GitHub issues.
-Contributing The Iceberg Project is hosted on Github at https://github.com/apache/iceberg.
-The Iceberg community prefers to receive contributions as Github pull requests.
-View open pull requests Learn about pull requests Issues Issues are tracked in GitHub:</description></item><item><title/><link>https://iceberg.apache.org/blogs/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/blogs/</guid><description>Iceberg Blogs Here is a list of company blogs that talk about Iceberg. The blogs are ordered from most recent to oldest.
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Iceberg</title><link>https://iceberg.apache.org/</link><description>Recent content on Apache Iceberg</description><generator>Hugo -- gohugo.io</generator><language>en-us</language><atom:link href="https://iceberg.apache.org/index.xml" rel="self" type="application/rss+xml"/><item><title>Expressive SQL</title><link>https://iceberg.apache.org/services/exp [...]
+0.13.1 source tar.gz &ndash; signature &ndash; sha512 0.13.1 Spark 3.2 runtime Jar 0.13.1 Spark 3.1 runtime Jar 0.13.1 Spark 3.0 runtime Jar 0.13.1 Spark 2.4 runtime Jar 0.13.1 Flink 1.14 runtime Jar 0.13.1 Flink 1.13 runtime Jar 0.13.1 Flink 1.12 runtime Jar 0.13.1 Hive runtime Jar To use Iceberg in Spark or Flink, download the runtime JAR for your engine version and add it to the jars folder of your installation.</description></item><item><title/><link>https://iceberg.apache.or [...]
Docker, Spark, and Iceberg: The Fastest Way to Try Iceberg! Date: February 2nd, 2022, Company: Tabular
Author: Sam Redai, Kyle Bendickson
Iceberg FileIO: Cloud Native Tables Date: December 16th, 2021, Company: Tabular
Author: Daniel Weeks
-Using Spark in EMR with Apache Iceberg Date: December 10th, 2021, Company: Tabular</description></item><item><title/><link>https://iceberg.apache.org/talks/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/talks/</guid><description>Iceberg Talks Here is a list of talks and other videos related to Iceberg.
+Using Spark in EMR with Apache Iceberg Date: December 10th, 2021, Company: Tabular</description></item><item><title/><link>https://iceberg.apache.org/contribute/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/contribute/</guid><description>Contributing In this page, you will find some guidelines on contributing to Apache Iceberg. Please keep in mind that none of these are hard rules and they&rsquo;re meant as a collection of helpful suggestio [...]
+If you are thinking of contributing but first would like to discuss the change you wish to make, we welcome you to head over to the Community page on the official Iceberg documentation site to find a number of ways to connect with the community, including slack and our mailing lists.</description></item><item><title/><link>https://iceberg.apache.org/community/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/community/</guid><description>Welcome! A [...]
+Community discussions happen primarily on the dev mailing list, on apache-iceberg Slack workspace, and on specific GitHub issues.
+Contribute See Contributing for more details on how to contribute to Iceberg.
+Issues Issues are tracked in GitHub:
+View open issues Open a new issue Slack We use the Apache Iceberg workspace on Slack. To be invited, follow this invite link.</description></item><item><title/><link>https://iceberg.apache.org/talks/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/talks/</guid><description>Iceberg Talks Here is a list of talks and other videos related to Iceberg.
Expert Roundtable: The Future of Metadata After Hive Metastore Date: November 15, 2021, Authors: Lior Ebel, Seshu Adunuthula, Ryan Blue &amp; Oz Katz
Spark and Iceberg at Apple&rsquo;s Scale - Leveraging differential files for efficient upserts and deletes Date: October 21, 2020, Author: Anton
-Apache Iceberg - A Table Format for Huge Analytic Datasets Date: October 21, 2020, Author: Ryan Blue</description></item><item><title/><link>https://iceberg.apache.org/releases/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/releases/</guid><description>Downloads The latest version of Iceberg is 0.13.0.
-0.13.0 source tar.gz &ndash; signature &ndash; sha512 0.13.0 Spark 3.2 runtime Jar 0.13.0 Spark 3.1 runtime Jar 0.13.0 Spark 3.0 runtime Jar 0.13.0 Spark 2.4 runtime Jar 0.13.0 Flink 1.14 runtime Jar 0.13.0 Flink 1.13 runtime Jar 0.13.0 Flink 1.12 runtime Jar 0.13.0 Hive runtime Jar To use Iceberg in Spark or Flink, download the runtime JAR for your engine version and add it to the jars folder of your installation.</description></item><item><title/><link>https://iceberg.apache.or [...]
+Apache Iceberg - A Table Format for Huge Analytic Datasets Date: October 21, 2020, Author: Ryan Blue</description></item><item><title/><link>https://iceberg.apache.org/spec/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/spec/</guid><description>Iceberg Table Spec This is a specification for the Iceberg table format that is designed to manage a large, slow-changing collection of files in a distributed file system or key-value store as a table.
Format Versioning Versions 1 and 2 of the Iceberg spec are complete and adopted by the community.
The format version number is incremented when new features are added that will break forward-compatibility&mdash;that is, when older readers would not read newer table features correctly.</description></item><item><title/><link>https://iceberg.apache.org/terms/</link><pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate><guid>https://iceberg.apache.org/terms/</guid><description>Terms Snapshot A snapshot is the state of a table at some time.
Each snapshot lists all of the data files that make up the table&rsquo;s contents at the time of the snapshot. Data files are stored across multiple manifest files, and the manifests for a snapshot are listed in a single manifest list file.
diff --git a/multi-engine-support/index.html b/multi-engine-support/index.html
index 21db4d2..4375963 100644
--- a/multi-engine-support/index.html
+++ b/multi-engine-support/index.html
@@ -84,7 +84,7 @@ By doing this, changes across versions are isolated.
New features in Iceberg could be developed against the latest features of an engine without breaking support of old APIs in past engine versions.</p>
<p>For Hive, Hive 2 uses the <code>iceberg-mr</code> package for Iceberg integration, and Hive 3 requires an additional dependency of the <code>iceberg-hive3</code> package.</p>
<h3 id=runtime-jar>Runtime Jar</h3>
-<p>Iceberg provides a runtime connector Jar for each supported version of Spark, Flink and Hive.
+<p>Iceberg provides a runtime connector jar for each supported version of Spark, Flink and Hive.
When using Iceberg with these engines, the runtime jar is the only addition to the classpath needed in addition to vendor dependencies.
For example, to use Iceberg with Spark 3.2 and AWS integrations, <code>iceberg-spark-runtime-3.2_2.12</code> and AWS SDK dependencies are needed for the Spark installation.</p>
<p>Spark and Flink provide different runtime jars for each supported engine version.
@@ -100,38 +100,51 @@ The runtime jar names and latest version download links are listed in <a href=./
</ol>
<h2 id=current-engine-version-lifecycle-status>Current Engine Version Lifecycle Status</h2>
<h3 id=apache-spark>Apache Spark</h3>
-<p>Note that Spark 2.4 and 3.0 artifact names do not comply to the naming convention of later versions for backwards compatibility.</p>
<table>
<thead>
<tr>
<th>Version</th>
<th>Lifecycle Stage</th>
-<th>Runtime Artifact</th>
+<th>Initial Iceberg Support</th>
+<th>Latest Iceberg Support</th>
+<th>Latest Runtime Jar</th>
</tr>
</thead>
<tbody>
<tr>
<td>2.4</td>
<td>Deprecated</td>
-<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime/0.13.0/iceberg-spark-runtime-0.13.0.jar">iceberg-spark-runtime</a></td>
+<td>0.7.0-incubating</td>
+<td>0.13.1</td>
+<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime/0.13.1/iceberg-spark-runtime-0.13.1.jar">iceberg-spark-runtime</a></td>
</tr>
<tr>
<td>3.0</td>
<td>Maintained</td>
-<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark3-runtime/0.13.0/iceberg-spark3-runtime-0.13.0.jar">iceberg-spark3-runtime</a></td>
+<td>0.9.0</td>
+<td>0.13.1</td>
+<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark3-runtime/0.13.1/iceberg-spark3-runtime-0.13.1.jar">iceberg-spark3-runtime</a> [1]</td>
</tr>
<tr>
<td>3.1</td>
<td>Maintained</td>
-<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime-3.1_2.12/0.13.0/iceberg-spark-runtime-3.1_2.12-0.13.0.jar">iceberg-spark-runtime-3.1_2.12</a></td>
+<td>0.12.0</td>
+<td>0.13.1</td>
+<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime-3.1_2.12/0.13.1/iceberg-spark-runtime-3.1_2.12-0.13.1.jar">iceberg-spark-runtime-3.1_2.12</a> [2]</td>
</tr>
<tr>
<td>3.2</td>
<td>Maintained</td>
-<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime-3.2_2.12/0.13.0/iceberg-spark-runtime-3.2_2.12-0.13.0.jar">iceberg-spark-runtime-3.2_2.12</a></td>
+<td>0.13.0</td>
+<td>0.13.1</td>
+<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime-3.2_2.12/0.13.1/iceberg-spark-runtime-3.2_2.12-0.13.1.jar">iceberg-spark-runtime-3.2_2.12</a></td>
</tr>
</tbody>
</table>
+<ul>
+<li>[1] Spark 2.4 and 3.0 jar names do not follow the naming convention of newer versions for backwards compatibility</li>
+<li>[2] Spark 3.1 shares the same runtime jar <code>iceberg-spark3-runtime</code> with Spark 3.0 before Iceberg 0.13.0</li>
+</ul>
<h3 id=apache-flink>Apache Flink</h3>
<p>Based on the guideline of the Flink community, only the latest 2 minor versions are actively maintained.
Users should continuously upgrade their Flink version to stay up-to-date.</p>
@@ -140,27 +153,45 @@ Users should continuously upgrade their Flink version to stay up-to-date.</p>
<tr>
<th>Version</th>
<th>Lifecycle Stage</th>
-<th>Runtime Artifact</th>
+<th>Initial Iceberg Support</th>
+<th>Latest Iceberg Support</th>
+<th>Latest Runtime Jar</th>
</tr>
</thead>
<tbody>
<tr>
+<td>1.11</td>
+<td>End of Life</td>
+<td>0.9.0</td>
+<td>0.12.1</td>
+<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime/0.12.1/iceberg-flink-runtime-0.12.1.jar">iceberg-flink-runtime</a></td>
+</tr>
+<tr>
<td>1.12</td>
<td>Deprecated</td>
-<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.12/0.13.0/iceberg-flink-runtime-1.12-0.13.0.jar">iceberg-flink-runtime-1.12</a></td>
+<td>0.12.0</td>
+<td>0.13.1</td>
+<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.12/0.13.1/iceberg-flink-runtime-1.12-0.13.1.jar">iceberg-flink-runtime-1.12</a> [3]</td>
</tr>
<tr>
<td>1.13</td>
<td>Maintained</td>
-<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.13/0.13.0/iceberg-flink-runtime-1.13-0.13.0.jar">iceberg-flink-runtime-1.13</a></td>
+<td>0.13.0</td>
+<td>0.13.1</td>
+<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.13/0.13.1/iceberg-flink-runtime-1.13-0.13.1.jar">iceberg-flink-runtime-1.13</a></td>
</tr>
<tr>
<td>1.14</td>
<td>Maintained</td>
-<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.14/0.13.0/iceberg-flink-runtime-1.14-0.13.0.jar">iceberg-flink-runtime-1.14</a></td>
+<td>0.13.0</td>
+<td>0.13.1</td>
+<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.14/0.13.1/iceberg-flink-runtime-1.14-0.13.1.jar">iceberg-flink-runtime-1.14</a></td>
</tr>
</tbody>
</table>
+<ul>
+<li>[3] Flink 1.12 shares the same runtime jar <code>iceberg-flink-runtime</code> with Flink 1.11 before Iceberg 0.13.0</li>
+</ul>
<h3 id=apache-hive>Apache Hive</h3>
<table>
<thead>
@@ -168,7 +199,9 @@ Users should continuously upgrade their Flink version to stay up-to-date.</p>
<th>Version</th>
<th>Recommended minor version</th>
<th>Lifecycle Stage</th>
-<th>Runtime Artifact</th>
+<th>Initial Iceberg Support</th>
+<th>Latest Iceberg Support</th>
+<th>Latest Runtime Jar</th>
</tr>
</thead>
<tbody>
@@ -176,13 +209,17 @@ Users should continuously upgrade their Flink version to stay up-to-date.</p>
<td>2</td>
<td>2.3.8</td>
<td>Maintained</td>
-<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-hive-runtime/0.13.0/iceberg-hive-runtime-0.13.0.jar">iceberg-hive-runtime</a></td>
+<td>0.8.0-incubating</td>
+<td>0.13.1</td>
+<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-hive-runtime/0.13.1/iceberg-hive-runtime-0.13.1.jar">iceberg-hive-runtime</a></td>
</tr>
<tr>
<td>3</td>
<td>3.1.2</td>
<td>Maintained</td>
-<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-hive-runtime/0.13.0/iceberg-hive-runtime-0.13.0.jar">iceberg-hive-runtime</a></td>
+<td>0.10.0</td>
+<td>0.13.1</td>
+<td><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-hive-runtime/0.13.1/iceberg-hive-runtime-0.13.1.jar">iceberg-hive-runtime</a></td>
</tr>
</tbody>
</table>
diff --git a/releases/index.html b/releases/index.html
index 9b688fd..adb97f9 100644
--- a/releases/index.html
+++ b/releases/index.html
@@ -72,24 +72,24 @@
<body dir=" ltr">
<div class=markdown-body>
<h2 id=downloads>Downloads</h2>
-<p>The latest version of Iceberg is <a href=https://github.com/apache/iceberg/releases/tag/apache-iceberg-0.13.0>0.13.0</a>.</p>
-<ul>
-<li><a href=https://www.apache.org/dyn/closer.cgi/iceberg/apache-iceberg-0.13.0/apache-iceberg-0.13.0.tar.gz>0.13.0 source tar.gz</a> – <a href=https://downloads.apache.org/iceberg/apache-iceberg-0.13.0/apache-iceberg-0.13.0.tar.gz.asc>signature</a> – <a href=https://downloads.apache.org/iceberg/apache-iceberg-0.13.0/apache-iceberg-0.13.0.tar.gz.sha512>sha512</a></li>
-<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime-3.2_2.12/0.13.0/iceberg-spark-runtime-3.2_2.12-0.13.0.jar">0.13.0 Spark 3.2 runtime Jar</a></li>
-<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime-3.1_2.12/0.13.0/iceberg-spark-runtime-3.1_2.12-0.13.0.jar">0.13.0 Spark 3.1 runtime Jar</a></li>
-<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark3-runtime/0.13.0/iceberg-spark3-runtime-0.13.0.jar">0.13.0 Spark 3.0 runtime Jar</a></li>
-<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime/0.13.0/iceberg-spark-runtime-0.13.0.jar">0.13.0 Spark 2.4 runtime Jar</a></li>
-<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.14/0.13.0/iceberg-flink-runtime-1.14-0.13.0.jar">0.13.0 Flink 1.14 runtime Jar</a></li>
-<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.13/0.13.0/iceberg-flink-runtime-1.13-0.13.0.jar">0.13.0 Flink 1.13 runtime Jar</a></li>
-<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.12/0.13.0/iceberg-flink-runtime-1.12-0.13.0.jar">0.13.0 Flink 1.12 runtime Jar</a></li>
-<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-hive-runtime/0.13.0/iceberg-hive-runtime-0.13.0.jar">0.13.0 Hive runtime Jar</a></li>
+<p>The latest version of Iceberg is <a href=https://github.com/apache/iceberg/releases/tag/apache-iceberg-0.13.1>0.13.1</a>.</p>
+<ul>
+<li><a href=https://www.apache.org/dyn/closer.cgi/iceberg/apache-iceberg-0.13.1/apache-iceberg-0.13.1.tar.gz>0.13.1 source tar.gz</a> – <a href=https://downloads.apache.org/iceberg/apache-iceberg-0.13.1/apache-iceberg-0.13.1.tar.gz.asc>signature</a> – <a href=https://downloads.apache.org/iceberg/apache-iceberg-0.13.1/apache-iceberg-0.13.1.tar.gz.sha512>sha512</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime-3.2_2.12/0.13.1/iceberg-spark-runtime-3.2_2.12-0.13.1.jar">0.13.1 Spark 3.2 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime-3.1_2.12/0.13.1/iceberg-spark-runtime-3.1_2.12-0.13.1.jar">0.13.1 Spark 3.1 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark3-runtime/0.13.1/iceberg-spark3-runtime-0.13.1.jar">0.13.1 Spark 3.0 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime/0.13.1/iceberg-spark-runtime-0.13.1.jar">0.13.1 Spark 2.4 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.14/0.13.1/iceberg-flink-runtime-1.14-0.13.1.jar">0.13.1 Flink 1.14 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.13/0.13.1/iceberg-flink-runtime-1.13-0.13.1.jar">0.13.1 Flink 1.13 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.12/0.13.1/iceberg-flink-runtime-1.12-0.13.1.jar">0.13.1 Flink 1.12 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-hive-runtime/0.13.1/iceberg-hive-runtime-0.13.1.jar">0.13.1 Hive runtime Jar</a></li>
</ul>
<p>To use Iceberg in Spark or Flink, download the runtime JAR for your engine version and add it to the jars folder of your installation.</p>
<p>To use Iceberg in Hive 2 or Hive 3, download the Hive runtime JAR and add it to Hive using <code>ADD JAR</code>.</p>
<h3 id=gradle>Gradle</h3>
<p>To add a dependency on Iceberg in Gradle, add the following to <code>build.gradle</code>:</p>
<pre tabindex=0><code>dependencies {
- compile 'org.apache.iceberg:iceberg-core:0.13.0'
+ compile 'org.apache.iceberg:iceberg-core:0.13.1'
}
</code></pre><p>You may also want to include <code>iceberg-parquet</code> for Parquet file support.</p>
<h3 id=maven>Maven</h3>
@@ -99,12 +99,46 @@
<dependency>
<groupId>org.apache.iceberg</groupId>
<artifactId>iceberg-core</artifactId>
- <version>0.13.0</version>
+ <version>0.13.1</version>
</dependency>
...
</dependencies>
-</code></pre><h2 id=0130-release-notes>0.13.0 Release Notes</h2>
+</code></pre><h2 id=0131-release-notes>0.13.1 Release Notes</h2>
+<p>Apache Iceberg 0.13.1 was released on February 14th, 2022.</p>
+<p><strong>Important bug fixes:</strong></p>
+<ul>
+<li>
+<p><strong>Spark</strong></p>
+<ul>
+<li><a href=https://github.com/apache/iceberg/pull/4023>#4023</a> fixes predicate pushdown in row-level operations for merge conditions in Spark 3.2.
+Prior to the fix, filters would not be extracted and targeted merge conditions were not pushed down leading to degraded performance
+for these targeted merge operations.</li>
+<li><a href=https://github.com/apache/iceberg/pull/4024>#4024</a> fixes table creation in the root namespace of a Hadoop Catalog.</li>
+</ul>
+</li>
+<li>
+<p><strong>Flink</strong></p>
+<ul>
+<li><a href=https://github.com/apache/iceberg/pull/3986>#3986</a> fixes manifest location collisions when there are multiple committers
+in the same Flink job.</li>
+</ul>
+</li>
+</ul>
+<h2 id=past-releases>Past releases</h2>
+<h3 id=0130-release-notes>0.13.0 Release Notes</h3>
<p>Apache Iceberg 0.13.0 was released on February 4th, 2022.</p>
+<ul>
+<li>Git tag: <a href=https://github.com/apache/iceberg/releases/tag/apache-iceberg-0.13.0>0.13.0</a></li>
+<li><a href=https://www.apache.org/dyn/closer.cgi/iceberg/apache-iceberg-0.13.0/apache-iceberg-0.13.0.tar.gz>0.13.0 source tar.gz</a> – <a href=https://downloads.apache.org/iceberg/apache-iceberg-0.13.0/apache-iceberg-0.13.0.tar.gz.asc>signature</a> – <a href=https://downloads.apache.org/iceberg/apache-iceberg-0.13.0/apache-iceberg-0.13.0.tar.gz.sha512>sha512</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime-3.2_2.12/0.13.0/iceberg-spark-runtime-3.2_2.12-0.13.0.jar">0.13.0 Spark 3.2 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime-3.1_2.12/0.13.0/iceberg-spark-runtime-3.1_2.12-0.13.0.jar">0.13.0 Spark 3.1 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark3-runtime/0.13.0/iceberg-spark3-runtime-0.13.0.jar">0.13.0 Spark 3.0 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-spark-runtime/0.13.0/iceberg-spark-runtime-0.13.0.jar">0.13.0 Spark 2.4 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.14/0.13.0/iceberg-flink-runtime-1.14-0.13.0.jar">0.13.0 Flink 1.14 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.13/0.13.0/iceberg-flink-runtime-1.13-0.13.0.jar">0.13.0 Flink 1.13 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-flink-runtime-1.12/0.13.0/iceberg-flink-runtime-1.12-0.13.0.jar">0.13.0 Flink 1.12 runtime Jar</a></li>
+<li><a href="https://search.maven.org/remotecontent?filepath=org/apache/iceberg/iceberg-hive-runtime/0.13.0/iceberg-hive-runtime-0.13.0.jar">0.13.0 Hive runtime Jar</a></li>
+</ul>
<p><strong>High-level features:</strong></p>
<ul>
<li><strong>Core</strong>
@@ -202,7 +236,6 @@
<ul>
<li>The community has finalized the long-term strategy of Spark, Flink and Hive support. See <a href=../multi-engine-support>Multi-Engine Support</a> page for more details.</li>
</ul>
-<h2 id=past-releases>Past releases</h2>
<h3 id=0121>0.12.1</h3>
<p>Apache Iceberg 0.12.1 was released on November 8th, 2021.</p>
<ul>
diff --git a/sitemap.xml b/sitemap.xml
index ce2b4db..82d19d0 100644
--- a/sitemap.xml
+++ b/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>https://iceberg.apache.org/services/expressive-sql/</loc></url><url><loc>https://iceberg.apache.org/services/schema-evolution/</loc></url><url><loc>https://iceberg.apache.org/services/hidden-partitioning/</loc></url><url><loc>https://iceberg.apache.org/services/time-travel/</loc></url><url><loc>https://iceberg.apache.org/s [...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>https://iceberg.apache.org/services/expressive-sql/</loc></url><url><loc>https://iceberg.apache.org/services/schema-evolution/</loc></url><url><loc>https://iceberg.apache.org/services/hidden-partitioning/</loc></url><url><loc>https://iceberg.apache.org/services/time-travel/</loc></url><url><loc>https://iceberg.apache.org/s [...]
\ No newline at end of file
diff --git a/spec/index.html b/spec/index.html
index bf37d47..3825b5c 100644
--- a/spec/index.html
+++ b/spec/index.html
@@ -1347,7 +1347,7 @@ Retention policy can be configured both globally and on snapshot reference throu
</ol>
<p>Notes:</p>
<ol>
-<li>The file system table scheme is implemented in <a href=../../../javadoc/0.13.0/index.html?org/apache/iceberg/hadoop/HadoopTableOperations.html>HadoopTableOperations</a>.</li>
+<li>The file system table scheme is implemented in <a href=../../../javadoc/0.13.1/index.html?org/apache/iceberg/hadoop/HadoopTableOperations.html>HadoopTableOperations</a>.</li>
</ol>
<h4 id=metastore-tables>Metastore Tables</h4>
<p>The atomic swap needed to commit new versions of table metadata can be implemented by storing a pointer in a metastore or database that is updated with a check-and-put operation [1]. The check-and-put validates that the version of the table that a write is based on is still current and then makes the new metadata from the write the current version.</p>
@@ -1364,7 +1364,7 @@ Retention policy can be configured both globally and on snapshot reference throu
</ol>
<p>Notes:</p>
<ol>
-<li>The metastore table scheme is partly implemented in <a href=../../../javadoc/0.13.0/index.html?org/apache/iceberg/BaseMetastoreTableOperations.html>BaseMetastoreTableOperations</a>.</li>
+<li>The metastore table scheme is partly implemented in <a href=../../../javadoc/0.13.1/index.html?org/apache/iceberg/BaseMetastoreTableOperations.html>BaseMetastoreTableOperations</a>.</li>
</ol>
<h3 id=delete-formats>Delete Formats</h3>
<p>This section details how to encode row-level deletes in Iceberg delete files. Row-level deletes are not supported in v1.</p>