You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2020/01/23 23:38:32 UTC
[beam] branch asf-site updated: Publishing website 2020/01/23
23:38:25 at commit b3a0364
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new a5a906a Publishing website 2020/01/23 23:38:25 at commit b3a0364
a5a906a is described below
commit a5a906a3586d734767124fd102b7874361d7667f
Author: jenkins <bu...@apache.org>
AuthorDate: Thu Jan 23 23:38:25 2020 +0000
Publishing website 2020/01/23 23:38:25 at commit b3a0364
---
.../2020/01/13/beam-2.18.0.html} | 329 ++++++++-------------
website/generated-content/blog/index.html | 32 ++
.../contribute/release-guide/index.html | 4 +-
website/generated-content/feed.xml | 218 ++++++++------
website/generated-content/index.html | 10 +-
5 files changed, 292 insertions(+), 301 deletions(-)
diff --git a/website/generated-content/index.html b/website/generated-content/blog/2020/01/13/beam-2.18.0.html
similarity index 50%
copy from website/generated-content/index.html
copy to website/generated-content/blog/2020/01/13/beam-2.18.0.html
index 3a7204b..cdbc5a1 100644
--- a/website/generated-content/index.html
+++ b/website/generated-content/blog/2020/01/13/beam-2.18.0.html
@@ -28,9 +28,8 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Apache Beam</title>
- <meta name="description" content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow [...]
-">
+ <title>Apache Beam 2.18.0</title>
+ <meta name="description" content="We are happy to present the new 2.18.0 release of Beam. This release includes both improvements and new functionality.See the download page for this release.">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400" rel="stylesheet">
<link rel="stylesheet" href="/css/site.css">
<script src="https://code.jquery.com/jquery-2.2.4.min.js"></script>
@@ -42,7 +41,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical" href="https://beam.apache.org/" data-proofer-ignore>
+ <link rel="canonical" href="https://beam.apache.org/blog/2020/01/13/beam-2.18.0.html" data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam" href="https://beam.apache.org/feed.xml">
<link rel="stylesheet" href="https://use.fontawesome.com/releases/v5.4.1/css/all.css" integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous">
@@ -56,7 +55,7 @@
</script>
</head>
- <body class="body body--index">
+ <body class="body ">
<!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
@@ -144,7 +143,7 @@
GitHub links will not resolve until the markdown source is available on the master branch.
New pages would fail validation during development / PR test automation.
-->
- <a href="https://github.com/apache/beam/edit/master/website/src/index.md" data-proofer-ignore>
+ <a href="https://github.com/apache/beam/edit/master/website/src/_posts/2020-01-13-beam-2.18.0.md" data-proofer-ignore>
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on GitHub"></i>
</a>
</li>
@@ -154,6 +153,31 @@
<div class="body__contained">
<!--
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+ http://www.apache.org/licenses/LICENSE-2.0
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+
+
+<article class="post" itemscope itemtype="http://schema.org/BlogPosting">
+
+ <header class="post-header">
+ <h1 class="post-title" itemprop="name headline">Apache Beam 2.18.0</h1>
+ <p class="post-meta"><time datetime="2020-01-23T00:00:01-08:00" itemprop="datePublished">Jan 23, 2020</time> •
+ Udi Meiri [<a href="https://twitter.com/udim">@udim</a>] & Ahmet Altay
+
+ </p>
+ </header>
+
+ <div class="post-content" itemprop="articleBody">
+ <!--
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
@@ -166,207 +190,110 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<div class="hero-bg">
- <div class="hero section">
- <div class="hero__cols">
- <div class="hero__cols__col">
- <div class="hero__cols__col__content">
- <div class="hero__title">
- Apache Beam: An advanced unified programming model
- </div>
- <div class="hero__subtitle">
- Implement batch and streaming data processing jobs that run on any execution engine.
- </div>
- <div class="hero__ctas hero__ctas--first">
- <a class="button button--primary" href="/get-started/beam-overview/">Learn more</a>
- <a class="button button--primary" href="/get-started/try-apache-beam/">Try Beam</a>
- <a class="button button--primary" href="/get-started/downloads/">Download Beam SDK 2.18.0</a>
- </div>
- <div class="hero__ctas">
- <a class="button" href="/get-started/quickstart-java/">Java Quickstart</a>
- <a class="button" href="/get-started/quickstart-py/">Python Quickstart</a>
- <a class="button" href="/get-started/quickstart-go/">Go Quickstart</a>
- </div>
- </div>
- </div>
- <div class="hero__cols__col">
- <div class="hero__blog">
- <div class="hero__blog__title">
- The latest from the blog
- </div>
- <div class="hero__blog__cards">
-
- <a class="hero__blog__cards__card" href="/blog/2020/01/06/beam-2.17.0.html">
- <div class="hero__blog__cards__card__title">Apache Beam 2.17.0</div>
- <div class="hero__blog__cards__card__date">Jan 6, 2020</div>
- </a>
-
- <a class="hero__blog__cards__card" href="/blog/2019/10/07/beam-2.16.0.html">
- <div class="hero__blog__cards__card__title">Apache Beam 2.16.0</div>
- <div class="hero__blog__cards__card__date">Oct 7, 2019</div>
- </a>
-
- <a class="hero__blog__cards__card" href="/blog/2019/09/04/gsoc-19.html">
- <div class="hero__blog__cards__card__title">Google Summer of Code '19</div>
- <div class="hero__blog__cards__card__date">Sep 4, 2019</div>
- </a>
-
- </div>
- </div>
- </div>
- </div>
- </div>
-</div>
-<div class="pillars section">
- <div class="pillars__title">
- All about Apache Beam
- </div>
- <div class="pillars__cols">
-
- <div class="pillars__cols__col">
- <div class="pillars__cols__col__title">
- Unified
- </div>
- <div class="pillars__cols__col__body">
- Use a single programming model for both batch and streaming use cases.
- </div>
- </div>
-
- <div class="pillars__cols__col">
- <div class="pillars__cols__col__title">
- Portable
- </div>
- <div class="pillars__cols__col__body">
- Execute pipelines on multiple execution environments.
- </div>
- </div>
-
- <div class="pillars__cols__col">
- <div class="pillars__cols__col__title">
- Extensible
- </div>
- <div class="pillars__cols__col__body">
- Write and share new SDKs, IO connectors, and transformation libraries.
- </div>
- </div>
-
- </div>
-</div>
+<p>We are happy to present the new 2.18.0 release of Beam. This release includes both improvements and new functionality.
+See the <a href="/get-started/downloads/#2180-2020-01-23">download page</a> for this release.<!--more-->
+For more information on changes in 2.18.0, check out the
+<a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346383&projectId=12319527">detailed release notes</a>.</p>
-<div class="graphic section">
-<div class="graphic__image">
-<img src="/images/beam_architecture.png" alt="Beam architecture" />
-</div>
-</div>
+<h2 id="highlights">Highlights</h2>
-<div class="logos section">
- <div class="logos__title">
- Works with
- </div>
- <div class="logos__logos">
-
- <div class="logos__logos__logo">
- <a href="http://apex.apache.org"><img src="/images/logo_apex.png" alt="APEX" /></a>
- </div>
-
- <div class="logos__logos__logo">
- <a href="http://flink.apache.org"><img src="/images/logo_flink.png" alt="Flink" /></a>
- </div>
-
- <div class="logos__logos__logo">
- <a href="http://spark.apache.org/"><img src="/images/logo_spark.png" alt="Spark" /></a>
- </div>
-
- <div class="logos__logos__logo">
- <a href="https://cloud.google.com/dataflow/"><img src="/images/logo_google_cloud.png" alt="Google Cloud Dataflow" /></a>
- </div>
-
- <div class="logos__logos__logo">
- <a href="http://gearpump.apache.org/"><img src="/images/logo_gearpump.png" alt="Gearpump" /></a>
- </div>
-
- <div class="logos__logos__logo">
- <a href="http://samza.apache.org/"><img src="/images/logo_samza.png" alt="Samza" /></a>
- </div>
-
- </div>
-</div>
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8470">BEAM-8470</a> - Create a new Spark runner based on Spark Structured streaming framework</li>
+</ul>
-<div class="cards section section--wide">
- <div class="section__contained">
- <div class="cards__title">
- Testimonials
- </div>
- <div class="cards__cards">
-
- <div class="cards__cards__card">
- <div class="cards__cards__card__body">
- A framework that delivers the flexibility and advanced functionality our customers need.
- </div>
- <div class="cards__cards__card__user">
- <!-- TODO: Implement icons.
- <div class="cards__cards__card__user__icon">
- </div>
- -->
- <div class="cards__cards__card__user__name">
- –Talend
- </div>
- </div>
- </div>
-
- <div class="cards__cards__card">
- <div class="cards__cards__card__body">
- Apache Beam has powerful semantics that solve real-world challenges of stream processing.
- </div>
- <div class="cards__cards__card__user">
- <!-- TODO: Implement icons.
- <div class="cards__cards__card__user__icon">
- </div>
- -->
- <div class="cards__cards__card__user__name">
- –PayPal
- </div>
- </div>
- </div>
-
- <div class="cards__cards__card">
- <div class="cards__cards__card__body">
- Apache Beam represents a principled approach for analyzing data streams.
- </div>
- <div class="cards__cards__card__user">
- <!-- TODO: Implement icons.
- <div class="cards__cards__card__user__icon">
- </div>
- -->
- <div class="cards__cards__card__user__name">
- –data Artisans
- </div>
- </div>
- </div>
-
- </div>
- <div class="cards__body">
- Beam is an open source community and contributions are greatly appreciated!
- If you’d like to contribute, please see the <a href="/contribute/">Contribute</a> section.
- </div>
- </div>
-</div>
+<h3 id="ios">I/Os</h3>
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-7636">BEAM-7636</a> - Added SqsIO v2 support.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8513">BEAM-8513</a> - RabbitMqIO: Allow reads from exchange-bound queue without declaring the exchange.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8540">BEAM-8540</a> - Fix CSVSink example in FileIO docs</li>
+</ul>
+
+<h3 id="new-features--improvements">New Features / Improvements</h3>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-5878">BEAM-5878</a> - Added support DoFns with Keyword-only arguments in Python 3.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-6756">BEAM-6756</a> - Improved support for lazy iterables in schemas (Java).</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-4776">BEAM-4776</a> AND <a href="https://issues.apache.org/jira/browse/BEAM-4777">BEAM-4777</a> - Added metrics supports to portable runners.</li>
+ <li>Various improvements to Interactive Beam: <a href="https://issues.apache.org/jira/browse/BEAM-7760">BEAM-7760</a>, <a href="https://issues.apache.org/jira/browse/BEAM-8379">BEAM-8379</a>, <a href="https://issues.apache.org/jira/browse/BEAM-8016">BEAM-8016</a>, <a href="https://issues.apache.org/jira/browse/BEAM-8016">BEAM-8016</a>.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8658">BEAM-8658</a> - Optionally set artifact staging port in FlinkUberJarJobServer.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8660">BEAM-8660</a> - Override returned artifact staging endpoint</li>
+</ul>
+
+<h3 id="sql">SQL</h3>
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8343">BEAM-8343</a> - [SQL] Add means for IO APIs to support predicate and/or project push-down when running SQL pipelines. And <a href="https://issues.apache.org/jira/browse/BEAM-8468">BEAM-8468</a>, <a href="https://issues.apache.org/jira/browse/BEAM-8365">BEAM-8365</a>, <a href="https://issues.apache.org/jira/browse/BEAM-8508">BEAM-8508</a>.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8427">BEAM-8427</a> - [SQL] Add support for MongoDB source.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8456">BEAM-8456</a> - Add pipeline option to control truncate of BigQuery data processed by Beam SQL.</li>
+</ul>
+
+<h3 id="breaking-changes">Breaking Changes</h3>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8814">BEAM-8814</a> - –no_auth flag changed to boolean type.</li>
+</ul>
+
+<h3 id="deprecations">Deprecations</h3>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8252">BEAM-8252</a> AND <a href="https://issues.apache.org/jira/browse/BEAM-8254">BEAM-8254</a> Add worker_region and worker_zone options. Deprecated –zone flag and –worker_region experiment argument.</li>
+</ul>
+
+<h3 id="dependency-changes">Dependency Changes</h3>
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-7078">BEAM-7078</a> - com.amazonaws:amazon-kinesis-client updated to 1.13.0.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8822">BEAM-8822</a> - Upgrade Hadoop dependencies to version 2.8.</li>
+</ul>
+
+<h3 id="bugfixes">Bugfixes</h3>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-7917">BEAM-7917</a> - Python datastore v1new fails on retry.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-7981">BEAM-7981</a> - ParDo function wrapper doesn’t support Iterable output types.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8146">BEAM-8146</a> - SchemaCoder/RowCoder have no equals() function.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8347">BEAM-8347</a> - UnboundedRabbitMqReader can fail to advance watermark if no new data comes in.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8352">BEAM-8352</a> - Reading records in background may lead to OOM errors</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8480">BEAM-8480</a> - Explicitly set restriction coder for bounded reader wrapper SDF.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8515">BEAM-8515</a> - Ensure that ValueProvider types have equals/hashCode implemented for comparison reasons.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8579">BEAM-8579</a> - Strip UTF-8 BOM bytes (if present) in TextSource.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8657">BEAM-8657</a> - Not doing Combiner lifting for data-driven triggers.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8663">BEAM-8663</a> - BundleBasedRunner Stacked Bundles don’t respect PaneInfo.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8667">BEAM-8667</a> - Data channel should to avoid unlimited buffering in Python SDK.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8802">BEAM-8802</a> - Timestamp combiner not respected across bundles in streaming mode.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8803">BEAM-8803</a> - Default behaviour for Python BQ Streaming inserts sink should be to retry always.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8825">BEAM-8825</a> - OOM when writing large numbers of ‘narrow’ rows.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8835">BEAM-8835</a> - Artifact retrieval fails with FlinkUberJarJobServer</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8836">BEAM-8836</a> - ExternalTransform is not providing a unique name</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8884">BEAM-8884</a> - Python MongoDBIO TypeError when splitting.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-9041">BEAM-9041</a> - SchemaCoder equals should not rely on from/toRowFunction equality.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-9042">BEAM-9042</a> - AvroUtils.schemaCoder(schema) produces a not serializable SchemaCoder.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-9065">BEAM-9065</a> - Spark runner accumulates metrics (incorrectly) between runs.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-6303">BEAM-6303</a> - Add .parquet extension to files in ParquetIO.</li>
+ <li>Various bug fixes and performance improvements.</li>
+</ul>
+
+<h3 id="known-issues">Known Issues</h3>
+
+<ul>
+ <li>
+ <p><a href="https://issues.apache.org/jira/browse/BEAM-8882">BEAM-8882</a> - Python: <code class="highlighter-rouge">beam.Create</code> no longer preserves order unless <code class="highlighter-rouge">reshuffle=False</code> is passed in as an argument.</p>
+
+ <p>You may encounter this issue when using DirectRunner.</p>
+ </li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-9065">BEAM-9065</a> - Spark runner accumulates metrics (incorrectly) between runs</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-9123">BEAM-9123</a> - HadoopResourceId returns wrong directory name</li>
+ <li>See a full list of open <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20affectedVersion%20%3D%202.18.0%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC">issues that affect</a> this version.</li>
+</ul>
+
+<h2 id="list-of-contributors">List of Contributors</h2>
+
+<p>According to git shortlog, the following people contributed to the 2.18.0 release. Thank you to all contributors!</p>
+
+<p>Ahmet Altay, Aizhamal Nurmamat kyzy, Alan Myrvold, Alexey Romanenko, Alex Van Boxel, Andre Araujo, Andrew Crites, Andrew Pilloud, Aryan Naraghi, Boyuan Zhang, Brian Hulette, bumblebee-coming, Cerny Ondrej, Chad Dombrova, Chamikara Jayalath, Changming Ma, Chun Yang, cmachgodaddy, Colm O hEigeartaigh, Craig Chambers, Daniel Oliveira, Daniel Robert, David Cavazos, David Moravek, David Song, dependabot[bot], Derek, Dmytro Sadovnychyi, Elliotte Rusty Harold, Etienne Chauchot, Hai Lu, Henry [...]
-<div class="ctas section">
- <div class="ctas__title">
- Get started
- </div>
- <div class="ctas__ctas ctas__ctas--top">
- <a class="button button--primary" href="/get-started/beam-overview/">Learn more</a>
- <a class="button button--primary" href="/get-started/downloads/">Download Beam SDK 2.18.0</a>
- </div>
- <div class="ctas__ctas">
- <a class="button" href="/get-started/quickstart-java/">Java Quickstart</a>
- <a class="button" href="/get-started/quickstart-py/">Python Quickstart</a>
- <a class="button" href="/get-started/quickstart-go/">Go Quickstart</a>
</div>
-</div>
+
+</article>
</div>
<!--
diff --git a/website/generated-content/blog/index.html b/website/generated-content/blog/index.html
index 731ade7..a748a48 100644
--- a/website/generated-content/blog/index.html
+++ b/website/generated-content/blog/index.html
@@ -172,6 +172,38 @@ limitations under the License.
<p>This is the blog for the Apache Beam project. This blog contains news and updates
for the project.</p>
+<h3 id="apache-beam-2180"><a class="post-link" href="/blog/2020/01/13/beam-2.18.0.html">Apache Beam 2.18.0</a></h3>
+<p><i>Jan 23, 2020 •
+ Udi Meiri [<a href="https://twitter.com/udim">@udim</a>] & Ahmet Altay
+</i></p>
+
+<!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+
+<p>We are happy to present the new 2.18.0 release of Beam. This release includes both improvements and new functionality.
+See the <a href="/get-started/downloads/#2180-2020-01-23">download page</a> for this release.</p>
+
+<!-- Render a "read more" button if the post is longer than the excerpt -->
+
+<p>
+<a class="btn btn-default btn-sm" href="/blog/2020/01/13/beam-2.18.0.html" role="button">
+Read more <span class="glyphicon glyphicon-menu-right" aria-hidden="true"></span>
+</a>
+</p>
+
+<hr />
+
<h3 id="apache-beam-2170"><a class="post-link" href="/blog/2020/01/06/beam-2.17.0.html">Apache Beam 2.17.0</a></h3>
<p><i>Jan 6, 2020 •
Mikhail Gryzykhin
diff --git a/website/generated-content/contribute/release-guide/index.html b/website/generated-content/contribute/release-guide/index.html
index 2b456c7..2a19fea 100644
--- a/website/generated-content/contribute/release-guide/index.html
+++ b/website/generated-content/contribute/release-guide/index.html
@@ -1417,7 +1417,7 @@ all major features and bug fixes, and all known issues.</p>
* {$KNOWN_ISSUE_1}
* {$KNOWN_ISSUE_2}
- * See a full list of open [issues that affects](https://issues.apache.org/jira/browse/BEAM-8989?jql=project = BEAM AND affectedVersion = 2.16.0 ORDER BY priority DESC, updated DESC) this version.
+ * See a full list of open [issues that affect](https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20affectedVersion%20%3D%20{$RELEASE}%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC) this version.
## List of Contributors
@@ -1477,7 +1477,7 @@ The complete staging area is available for your review, which includes:
* Java artifacts were built with Maven MAVEN_VERSION and OpenJDK/Oracle JDK JDK_VERSION.
* Python artifacts are deployed along with the source release to the dist.apache.org [2].
* Validation sheet with a tab for 1.2.3 release to help with validation [9].
-* Docker images puhlished to Docker Hub [10].
+* Docker images published to Docker Hub [10].
The vote will be open for at least 72 hours. It is adopted by majority approval, with at least 3 PMC affirmative votes.
diff --git a/website/generated-content/feed.xml b/website/generated-content/feed.xml
index f78451e..681763c 100644
--- a/website/generated-content/feed.xml
+++ b/website/generated-content/feed.xml
@@ -20,6 +20,131 @@
<generator>Jekyll v3.6.3</generator>
<item>
+ <title>Apache Beam 2.18.0</title>
+ <description><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+
+<p>We are happy to present the new 2.18.0 release of Beam. This release includes both improvements and new functionality.
+See the <a href="/get-started/downloads/#2180-2020-01-23">download page</a> for this release.<!--more-->
+For more information on changes in 2.18.0, check out the
+<a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346383&amp;projectId=12319527">detailed release notes</a>.</p>
+
+<h2 id="highlights">Highlights</h2>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8470">BEAM-8470</a> - Create a new Spark runner based on Spark Structured streaming framework</li>
+</ul>
+
+<h3 id="ios">I/Os</h3>
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-7636">BEAM-7636</a> - Added SqsIO v2 support.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8513">BEAM-8513</a> - RabbitMqIO: Allow reads from exchange-bound queue without declaring the exchange.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8540">BEAM-8540</a> - Fix CSVSink example in FileIO docs</li>
+</ul>
+
+<h3 id="new-features--improvements">New Features / Improvements</h3>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-5878">BEAM-5878</a> - Added support DoFns with Keyword-only arguments in Python 3.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-6756">BEAM-6756</a> - Improved support for lazy iterables in schemas (Java).</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-4776">BEAM-4776</a> AND <a href="https://issues.apache.org/jira/browse/BEAM-4777">BEAM-4777</a> - Added metrics supports to portable runners.</li>
+ <li>Various improvements to Interactive Beam: <a href="https://issues.apache.org/jira/browse/BEAM-7760">BEAM-7760</a>, <a href="https://issues.apache.org/jira/browse/BEAM-8379">BEAM-8379</a>, <a href="https://issues.apache.org/jira/browse/BEAM-8016">BEAM-8016</a>, <a href="https://issues.apache.org/jira/browse/BEAM-8016">BEAM-8016</a>.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8658">BEAM-8658</a> - Optionally set artifact staging port in FlinkUberJarJobServer.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8660">BEAM-8660</a> - Override returned artifact staging endpoint</li>
+</ul>
+
+<h3 id="sql">SQL</h3>
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8343">BEAM-8343</a> - [SQL] Add means for IO APIs to support predicate and/or project push-down when running SQL pipelines. And <a href="https://issues.apache.org/jira/browse/BEAM-8468">BEAM-8468</a>, <a href="https://issues.apache.org/jira/browse/BEAM-8365">BEAM-8365</a>, <a href="https://issues.apache.org/jira/browse/BEAM-8508">BEAM-8508</ [...]
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8427">BEAM-8427</a> - [SQL] Add support for MongoDB source.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8456">BEAM-8456</a> - Add pipeline option to control truncate of BigQuery data processed by Beam SQL.</li>
+</ul>
+
+<h3 id="breaking-changes">Breaking Changes</h3>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8814">BEAM-8814</a> - –no_auth flag changed to boolean type.</li>
+</ul>
+
+<h3 id="deprecations">Deprecations</h3>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8252">BEAM-8252</a> AND <a href="https://issues.apache.org/jira/browse/BEAM-8254">BEAM-8254</a> Add worker_region and worker_zone options. Deprecated –zone flag and –worker_region experiment argument.</li>
+</ul>
+
+<h3 id="dependency-changes">Dependency Changes</h3>
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-7078">BEAM-7078</a> - com.amazonaws:amazon-kinesis-client updated to 1.13.0.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8822">BEAM-8822</a> - Upgrade Hadoop dependencies to version 2.8.</li>
+</ul>
+
+<h3 id="bugfixes">Bugfixes</h3>
+
+<ul>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-7917">BEAM-7917</a> - Python datastore v1new fails on retry.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-7981">BEAM-7981</a> - ParDo function wrapper doesn’t support Iterable output types.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8146">BEAM-8146</a> - SchemaCoder/RowCoder have no equals() function.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8347">BEAM-8347</a> - UnboundedRabbitMqReader can fail to advance watermark if no new data comes in.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8352">BEAM-8352</a> - Reading records in background may lead to OOM errors</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8480">BEAM-8480</a> - Explicitly set restriction coder for bounded reader wrapper SDF.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8515">BEAM-8515</a> - Ensure that ValueProvider types have equals/hashCode implemented for comparison reasons.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8579">BEAM-8579</a> - Strip UTF-8 BOM bytes (if present) in TextSource.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8657">BEAM-8657</a> - Not doing Combiner lifting for data-driven triggers.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8663">BEAM-8663</a> - BundleBasedRunner Stacked Bundles don’t respect PaneInfo.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8667">BEAM-8667</a> - Data channel should to avoid unlimited buffering in Python SDK.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8802">BEAM-8802</a> - Timestamp combiner not respected across bundles in streaming mode.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8803">BEAM-8803</a> - Default behaviour for Python BQ Streaming inserts sink should be to retry always.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8825">BEAM-8825</a> - OOM when writing large numbers of ‘narrow’ rows.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8835">BEAM-8835</a> - Artifact retrieval fails with FlinkUberJarJobServer</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8836">BEAM-8836</a> - ExternalTransform is not providing a unique name</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-8884">BEAM-8884</a> - Python MongoDBIO TypeError when splitting.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-9041">BEAM-9041</a> - SchemaCoder equals should not rely on from/toRowFunction equality.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-9042">BEAM-9042</a> - AvroUtils.schemaCoder(schema) produces a not serializable SchemaCoder.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-9065">BEAM-9065</a> - Spark runner accumulates metrics (incorrectly) between runs.</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-6303">BEAM-6303</a> - Add .parquet extension to files in ParquetIO.</li>
+ <li>Various bug fixes and performance improvements.</li>
+</ul>
+
+<h3 id="known-issues">Known Issues</h3>
+
+<ul>
+ <li>
+ <p><a href="https://issues.apache.org/jira/browse/BEAM-8882">BEAM-8882</a> - Python: <code class="highlighter-rouge">beam.Create</code> no longer preserves order unless <code class="highlighter-rouge">reshuffle=False</code> is passed in as an argument.</p>
+
+ <p>You may encounter this issue when using DirectRunner.</p>
+ </li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-9065">BEAM-9065</a> - Spark runner accumulates metrics (incorrectly) between runs</li>
+ <li><a href="https://issues.apache.org/jira/browse/BEAM-9123">BEAM-9123</a> - HadoopResourceId returns wrong directory name</li>
+ <li>See a full list of open <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20affectedVersion%20%3D%202.18.0%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC">issues that affect</a> this version.</li>
+</ul>
+
+<h2 id="list-of-contributors">List of Contributors</h2>
+
+<p>According to git shortlog, the following people contributed to the 2.18.0 release. Thank you to all contributors!</p>
+
+<p>Ahmet Altay, Aizhamal Nurmamat kyzy, Alan Myrvold, Alexey Romanenko, Alex Van Boxel, Andre Araujo, Andrew Crites, Andrew Pilloud, Aryan Naraghi, Boyuan Zhang, Brian Hulette, bumblebee-coming, Cerny Ondrej, Chad Dombrova, Chamikara Jayalath, Changming Ma, Chun Yang, cmachgodaddy, Colm O hEigeartaigh, Craig Chambers, Daniel Oliveira, Daniel Robert, David Cavazos, David Moravek, David Song, dependabot[bot], Derek, Dmytro Sadovnychyi, Elliotte Rusty Harold, Etienne Chauchot, Hai Lu, [...]
+</description>
+ <pubDate>Thu, 23 Jan 2020 00:00:01 -0800</pubDate>
+ <link>https://beam.apache.org/blog/2020/01/13/beam-2.18.0.html</link>
+ <guid isPermaLink="true">https://beam.apache.org/blog/2020/01/13/beam-2.18.0.html</guid>
+
+
+ <category>blog</category>
+
+ </item>
+
+ <item>
<title>Apache Beam 2.17.0</title>
<description><!--
Licensed under the Apache License, Version 2.0 (the "License");
@@ -1232,98 +1357,5 @@ useful for people to learn more about Apache Beam, and eventually become Beam Ma
</item>
- <item>
- <title>Beam community update!</title>
- <description><!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-
-http://www.apache.org/licenses/LICENSE-2.0
-
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-
-<h1 id="the-apache-beam-community-in-2019">The Apache Beam community in 2019</h1>
-
-<p>2019 has already been a busy time for the Apache Beam community. The ASF blog featured <a href="https://blogs.apache.org/comdev/date/20190222">our way of community building</a> and we’ve had <a href="https://www.meetup.com/San-Francisco-Apache-Beam/events/257482350">more Beam meetups</a> around the world. Apache Beam also received the <a href="https://www.infoworld.com/article/3336072/infoworlds-2019-technology-of-the-year-awa [...]
-
-<p>As these events happened, we were building up to the <a href="https://opensource.googleblog.com/2019/03/celebrating-20-years-of-apache.html">20th anniversary of the Apache Software Foundation</a>. The contributions of the Beam community were a part of Maximilian Michels blog post on the success of the ASF’s open source development model:</p>
-
-<blockquote class="twitter-tweet" data-lang="nl"><p lang="en" dir="ltr">Success at Apache: What You Need to Know by Maximilian Michels <a href="https://t.co/XjtVYgPAHX">https://t.co/XjtVYgPAHX</a> <a href="https://twitter.com/hashtag/Apache?src=hash&amp;ref_src=twsrc%5Etfw">#Apache</a> <a href="https://twitter.com/hashtag/Open?src=hash&amp;ref_src=twsrc%5Etfw">#Open< [...]
-
-<script async="" src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>
-
-<p>In that spirit, let’s have an overview of the things that have happened, what the next few months look like, and how we can foster even more community growth.</p>
-
-<h2 id="meetups">Meetups</h2>
-<p>We’ve had a flurry of activity, with several meetups in the planning process and more popping up globally over time. As diversity of contributors is a core ASF value, this geographic spread is exciting for the community. Here’s a picture from the latest Apache Beam meetup organized at Lyft in San Francisco:</p>
-
-<p><img src="https://secure.meetupstatic.com/photos/event/8/0/1/2/600_481292786.jpeg" alt="Beam Meetup Bay Area" /></p>
-
-<p>We have more <a href="https://www.meetup.com/San-Francisco-Apache-Beam">Bay Area meetups</a> coming soon, and the community is looking into kicking off a meetup in Toronto!</p>
-
-<p><a href="https://www.meetup.com/London-Apache-Beam-Meetup">London</a> had its first meetup of 2019 at the start of April:</p>
-
-<p><img src="https://secure.meetupstatic.com/photos/event/4/7/0/e/600_480318190.jpeg" alt="Beam Meetup London" height="360" width="640" /></p>
-
-<p>and <a href="https://www.meetup.com/Apache-Beam-Stockholm/events/260634514">Stockholm</a> had its second meetup at the start of May:</p>
-
-<blockquote class="twitter-tweet" data-lang="en-gb"><p lang="en" dir="ltr">Big audience for the second <a href="https://twitter.com/ApacheBeam?ref_src=twsrc%5Etfw">@ApacheBeam</a> meetup in Stockholm! Gleb, <a href="https://twitter.com/kanterov?ref_src=twsrc%5Etfw">@kanterov</a> from <a href="https://twitter.com/SpotifyEng?ref_src=twsrc%5Etfw">@SpotifyEng</a> kicking off [...]
-<script async="" src="https://platform.twitter.com/widgets.js" charset="utf-8"></script>
-
-<p>Keep an eye out for a meetup in <a href="https://www.meetup.com/Paris-Apache-Beam-Meetup">Paris</a>.</p>
-
-<p>If you are interested in starting your own meetup, feel free <a href="https://beam.apache.org/community/contact-us">to reach out</a>! Good places to start include our Slack channel, the dev and user mailing lists, or the Apache Beam Twitter.</p>
-
-<p>Even if you can’t travel to these meetups, you can stay informed on the happenings of the community. The talks and sessions from previous conferences and meetups are archived on the <a href="https://www.youtube.com/c/ApacheBeamYT">Apache Beam YouTube channel</a>. If you want your session added to the channel, don’t hesitate to get in touch! And in case you want to attend the next Beam event in style, you can also order your swag on the <a href="htt [...]
-
-<h2 id="summits">Summits</h2>
-<p>The first summit of the year will be held in Berlin:</p>
-
-<p><img src="https://img.evbuc.com/https%3A%2F%2Fcdn.evbuc.com%2Fimages%2F58635346%2F70962106775%2F1%2Foriginal.20190317-212619?w=800&amp;auto=compress&amp;rect=0%2C115%2C2666%2C1333&amp;s=2680f5036dcad9177b027cce026c0224" alt="Beam Summit Europe Banner" /></p>
-
-<p>You can find more info on the <a href="https://beamsummit.org">website</a> and read about the inaugural edition of the Beam Summit Europe <a href="https://beam.apache.org/blog/2018/10/31/beam-summit-aftermath.html">here</a>. At these summits, you have the opportunity to meet with other Apache Beam creators and users, get expert advice, learn from the speaker sessions, and participate in workshops.</p>
-
-<p>We strongly encourage you to get involved again this year! You can participate in the following ways for the upcoming summit in Europe:</p>
-
-<p>🎫 If you want to secure your ticket to attend the Beam Summit Europe 2019, check our <a href="http://beam-summit-europe.eventbrite.com">event page</a>.</p>
-
-<p>💸 If you want to make the Summit even <strong>more</strong> awesome, check out our <a href="https://drive.google.com/file/d/1R3vvOHihQbpuzF2aaSV8WYg9YHRmJwxS/view">sponsor booklet</a>!</p>
-
-<p>We also launched the CfP for our Beam Summit in North America, which will be held in collaboration with <a href="https://www.apachecon.com">ApacheCon</a>.</p>
-
-<p>🎤 If you want to give a talk, take a look at our <a href="https://www.apachecon.com/acna19/cfp.html">CfP</a>.</p>
-
-<p>Stay tuned for more information on the summit in North America and Asia.</p>
-
-<h2 id="why-community-engagement-matters">Why community engagement matters</h2>
-<p>Why we need a strong Apache Beam community:</p>
-<ul>
- <li>We’re receiving lots of code contributions and need committers to review those and help onboard new contributors to the project.</li>
- <li>We want people to feel a sense of ownership to the project. By fostering this level of engagement, the work becomes even more exciting.</li>
- <li>A healthy community has a further reach and leads to more growth. More hours can be contributed to the project as we can spread the work and ownership.</li>
-</ul>
-
-<p>Why are we organizing these summits:</p>
-<ul>
- <li>We’d like to give folks a place to meet, congregate, and share ideas.</li>
- <li>We know that offline interactions often changes the nature of the online ones in a positive manner.</li>
- <li>Building an active and diverse community is part of the Apache Way. These summits provide an opportunity for us to engage people from different locations, companies, and backgrounds.</li>
-</ul>
-</description>
- <pubDate>Sat, 11 May 2019 01:00:01 -0700</pubDate>
- <link>https://beam.apache.org/blog/2019/05/11/beam-summit-europe-2019.html</link>
- <guid isPermaLink="true">https://beam.apache.org/blog/2019/05/11/beam-summit-europe-2019.html</guid>
-
-
- <category>blog</category>
-
- </item>
-
</channel>
</rss>
diff --git a/website/generated-content/index.html b/website/generated-content/index.html
index 3a7204b..c72efd1 100644
--- a/website/generated-content/index.html
+++ b/website/generated-content/index.html
@@ -196,6 +196,11 @@ limitations under the License.
</div>
<div class="hero__blog__cards">
+ <a class="hero__blog__cards__card" href="/blog/2020/01/13/beam-2.18.0.html">
+ <div class="hero__blog__cards__card__title">Apache Beam 2.18.0</div>
+ <div class="hero__blog__cards__card__date">Jan 23, 2020</div>
+ </a>
+
<a class="hero__blog__cards__card" href="/blog/2020/01/06/beam-2.17.0.html">
<div class="hero__blog__cards__card__title">Apache Beam 2.17.0</div>
<div class="hero__blog__cards__card__date">Jan 6, 2020</div>
@@ -206,11 +211,6 @@ limitations under the License.
<div class="hero__blog__cards__card__date">Oct 7, 2019</div>
</a>
- <a class="hero__blog__cards__card" href="/blog/2019/09/04/gsoc-19.html">
- <div class="hero__blog__cards__card__title">Google Summer of Code '19</div>
- <div class="hero__blog__cards__card__date">Sep 4, 2019</div>
- </a>
-
</div>
</div>
</div>