You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2024/01/16 17:41:25 UTC
(beam) branch asf-site updated: Publishing website 2024/01/16 17:41:18 at commit c11b7c1
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 9a2f060ce0b Publishing website 2024/01/16 17:41:18 at commit c11b7c1
9a2f060ce0b is described below
commit 9a2f060ce0bfbbc51a163e8c95b47329e0186079
Author: runner <ru...@main-runner-zt478-g6c9r>
AuthorDate: Tue Jan 16 17:41:18 2024 +0000
Publishing website 2024/01/16 17:41:18 at commit c11b7c1
---
website/generated-content/blog/index.html | 2 +-
website/generated-content/blog/index.xml | 1 -
website/generated-content/blog/scaling-streaming-workload/index.html | 2 +-
website/generated-content/categories/blog/index.xml | 1 -
website/generated-content/feed.xml | 1 -
website/generated-content/sitemap.xml | 2 +-
6 files changed, 3 insertions(+), 6 deletions(-)
diff --git a/website/generated-content/blog/index.html b/website/generated-content/blog/index.html
index 8c8cc152112..e56328e18db 100644
--- a/website/generated-content/blog/index.html
+++ b/website/generated-content/blog/index.html
@@ -60,7 +60,7 @@ capability</button>
sdk</button>
<button xx class=category-button id=category-website onclick=applyFilter(this)>
website</button></div><div class=posts-list><a class="post-card tf-filter-item" href=/blog/beam-2.53.0/ data-categories='blog release '><div class="post-info post-category"><p>blog & release
- </p><p>2024/01/04</p></div><p class=post-title>Apache Beam 2.53.0</p><p class=post-info>Jack R. McCluskey</p><div class=post-summary>We are happy to present the new 2.53.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.</div></a><a class="post-card tf-filter-item" href=/blog/scaling-streaming-workload/ data-categories='blog '><div class="post-info post-category"><p>blog</p><p>2024/01/03</p></div><p [...]
+ </p><p>2024/01/04</p></div><p class=post-title>Apache Beam 2.53.0</p><p class=post-info>Jack R. McCluskey</p><div class=post-summary>We are happy to present the new 2.53.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.</div></a><a class="post-card tf-filter-item" href=/blog/scaling-streaming-workload/ data-categories='blog '><div class="post-info post-category"><p>blog</p><p>2024/01/03</p></div><p [...]
</p><p>2023/11/17</p></div><p class=post-title>Apache Beam 2.52.0</p><p class=post-info>Danny McCormick</p><div class=post-summary>We are happy to present the new 2.52.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.</div></a><a class="post-card tf-filter-item" href=/blog/contributor-spotlight-johanna-ojeling/ data-categories='blog '><div class="post-info post-category"><p>blog</p><p>2023/11/11</p [...]
</p><p>2023/10/11</p></div><p class=post-title>Apache Beam 2.51.0</p><p class=post-info>Kenneth Knowles</p><div class=post-summary>We are happy to present the new 2.51.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.</div></a><a class="post-card tf-filter-item" href=/blog/dyi-content-discovery-platform-genai-beam/ data-categories='blog '><div class="post-info post-category"><p>blog</p><p>2023/10/0 [...]
Namita Sharma</p><div class=post-summary>DIY GenAI Content Discovery Platform with Apache Beam Your digital assets, such as documents, PDFs, spreadsheets, and presentations, contain a wealth of valuable information, but sometimes it&rsquo;s hard to find what you&rsquo;re looking for.</div></a><a class="post-card tf-filter-item" href=/blog/beam-2.50.0/ data-categories='blog release '><div class="post-info post-category"><p>blog & release
diff --git a/website/generated-content/blog/index.xml b/website/generated-content/blog/index.xml
index 6de5ecc99c4..e110ceccf32 100644
--- a/website/generated-content/blog/index.xml
+++ b/website/generated-content/blog/index.xml
@@ -121,7 +121,6 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="scaling-a-streaming-workload-on-apache-beam">Scaling a streaming workload on Apache Beam</h1>
<p><img class="center-block"
src="/images/blog/scaling-streaming-workload/0-intro.png"
alt="Streaming Processing"></p>
diff --git a/website/generated-content/blog/scaling-streaming-workload/index.html b/website/generated-content/blog/scaling-streaming-workload/index.html
index dd651c4f301..b577a563450 100644
--- a/website/generated-content/blog/scaling-streaming-workload/index.html
+++ b/website/generated-content/blog/scaling-streaming-workload/index.html
@@ -36,7 +36,7 @@
<img class=banner-img-mobile src=/images/banners/tour-of-beam/tour-of-beam-mobile.png alt="Start Tour of Beam"></a></div><div class=swiper-slide><a href=https://beam.apache.org/documentation/ml/overview/><img class=banner-img-desktop src=/images/banners/machine-learning/machine-learning-desktop.jpg alt="Machine Learning">
<img class=banner-img-mobile src=/images/banners/machine-learning/machine-learning-mobile.jpg alt="Machine Learning"></a></div></div><div class=swiper-pagination></div></div><script src=/js/swiper-bundle.min.min.e0e8f81b0b15728d35ff73c07f42ddbb17a108d6f23df4953cb3e60df7ade675.js></script>
<script src=/js/sliders/top-banners.min.91104c476b3d8123ebee5ed9a8168556ec546abb698549551b38a0cee187ee1c.js></script>
-<script>function showSearch(){addPlaceholder();var e,t=document.querySelector(".searchBar");t.classList.remove("disappear"),e=document.querySelector("#iconsBar"),e.classList.add("disappear")}function addPlaceholder(){$("input:text").attr("placeholder","What are you looking for?")}function endSearch(){var e,t=document.querySelector(".searchBar");t.classList.add("disappear"),e=document.querySelector("#iconsBar"),e.classList.remove("disappear")}function blockScroll(){$("body").toggleClass(" [...]
+<script>function showSearch(){addPlaceholder();var e,t=document.querySelector(".searchBar");t.classList.remove("disappear"),e=document.querySelector("#iconsBar"),e.classList.add("disappear")}function addPlaceholder(){$("input:text").attr("placeholder","What are you looking for?")}function endSearch(){var e,t=document.querySelector(".searchBar");t.classList.add("disappear"),e=document.querySelector("#iconsBar"),e.classList.remove("disappear")}function blockScroll(){$("body").toggleClass(" [...]
<img class=center-block src=/images/blog/scaling-streaming-workload/3-autoshard-tr-output.png alt="TableRow Output Size"></p><p>Looking at the input size, right before the identity UDF execution, the data format is binary Thrift, which is a decently compact format even when no compression is used. However, while comparing the <code>PCollection</code> approximated size with the <code>TableRow</code> format needed for BigQuery ingestion, a clear size increase is visible. This is something [...]
<img class=center-block src=/images/blog/scaling-streaming-workload/5-output-size.png alt="Row output size"></p><p>The <code>PCollection</code> size written into BigQuery is considerably smaller than on previous executions. In fact, for this particular execution, the Beam row format is a smaller size than the Thrift format. A larger <code>PCollection</code> conformed by bigger per-element sizes can put nontrivial memory pressure in smaller worker configurations, reducing the overall thro [...]
<img class=center-block src=/images/blog/scaling-streaming-workload/7-current-shuffle-total.png alt="Streamed data size"></p><p>Considering all of these factors, this change further optimizes the workload, achieving a throughput of 6.4 MB/s per CPU core. This improvement is small compared to the same workload when using consistent writes into BigQuery, but it uses less streaming data resources. This configuration represents the most optimal setup for our workload, with the highest throug [...]
diff --git a/website/generated-content/categories/blog/index.xml b/website/generated-content/categories/blog/index.xml
index 08cf33bedec..80f32fdde2e 100644
--- a/website/generated-content/categories/blog/index.xml
+++ b/website/generated-content/categories/blog/index.xml
@@ -121,7 +121,6 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="scaling-a-streaming-workload-on-apache-beam">Scaling a streaming workload on Apache Beam</h1>
<p><img class="center-block"
src="/images/blog/scaling-streaming-workload/0-intro.png"
alt="Streaming Processing"></p>
diff --git a/website/generated-content/feed.xml b/website/generated-content/feed.xml
index b7d9a18f04a..3e9ffa7ceba 100644
--- a/website/generated-content/feed.xml
+++ b/website/generated-content/feed.xml
@@ -121,7 +121,6 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="scaling-a-streaming-workload-on-apache-beam">Scaling a streaming workload on Apache Beam</h1>
<p><img class="center-block"
src="/images/blog/scaling-streaming-workload/0-intro.png"
alt="Streaming Processing"></p>
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index c5a174a564f..e38fb45492c 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.53.0/</loc><lastmod>2024-01-16T09:56:10+01:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2024-01-16T09:56:10+01:00</lastmod></url><url><loc>/blog/</loc><lastmod>2024-01-16T09:56:10+01:00</lastmod></url><url><loc>/categories/</loc><lastmod>2024-01-16T09:56:10+01:00</lastmod></url><url><loc>/catego [...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.53.0/</loc><lastmod>2024-01-16T06:33:03-08:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2024-01-16T06:33:03-08:00</lastmod></url><url><loc>/blog/</loc><lastmod>2024-01-16T06:33:03-08:00</lastmod></url><url><loc>/categories/</loc><lastmod>2024-01-16T06:33:03-08:00</lastmod></url><url><loc>/catego [...]
\ No newline at end of file