You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/06/24 16:18:22 UTC
[beam] branch asf-site updated: Publishing website 2022/06/24 16:18:16 at commit 973175b
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 898b8bbb0d4 Publishing website 2022/06/24 16:18:16 at commit 973175b
898b8bbb0d4 is described below
commit 898b8bbb0d497d33908c8aed7e50faad4340001d
Author: jenkins <bu...@apache.org>
AuthorDate: Fri Jun 24 16:18:17 2022 +0000
Publishing website 2022/06/24 16:18:16 at commit 973175b
---
.../documentation/io/developing-io-overview/index.html | 14 +++++++++++---
website/generated-content/sitemap.xml | 2 +-
2 files changed, 12 insertions(+), 4 deletions(-)
diff --git a/website/generated-content/documentation/io/developing-io-overview/index.html b/website/generated-content/documentation/io/developing-io-overview/index.html
index eacad959d34..04ea8863a62 100644
--- a/website/generated-content/documentation/io/developing-io-overview/index.html
+++ b/website/generated-content/documentation/io/developing-io-overview/index.html
@@ -91,9 +91,17 @@ cannot be parallelized. In this case, the <code>ParDo</code> would open the file
read in sequence, producing a <code>PCollection</code> of records from the file.</p></li></ul><h2 id=sinks>Sinks</h2><p>To create a Beam sink, we recommend that you use a <code>ParDo</code> that writes the
received records to the data store. To develop more complex sinks (for example,
to support data de-duplication when failures are retried by a runner), use
-<code>ParDo</code>, <code>GroupByKey</code>, and other available Beam transforms.</p><p>For <strong>file-based sinks</strong>, you can use the <code>FileBasedSink</code> abstraction that is
-provided by both the Java and Python SDKs. See our language specific
-implementation guides for more details:</p><div class=feedback><p class=update>Last updated on 2020/10/29</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols>< [...]
+<code>ParDo</code>, <code>GroupByKey</code>, and other available Beam transforms.
+Many data services are optimized to write batches of elements at a time,
+so it may make sense to group the elements into batches before writing.
+Persistant connectons can be initialized in a DoFn’s <code>setUp</code> or <code>startBundle</code>
+method rather than upon the receipt of every element as well.
+It should also be noted that in a large-scale, distributed system work can
+<a href=/documentation/runtime/model/>fail and/or be retried</a>, so it is preferable to
+make the external interactions idempotent when possible.</p><p>For <strong>file-based sinks</strong>, you can use the <code>FileBasedSink</code> abstraction that is
+provided by both the Java and Python SDKs. Beam’s <code>FileSystems</code> utility classes
+can also be useful for reading and writing files. See our language specific
+implementation guides for more details:</p><div class=feedback><p class=update>Last updated on 2022/06/24</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols>< [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index eb778078117..fd81e81e9ce 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/case-studies/lyft/</loc><lastmod>2022-06-18T03:13:47+06:00</lastmod></url><url><loc>/blog/beam-2.39.0/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2022-06-22T16:19:58-04:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-06-22T16:19:58-04:00</lastmod></url><url><loc> [...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/case-studies/lyft/</loc><lastmod>2022-06-18T03:13:47+06:00</lastmod></url><url><loc>/blog/beam-2.39.0/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2022-06-22T16:19:58-04:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-06-22T16:19:58-04:00</lastmod></url><url><loc> [...]
\ No newline at end of file