You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/02/17 04:17:58 UTC
[beam] branch asf-site updated: Publishing website 2023/02/17 04:17:52 at commit 40838f7
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 957d6189293 Publishing website 2023/02/17 04:17:52 at commit 40838f7
957d6189293 is described below
commit 957d6189293578d511d12f82507adc99e18653d5
Author: jenkins <bu...@apache.org>
AuthorDate: Fri Feb 17 04:17:52 2023 +0000
Publishing website 2023/02/17 04:17:52 at commit 40838f7
---
website/generated-content/documentation/index.xml | 2 ++
.../documentation/io/built-in/google-bigquery/index.html | 4 ++--
website/generated-content/sitemap.xml | 2 +-
3 files changed, 5 insertions(+), 3 deletions(-)
diff --git a/website/generated-content/documentation/index.xml b/website/generated-content/documentation/index.xml
index a52ba7bd329..1e04b4a4cb9 100644
--- a/website/generated-content/documentation/index.xml
+++ b/website/generated-content/documentation/index.xml
@@ -19039,6 +19039,8 @@ in the following example:</p>
<span class="o">|</span> <span class="n">beam</span><span class="o">.</span><span class="n">Map</span><span class="p">(</span><span class="k">lambda</span> <span class="n">elem</span><span class="p">:</span> <span class="n">elem</span><span class="p">[</span><span class="s1">&#39;max_temperature&#39;</span><span class="p">]))</span></code></pre></div>
</div>
</div>
+<p class="language-java"><h4 id="query-execution-project">Query execution project</h4>
+<p>By default the pipeline executes the query in the Google Cloud project associated with the pipeline (in case of the Dataflow runner it&rsquo;s the project where the pipeline runs). There are cases where the query execution project should be different from the pipeline project. If you use Java SDK, you can define the query execution project by setting the pipeline option &ldquo;<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/gcp/bigquery/B [...]
<h3 id="storage-api">Using the Storage Read API</h3>
<p>The <a href="https://cloud.google.com/bigquery/docs/reference/storage/">BigQuery Storage API</a>
allows you to directly access tables in BigQuery storage, and supports features
diff --git a/website/generated-content/documentation/io/built-in/google-bigquery/index.html b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
index 8db3a9a1cf9..3fc872b3b25 100644
--- a/website/generated-content/documentation/io/built-in/google-bigquery/index.html
+++ b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
@@ -265,7 +265,7 @@ in the following example:</p><div class="language-java snippet"><div class="note
<span class=s1>'`clouddataflow-readonly.samples.weather_stations`'</span><span class=p>,</span>
<span class=n>use_standard_sql</span><span class=o>=</span><span class=bp>True</span><span class=p>)</span>
<span class=c1># Each row is a dictionary where the keys are the BigQuery columns</span>
- <span class=o>|</span> <span class=n>beam</span><span class=o>.</span><span class=n>Map</span><span class=p>(</span><span class=k>lambda</span> <span class=n>elem</span><span class=p>:</span> <span class=n>elem</span><span class=p>[</span><span class=s1>'max_temperature'</span><span class=p>]))</span></code></pre></div></div></div><h3 id=storage-api>Using the Storage Read API</h3><p>The <a href=https://cloud.google.com/bigquery/docs/reference/storage/>BigQuery Storage API</a>
+ <span class=o>|</span> <span class=n>beam</span><span class=o>.</span><span class=n>Map</span><span class=p>(</span><span class=k>lambda</span> <span class=n>elem</span><span class=p>:</span> <span class=n>elem</span><span class=p>[</span><span class=s1>'max_temperature'</span><span class=p>]))</span></code></pre></div></div></div><p class=language-java><h4 id=query-execution-project>Query execution project</h4><p>By default the pipeline executes the query in the Google Cloud [...]
allows you to directly access tables in BigQuery storage, and supports features
such as column selection and predicate filter push-down which can allow more
efficient pipeline execution.</p><p>The Beam SDK for Java supports using the BigQuery Storage API when reading from
@@ -869,7 +869,7 @@ reads from a BigQuery table that has the ‘month’ and ‘tornado&
of the table schema, computes the number of tornadoes in each month, and
outputs the results to a BigQuery table.</p></li><li><p><a href=https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/cookbook/filters.py>BigQuery filters</a>
reads weather station data from a BigQuery table, manipulates BigQuery rows in
-memory, and writes the results to a BigQuery table.</p></li></ul><div class=feedback><p class=update>Last updated on 2023/02/09</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><di [...]
+memory, and writes the results to a BigQuery table.</p></li></ul><div class=feedback><p class=update>Last updated on 2023/02/16</p><h3>Have you found everything you were looking for?</h3><p class=description>Was it all useful and clear? Is there anything that you would like to change? Let us know!</p><button class=load-button><a href="mailto:dev@beam.apache.org?subject=Beam Website Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div class=footer__contained><di [...]
<a href=https://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index 2a14d9dfb4b..4a41dfbf8e4 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.45.0/</loc><lastmod>2023-02-15T16:50:59-05:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2023-02-15T16:50:59-05:00</lastmod></url><url><loc>/blog/</loc><lastmod>2023-02-15T16:50:59-05:00</lastmod></url><url><loc>/categories/</loc><lastmod>2023-02-15T16:50:59-05:00</lastmod></url><url><loc>/catego [...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.45.0/</loc><lastmod>2023-02-15T16:50:59-05:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2023-02-15T16:50:59-05:00</lastmod></url><url><loc>/blog/</loc><lastmod>2023-02-15T16:50:59-05:00</lastmod></url><url><loc>/categories/</loc><lastmod>2023-02-15T16:50:59-05:00</lastmod></url><url><loc>/catego [...]
\ No newline at end of file