You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2026/07/08 00:00:20 UTC

(beam) branch asf-site updated: Publishing website 2026/07/08 00:00:12 at commit 123dc7f

This is an automated email from the ASF dual-hosted git repository.

github-actions[bot] pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
     new 9a3d930686b Publishing website 2026/07/08 00:00:12 at commit 123dc7f
9a3d930686b is described below

commit 9a3d930686bd6453442f51f19a175971a05bb100
Author: runner <ru...@main-runner-2404-9kmqn-6vzlr>
AuthorDate: Wed Jul 8 00:00:13 2026 +0000

    Publishing website 2026/07/08 00:00:12 at commit 123dc7f
---
 .../extensions/create-external-table/index.html    | 41 ++++++----------------
 website/generated-content/sitemap.xml              |  2 +-
 2 files changed, 12 insertions(+), 31 deletions(-)

diff --git a/website/generated-content/documentation/dsls/sql/extensions/create-external-table/index.html b/website/generated-content/documentation/dsls/sql/extensions/create-external-table/index.html
index 251326851c4..d4637df37e1 100644
--- a/website/generated-content/documentation/dsls/sql/extensions/create-external-table/index.html
+++ b/website/generated-content/documentation/dsls/sql/extensions/create-external-table/index.html
@@ -35,7 +35,7 @@
 <img class=banner-img-mobile src=/images/banners/tour-of-beam/tour-of-beam-mobile.png alt="Start Tour of Beam"></a></div><div class=swiper-slide><a href=https://beam.apache.org/documentation/ml/overview/><img class=banner-img-desktop src=/images/banners/machine-learning/machine-learning-desktop.jpg alt="Machine Learning">
 <img class=banner-img-mobile src=/images/banners/machine-learning/machine-learning-mobile.jpg alt="Machine Learning"></a></div></div><div class=swiper-pagination></div><div class=swiper-button-prev></div><div class=swiper-button-next></div></div><script src=/js/swiper-bundle.min.min.e0e8f81b0b15728d35ff73c07f42ddbb17a108d6f23df4953cb3e60df7ade675.js></script>
 <script src=/js/sliders/top-banners.min.afa7d0a19acf7a3b28ca369490b3d401a619562a2a4c9612577be2f66a4b9855.js></script>
-<script>function showSearch(){addPlaceholder();var e,t=document.querySelector(".searchBar");t.classList.remove("disappear"),e=document.querySelector("#iconsBar"),e.classList.add("disappear")}function addPlaceholder(){$("input:text").attr("placeholder","What are you looking for?")}function endSearch(){var e,t=document.querySelector(".searchBar");t.classList.add("disappear"),e=document.querySelector("#iconsBar"),e.classList.remove("disappear")}function blockScroll(){$("body").toggleClass(" [...]
+<script>function showSearch(){addPlaceholder();var e,t=document.querySelector(".searchBar");t.classList.remove("disappear"),e=document.querySelector("#iconsBar"),e.classList.add("disappear")}function addPlaceholder(){$("input:text").attr("placeholder","What are you looking for?")}function endSearch(){var e,t=document.querySelector(".searchBar");t.classList.add("disappear"),e=document.querySelector("#iconsBar"),e.classList.remove("disappear")}function blockScroll(){$("body").toggleClass(" [...]
 <a href=/documentation/io/built-in/>external storage system</a>.
 For some storage systems, <code>CREATE EXTERNAL TABLE</code> does not create a physical table until
 a write occurs. After the physical table exists, you can access the table with
@@ -179,26 +179,7 @@ SQL statements. Currently, this means that PubsubIO tables require you to
 declare a special set of columns, as shown below.</p><h3 id=supported-payload>Supported Payload</h3><ul><li>Pub/Sub supports <a href=#generic-payload-handling>Generic Payload Handling</a>.</li></ul><h3 id=example-2>Example</h3><pre tabindex=0><code>CREATE EXTERNAL TABLE locations (event_timestamp TIMESTAMP, attributes MAP&lt;VARCHAR, VARCHAR&gt;, payload ROW&lt;id INTEGER, location VARCHAR&gt;)
 TYPE pubsub
 LOCATION &#39;projects/testing-integration/topics/user-location&#39;
-</code></pre><h2 id=pubsub-lite>Pub/Sub Lite</h2><h3 id=syntax-4>Syntax</h3><pre tabindex=0><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName(
-    publish_timestamp DATETIME,
-    event_timestamp DATETIME,
-    message_key BYTES,
-    attributes ARRAY&lt;ROW&lt;key VARCHAR, `values` ARRAY&lt;VARBINARY&gt;&gt;&gt;,
-    payload [BYTES, ROW&lt;tableElement [, tableElement ]*&gt;]
-)
-TYPE pubsublite
-// For writing
-LOCATION &#39;projects/[PROJECT]/locations/[GCP-LOCATION]/topics/[TOPIC]&#39;
-// For reading
-LOCATION &#39;projects/[PROJECT]/locations/[GCP-LOCATION]/subscriptions/[SUBSCRIPTION]&#39;
-</code></pre><ul><li><code>LOCATION</code>:<ul><li><code>PROJECT</code>: ID of the Google Cloud Project</li><li><code>TOPIC</code>: The Pub/Sub Lite topic name.</li><li><code>SUBSCRIPTION</code>: The Pub/Sub Lite subscription name.</li><li><code>GCP-LOCATION</code>: The location for this Pub/Sub Lite topic os subscription.</li></ul></li><li><code>TBLPROPERTIES</code>:<ul><li><code>timestampAttributeKey</code>: Optional. The key which contains the event
-timestamp associated with the Pub/Sub message. If not specified, the
-message publish timestamp is used as an event timestamp for
-windowing/watermarking.</li><li><code>deadLetterQueue</code>: Optional, supports
-<a href=#generic-dlq-handling>Generic DLQ Handling</a></li><li><code>format</code>: Optional. Allows you to specify the payload format.</li></ul></li></ul><h3 id=read-mode-3>Read Mode</h3><p>PubsubLiteIO supports reading from subscriptions.</p><h3 id=write-mode-3>Write Mode</h3><p>PubsubLiteIO supports writing to topics.</p><h3 id=supported-payload-1>Supported Payload</h3><ul><li>Pub/Sub Lite supports <a href=#generic-payload-handling>Generic Payload Handling</a>.</li></ul><h3 id=example [...]
-TYPE pubsublite
-LOCATION &#39;projects/testing-integration/locations/us-central1-a/topics/user-location&#39;
-</code></pre><h2 id=kafka>Kafka</h2><p>KafkaIO is experimental in Beam SQL.</p><h3 id=syntax-5>Syntax</h3><h4 id=flattened-mode-1>Flattened mode</h4><pre tabindex=0><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName (tableElement [, tableElement ]*)
+</code></pre><h2 id=kafka>Kafka</h2><p>KafkaIO is experimental in Beam SQL.</p><h3 id=syntax-4>Syntax</h3><h4 id=flattened-mode-1>Flattened mode</h4><pre tabindex=0><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName (tableElement [, tableElement ]*)
 TYPE kafka
 LOCATION &#39;my.company.url.com:2181/topic1&#39;
 TBLPROPERTIES &#39;{
@@ -225,38 +206,38 @@ bootstrap servers, which are used in addition to the one in <code>LOCATION</code
 used in addition to the one in <code>LOCATION</code>.</li><li><code>format</code>: Optional. Allows you to specify the Kafka values format. Possible values are
 {<code>csv</code>, <code>avro</code>, <code>json</code>, <code>proto</code>, <code>thrift</code>}. Defaults to <code>csv</code> in
 flattened mode or <code>json</code> in nested mode. <code>csv</code> does not support nested
-mode.</li><li><code>watermark.type</code>: Optional. Defines the strategy for watermark generation. Defaults to <code>ProcessingTime</code>. Supported values are:<ul><li><code>ProcessingTime</code>: Generates watermarks based on the time messages are processed within the Beam pipeline.</li><li><code>LogAppendTime</code>: Generates watermarks based on the timestamps that Kafka brokers append to messages.</li><li><code>CreateTime</code>: Generates watermarks based on the timestamps embedde [...]
+mode.</li><li><code>watermark.type</code>: Optional. Defines the strategy for watermark generation. Defaults to <code>ProcessingTime</code>. Supported values are:<ul><li><code>ProcessingTime</code>: Generates watermarks based on the time messages are processed within the Beam pipeline.</li><li><code>LogAppendTime</code>: Generates watermarks based on the timestamps that Kafka brokers append to messages.</li><li><code>CreateTime</code>: Generates watermarks based on the timestamps embedde [...]
 types specified in the schema.</li></ul></li><li>Kafka supports all <a href=#generic-payload-handling>Generic Payload Handling</a>
-formats.</li></ul><h3 id=schema-2>Schema</h3><p>For CSV only simple types are supported.</p><h2 id=parquet>Parquet</h2><h3 id=syntax-6>Syntax</h3><pre tabindex=0><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName (tableElement [, tableElement ]*)
+formats.</li></ul><h3 id=schema-2>Schema</h3><p>For CSV only simple types are supported.</p><h2 id=parquet>Parquet</h2><h3 id=syntax-5>Syntax</h3><pre tabindex=0><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName (tableElement [, tableElement ]*)
 TYPE parquet
 LOCATION &#39;/path/to/files/&#39;
-</code></pre><ul><li><code>LOCATION</code>: The path to the Parquet file(s). The interpretation of the path is based on a convention:<ul><li><strong>Directory:</strong> A path ending with a forward slash (<code>/</code>) is treated as a directory. Beam reads all files within that directory. Example: <code>'gs://my-bucket/orders/'</code>.</li><li><strong>Glob Pattern:</strong> A path containing wildcard characters (<code>*</code>, <code>?</code>, <code>[]</code>) is treated as a glob patt [...]
+</code></pre><ul><li><code>LOCATION</code>: The path to the Parquet file(s). The interpretation of the path is based on a convention:<ul><li><strong>Directory:</strong> A path ending with a forward slash (<code>/</code>) is treated as a directory. Beam reads all files within that directory. Example: <code>'gs://my-bucket/orders/'</code>.</li><li><strong>Glob Pattern:</strong> A path containing wildcard characters (<code>*</code>, <code>?</code>, <code>[]</code>) is treated as a glob patt [...]
   order_id BIGINT,
   product_name VARCHAR,
   purchase_ts TIMESTAMP
 )
 TYPE parquet
 LOCATION &#39;/gcs/my-data/orders/2025-07-14/*&#39;;
-</code></pre><hr><h2 id=mongodb>MongoDB</h2><h3 id=syntax-7>Syntax</h3><pre tabindex=0><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName (tableElement [, tableElement ]*)
+</code></pre><hr><h2 id=mongodb>MongoDB</h2><h3 id=syntax-6>Syntax</h3><pre tabindex=0><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName (tableElement [, tableElement ]*)
 TYPE mongodb
 LOCATION &#39;mongodb://[HOST]:[PORT]/[DATABASE]/[COLLECTION]&#39;
 </code></pre><ul><li><code>LOCATION</code>: Location of the collection.<ul><li><code>HOST</code>: Location of the MongoDB server. Can be localhost or an ip address.
 When authentication is required username and password can be specified
-as follows: <code>username:password@localhost</code>.</li><li><code>PORT</code>: Port on which MongoDB server is listening.</li><li><code>DATABASE</code>: Database to connect to.</li><li><code>COLLECTION</code>: Collection within the database.</li></ul></li></ul><h3 id=read-mode-6>Read Mode</h3><p>Read Mode supports reading from a collection.</p><h3 id=write-mode-6>Write Mode</h3><p>Write Mode supports writing to a collection.</p><h3 id=schema-4>Schema</h3><p>Only simple types are suppor [...]
+as follows: <code>username:password@localhost</code>.</li><li><code>PORT</code>: Port on which MongoDB server is listening.</li><li><code>DATABASE</code>: Database to connect to.</li><li><code>COLLECTION</code>: Collection within the database.</li></ul></li></ul><h3 id=read-mode-5>Read Mode</h3><p>Read Mode supports reading from a collection.</p><h3 id=write-mode-5>Write Mode</h3><p>Write Mode supports writing to a collection.</p><h3 id=schema-4>Schema</h3><p>Only simple types are suppor [...]
 TYPE mongodb
 LOCATION &#39;mongodb://localhost:27017/apache/users&#39;
 </code></pre><h2 id=text>Text</h2><p>TextIO is experimental in Beam SQL. Read Mode and Write Mode do not currently
-access the same underlying data.</p><h3 id=syntax-8>Syntax</h3><pre tabindex=0><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName (tableElement [, tableElement ]*)
+access the same underlying data.</p><h3 id=syntax-7>Syntax</h3><pre tabindex=0><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName (tableElement [, tableElement ]*)
 TYPE text
 LOCATION &#39;/home/admin/orders&#39;
 TBLPROPERTIES &#39;{&#34;format: &#34;Excel&#34;}&#39;
 </code></pre><ul><li><code>LOCATION</code>: The path to the file for Read Mode. The prefix for Write Mode.</li><li><code>TBLPROPERTIES</code>:<ul><li><code>format</code>: Optional. Allows you to specify the CSV Format, which controls
 the field delimeter, quote character, record separator, and other properties.
-See the following table:</li></ul></li></ul><div class=table-container-wrapper><div class=table-bordered-wrapper><table><thead><tr><th>Value for <code>format</code></th><th>Field delimiter</th><th>Quote</th><th>Record separator</th><th>Ignore empty lines?</th><th>Allow missing column names?</th></tr></thead><tbody><tr><td><code>default</code></td><td><code>,</code></td><td><code>"</code></td><td><code>\r\n</code></td><td>Yes</td><td>No</td></tr><tr><td><code>rfc4180</code></td><td><code> [...]
-types specified in the schema using org.apache.commons.csv.</li></ul></li></ul><h3 id=schema-5>Schema</h3><p>Only simple types are supported.</p><h3 id=example-6>Example</h3><pre tabindex=0><code>CREATE EXTERNAL TABLE orders (id INTEGER, price INTEGER)
+See the following table:</li></ul></li></ul><div class=table-container-wrapper><div class=table-bordered-wrapper><table><thead><tr><th>Value for <code>format</code></th><th>Field delimiter</th><th>Quote</th><th>Record separator</th><th>Ignore empty lines?</th><th>Allow missing column names?</th></tr></thead><tbody><tr><td><code>default</code></td><td><code>,</code></td><td><code>"</code></td><td><code>\r\n</code></td><td>Yes</td><td>No</td></tr><tr><td><code>rfc4180</code></td><td><code> [...]
+types specified in the schema using org.apache.commons.csv.</li></ul></li></ul><h3 id=schema-5>Schema</h3><p>Only simple types are supported.</p><h3 id=example-5>Example</h3><pre tabindex=0><code>CREATE EXTERNAL TABLE orders (id INTEGER, price INTEGER)
 TYPE text
 LOCATION &#39;/home/admin/orders&#39;
-</code></pre><h2 id=datagen>DataGen</h2><p>The <strong>DataGen</strong> connector allows for creating tables based on in-memory data generation. This is useful for developing and testing queries locally without requiring access to external systems. The DataGen connector is built-in; no additional dependencies are required.It is available for Beam 2.67.0+</p><p>Tables can be either <strong>bounded</strong> (generating a fixed number of rows) or <strong>unbounded</strong> (generating a str [...]
+</code></pre><h2 id=datagen>DataGen</h2><p>The <strong>DataGen</strong> connector allows for creating tables based on in-memory data generation. This is useful for developing and testing queries locally without requiring access to external systems. The DataGen connector is built-in; no additional dependencies are required.It is available for Beam 2.67.0+</p><p>Tables can be either <strong>bounded</strong> (generating a fixed number of rows) or <strong>unbounded</strong> (generating a str [...]
 </span></span></span><span class=line><span class=cl><span class=w></span><span class=k>TYPE</span><span class=w> </span><span class=n>datagen</span><span class=w>
 </span></span></span><span class=line><span class=cl><span class=w></span><span class=p>[</span><span class=n>TBLPROPERTIES</span><span class=w> </span><span class=n>tblProperties</span><span class=p>]</span><span class=w>
 </span></span></span></code></pre></div><h3 id=table-properties-tblproperties>Table Properties (<code>TBLPROPERTIES</code>)</h3><p>The <code>TBLPROPERTIES</code> JSON object is used to configure the generator&rsquo;s behavior.</p><h4 id=general-options>General Options</h4><table><thead><tr><th style=text-align:left>Key</th><th style=text-align:left>Required</th><th style=text-align:left>Description</th></tr></thead><tbody><tr><td style=text-align:left><code>number-of-rows</code></td><td  [...]
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index 46489f3e1ba..a0a026a13fa 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.74.0/</loc><lastmod>2026-07-07T16:41:37+02:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2026-07-07T16:41:37+02:00</lastmod></url><url><loc>/blog/</loc><lastmod>2026-07-07T16:41:37+02:00</lastmod></url><url><loc>/categories/</loc><lastmod>2026-07-07T16:41:37+02:00</lastmod></url><url><loc>/catego [...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.74.0/</loc><lastmod>2026-07-07T17:54:53-04:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2026-07-07T17:54:53-04:00</lastmod></url><url><loc>/blog/</loc><lastmod>2026-07-07T17:54:53-04:00</lastmod></url><url><loc>/categories/</loc><lastmod>2026-07-07T17:54:53-04:00</lastmod></url><url><loc>/catego [...]
\ No newline at end of file