You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2020/11/03 06:05:34 UTC
[beam] branch asf-site updated: Publishing website 2020/11/03
06:05:06 at commit 64ec3da
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new bb17b9d Publishing website 2020/11/03 06:05:06 at commit 64ec3da
bb17b9d is described below
commit bb17b9d9cc2e93b087443930a86b7192e89f5b16
Author: jenkins <bu...@apache.org>
AuthorDate: Tue Nov 3 06:05:06 2020 +0000
Publishing website 2020/11/03 06:05:06 at commit 64ec3da
---
.../dsls/sql/extensions/create-external-table/index.html | 6 ++++--
website/generated-content/sitemap.xml | 2 +-
2 files changed, 5 insertions(+), 3 deletions(-)
diff --git a/website/generated-content/documentation/dsls/sql/extensions/create-external-table/index.html b/website/generated-content/documentation/dsls/sql/extensions/create-external-table/index.html
index 83dd18a..ceba3de 100644
--- a/website/generated-content/documentation/dsls/sql/extensions/create-external-table/index.html
+++ b/website/generated-content/documentation/dsls/sql/extensions/create-external-table/index.html
@@ -95,13 +95,15 @@ TBLPROPERTIES '{
"bootstrap.servers":"localhost:9092",
"topics": ["topic1", "topic2"],
"format": "avro"
+ [, "protoClass": "com.example.ExampleMessage" ]*
}'
</code></pre><ul><li><code>LOCATION</code>: The Kafka topic URL.</li><li><code>TBLPROPERTIES</code>:<ul><li><code>bootstrap.servers</code>: Optional. Allows you to specify the bootstrap
server.</li><li><code>topics</code>: Optional. Allows you to specify specific topics.</li><li><code>format</code>: Optional. Allows you to specify the Kafka values format. Possible values are
-{<code>csv</code>, <code>avro</code>, <code>json</code>}. Defaults to <code>csv</code>.</li></ul></li></ul><h3 id=read-mode-2>Read Mode</h3><p>Read Mode supports reading from a topic.</p><h3 id=write-mode-2>Write Mode</h3><p>Write Mode supports writing to a topic.</p><h3 id=supported-formats>Supported Formats</h3><ul><li>CSV (default)<ul><li>Beam parses the messages, attempting to parse fields according to the
+{<code>csv</code>, <code>avro</code>, <code>json</code>, <code>proto</code>}. Defaults to <code>csv</code>.</li><li><code>protoClass</code>: Optional. Use only when <code>format</code> is equal to <code>proto</code>. Allows you to
+specify full protocol buffer java class name.</li></ul></li></ul><h3 id=read-mode-2>Read Mode</h3><p>Read Mode supports reading from a topic.</p><h3 id=write-mode-2>Write Mode</h3><p>Write Mode supports writing to a topic.</p><h3 id=supported-formats>Supported Formats</h3><ul><li>CSV (default)<ul><li>Beam parses the messages, attempting to parse fields according to the
types specified in the schema.</li></ul></li><li>Avro<ul><li>An Avro schema is automatically generated from the specified field
types. It is used to parse incoming messages and to format outgoing
-messages.</li></ul></li><li>JSON Objects<ul><li>Beam attempts to parse JSON to match the schema.</li></ul></li></ul><h3 id=schema-2>Schema</h3><p>For CSV only simple types are supported.</p><h2 id=mongodb>MongoDB</h2><h3 id=syntax-4>Syntax</h3><pre><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName (tableElement [, tableElement ]*)
+messages.</li></ul></li><li>JSON Objects<ul><li>Beam attempts to parse JSON to match the schema.</li></ul></li><li>Protocol buffers<ul><li>Fields in the schema have to match the fields of the given <code>protoClass</code>.</li></ul></li></ul><h3 id=schema-2>Schema</h3><p>For CSV only simple types are supported.</p><h2 id=mongodb>MongoDB</h2><h3 id=syntax-4>Syntax</h3><pre><code>CREATE EXTERNAL TABLE [ IF NOT EXISTS ] tableName (tableElement [, tableElement ]*)
TYPE mongodb
LOCATION 'mongodb://[HOST]:[PORT]/[DATABASE]/[COLLECTION]'
</code></pre><ul><li><code>LOCATION</code>: Location of the collection.<ul><li><code>HOST</code>: Location of the MongoDB server. Can be localhost or an ip address.
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index 6345462..56688a7 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.25.0/</loc><lastmod>2020-10-29T14:08:19-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2020-10-29T14:08:19-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2020-10-29T14:08:19-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2020-10-29T14:08:19-07:00</lastmod></url><url><loc>/blog/b [...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.25.0/</loc><lastmod>2020-10-29T14:08:19-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2020-10-29T14:08:19-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2020-10-29T14:08:19-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2020-10-29T14:08:19-07:00</lastmod></url><url><loc>/blog/b [...]
\ No newline at end of file