You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by me...@apache.org on 2018/07/17 18:50:16 UTC
[beam-site] branch asf-site updated (f82a1d7 -> 0e17f90)
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git.
from f82a1d7 Prepare repository for deployment.
add 48e7dec Rename RowType to Schema in SQL walkthrough
add d8dbf5a This closes #495
new 0e17f90 Prepare repository for deployment.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../documentation/dsls/sql/walkthrough/index.html | 41 ++++++++++----------
src/documentation/dsls/sql/walkthrough.md | 45 +++++++++++-----------
2 files changed, 44 insertions(+), 42 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
Posted by me...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit 0e17f9034c50924ea365ae89b3afe2c6b2092a1a
Author: Mergebot <me...@apache.org>
AuthorDate: Tue Jul 17 18:50:12 2018 +0000
Prepare repository for deployment.
---
.../documentation/dsls/sql/walkthrough/index.html | 41 +++++++++++-----------
1 file changed, 21 insertions(+), 20 deletions(-)
diff --git a/content/documentation/dsls/sql/walkthrough/index.html b/content/documentation/dsls/sql/walkthrough/index.html
index 3e258df..750cb9f 100644
--- a/content/documentation/dsls/sql/walkthrough/index.html
+++ b/content/documentation/dsls/sql/walkthrough/index.html
@@ -253,10 +253,10 @@ limitations under the License.
<p>Before applying a SQL query to a <code class="highlighter-rouge">PCollection</code>, the data in the collection must
be in <code class="highlighter-rouge">Row</code> format. A <code class="highlighter-rouge">Row</code> represents a single, immutable record in a Beam SQL
<code class="highlighter-rouge">PCollection</code>. The names and types of the fields/columns in the row are defined
-by its associated <a href="/documentation/sdks/javadoc/2.5.0/index.html?org/apache/beam/sdk/values/RowType.html">RowType</a>.
-For SQL queries, you should use the <a href="/documentation/sdks/javadoc/2.5.0/index.html?org/apache/beam/sdk/extensions/sql/RowSqlType.html">RowSqlType.builder()</a> to create
-<code class="highlighter-rouge">RowTypes</code>, it allows creating schemas with all supported SQL types (see <a href="/documentation/dsls/sql/data-types">Data
-Types</a> for more details on supported primitive data types).</p>
+by its associated <a href="/documentation/sdks/javadoc/2.5.0/index.html?org/apache/beam/sdk/schemas/Schema.html">Schema</a>.
+You can use the <a href="/documentation/sdks/javadoc/2.5.0/index.html?org/apache/beam/sdk/schemas/Schema.html">Schema.builder()</a> to create
+<code class="highlighter-rouge">Schemas</code>. See <a href="/documentation/dsls/sql/data-types">Data
+Types</a> for more details on supported primitive data types.</p>
<p>A <code class="highlighter-rouge">PCollection<Row></code> can be obtained multiple ways, for example:</p>
@@ -267,18 +267,18 @@ Types</a> for more details on supported primitive data types).</p>
<p><strong>Note:</strong> you have to explicitly specify the <code class="highlighter-rouge">Row</code> coder. In this example we’re doing it by calling <code class="highlighter-rouge">Create.of(..).withCoder()</code>:</p>
<div class="language-java highlighter-rouge"><pre class="highlight"><code><span class="c1">// Define the record type (i.e., schema).</span>
-<span class="n">RowType</span> <span class="n">appType</span> <span class="o">=</span>
- <span class="n">RowSqlType</span>
+<span class="n">Schema</span> <span class="n">appSchema</span> <span class="o">=</span>
+ <span class="n">Schema</span>
<span class="o">.</span><span class="na">builder</span><span class="o">()</span>
- <span class="o">.</span><span class="na">withIntegerField</span><span class="o">(</span><span class="s">"appId"</span><span class="o">)</span>
- <span class="o">.</span><span class="na">withVarcharField</span><span class="o">(</span><span class="s">"description"</span><span class="o">)</span>
- <span class="o">.</span><span class="na">withTimestampField</span><span class="o">(</span><span class="s">"rowtime"</span><span class="o">)</span>
+ <span class="o">.</span><span class="na">addInt32Field</span><span class="o">(</span><span class="s">"appId"</span><span class="o">)</span>
+ <span class="o">.</span><span class="na">addStringField</span><span class="o">(</span><span class="s">"description"</span><span class="o">)</span>
+ <span class="o">.</span><span class="na">addDateTimeField</span><span class="o">(</span><span class="s">"rowtime"</span><span class="o">)</span>
<span class="o">.</span><span class="na">build</span><span class="o">();</span>
<span class="c1">// Create a concrete row with that type.</span>
<span class="n">Row</span> <span class="n">row</span> <span class="o">=</span>
<span class="n">Row</span>
- <span class="o">.</span><span class="na">withRowType</span><span class="o">(</span><span class="n">appType</span><span class="o">)</span>
+ <span class="o">.</span><span class="na">withSchema</span><span class="o">(</span><span class="n">appSchema</span><span class="o">)</span>
<span class="o">.</span><span class="na">addValues</span><span class="o">(</span><span class="mi">1</span><span class="o">,</span> <span class="s">"Some cool app"</span><span class="o">,</span> <span class="k">new</span> <span class="n">Date</span><span class="o">())</span>
<span class="o">.</span><span class="na">build</span><span class="o">();</span>
@@ -288,14 +288,14 @@ Types</a> for more details on supported primitive data types).</p>
<span class="o">.</span><span class="na">in</span><span class="o">(</span><span class="n">p</span><span class="o">)</span>
<span class="o">.</span><span class="na">apply</span><span class="o">(</span><span class="n">Create</span>
<span class="o">.</span><span class="na">of</span><span class="o">(</span><span class="n">row</span><span class="o">)</span>
- <span class="o">.</span><span class="na">withCoder</span><span class="o">(</span><span class="n">appType</span><span class="o">.</span><span class="na">getRowCoder</span><span class="o">()));</span>
+ <span class="o">.</span><span class="na">withCoder</span><span class="o">(</span><span class="n">appSchema</span><span class="o">.</span><span class="na">getRowCoder</span><span class="o">()));</span>
</code></pre>
</div>
</li>
<li>
<p><strong>From a <code class="highlighter-rouge">PCollection<T></code> of records of some other type</strong> (i.e. <code class="highlighter-rouge">T</code> is not already a <code class="highlighter-rouge">Row</code>), by applying a <code class="highlighter-rouge">ParDo</code> that converts input records to <code class="highlighter-rouge">Row</code> format.</p>
- <p><strong>Note:</strong> you have to manually set the coder of the result by calling <code class="highlighter-rouge">setCoder(appType.getRowCoder())</code>:</p>
+ <p><strong>Note:</strong> you have to manually set the coder of the result by calling <code class="highlighter-rouge">setCoder(appSchema.getRowCoder())</code>:</p>
<div class="language-java highlighter-rouge"><pre class="highlight"><code><span class="c1">// An example POJO class.</span>
<span class="kd">class</span> <span class="nc">AppPojo</span> <span class="o">{</span>
<span class="n">Integer</span> <span class="n">appId</span><span class="o">;</span>
@@ -315,11 +315,11 @@ Types</a> for more details on supported primitive data types).</p>
<span class="c1">// Get the current POJO instance</span>
<span class="n">AppPojo</span> <span class="n">pojo</span> <span class="o">=</span> <span class="n">c</span><span class="o">.</span><span class="na">element</span><span class="o">();</span>
- <span class="c1">// Create a Row with the appType schema </span>
+ <span class="c1">// Create a Row with the appSchema schema </span>
<span class="c1">// and values from the current POJO</span>
<span class="n">Row</span> <span class="n">appRow</span> <span class="o">=</span>
<span class="n">Row</span>
- <span class="o">.</span><span class="na">withRowType</span><span class="o">(</span><span class="n">appType</span><span class="o">)</span>
+ <span class="o">.</span><span class="na">withSchema</span><span class="o">(</span><span class="n">appSchema</span><span class="o">)</span>
<span class="o">.</span><span class="na">addValues</span><span class="o">(</span>
<span class="n">pojo</span><span class="o">.</span><span class="na">appId</span><span class="o">,</span>
<span class="n">pojo</span><span class="o">.</span><span class="na">description</span><span class="o">,</span>
@@ -330,7 +330,7 @@ Types</a> for more details on supported primitive data types).</p>
<span class="n">c</span><span class="o">.</span><span class="na">output</span><span class="o">(</span><span class="n">appRow</span><span class="o">);</span>
<span class="o">}</span>
<span class="o">}))</span>
- <span class="o">.</span><span class="na">setCoder</span><span class="o">(</span><span class="n">appType</span><span class="o">.</span><span class="na">getRowCoder</span><span class="o">());</span>
+ <span class="o">.</span><span class="na">setCoder</span><span class="o">(</span><span class="n">appSchema</span><span class="o">.</span><span class="na">getRowCoder</span><span class="o">());</span>
</code></pre>
</div>
</li>
@@ -363,12 +363,13 @@ to either a single <code class="highlighter-rouge">PCollection</code> or a <code
<p>For example, you can join two <code class="highlighter-rouge">PCollections</code>:</p>
<div class="language-java highlighter-rouge"><pre class="highlight"><code><span class="c1">// Create the schema for reviews</span>
-<span class="n">RowType</span> <span class="n">reviewType</span> <span class="o">=</span>
- <span class="n">RowSqlType</span><span class="o">.</span>
- <span class="o">.</span><span class="na">withIntegerField</span><span class="o">(</span><span class="s">"appId"</span><span class="o">)</span>
- <span class="o">.</span><span class="na">withIntegerField</span><span class="o">(</span><span class="s">"reviewerId"</span><span class="o">)</span>
+<span class="n">Schema</span> <span class="n">reviewSchema</span> <span class="o">=</span>
+ <span class="n">Schema</span><span class="o">.</span>
+ <span class="o">.</span><span class="na">builder</span><span class="o">()</span>
+ <span class="o">.</span><span class="na">addInt32Field</span><span class="o">(</span><span class="s">"appId"</span><span class="o">)</span>
+ <span class="o">.</span><span class="na">addInt32Field</span><span class="o">(</span><span class="s">"reviewerId"</span><span class="o">)</span>
<span class="o">.</span><span class="na">withFloatField</span><span class="o">(</span><span class="s">"rating"</span><span class="o">)</span>
- <span class="o">.</span><span class="na">withTimestampField</span><span class="o">(</span><span class="s">"rowtime"</span><span class="o">)</span>
+ <span class="o">.</span><span class="na">addDateTimeField</span><span class="o">(</span><span class="s">"rowtime"</span><span class="o">)</span>
<span class="o">.</span><span class="na">build</span><span class="o">();</span>
<span class="c1">// Obtain the reviews records with this schema</span>