You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2019/07/19 14:14:12 UTC
[beam] branch asf-site updated: Publishing website 2019/07/19
14:13:55 at commit 9589835
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new ab4df17 Publishing website 2019/07/19 14:13:55 at commit 9589835
ab4df17 is described below
commit ab4df170e26d2c45a33f8a7a8cb5290110c4147b
Author: jenkins <bu...@apache.org>
AuthorDate: Fri Jul 19 14:13:56 2019 +0000
Publishing website 2019/07/19 14:13:55 at commit 9589835
---
.../documentation/runners/flink/index.html | 23 +++++++++++++++++++---
1 file changed, 20 insertions(+), 3 deletions(-)
diff --git a/website/generated-content/documentation/runners/flink/index.html b/website/generated-content/documentation/runners/flink/index.html
index e6fae5c..7ab9e43 100644
--- a/website/generated-content/documentation/runners/flink/index.html
+++ b/website/generated-content/documentation/runners/flink/index.html
@@ -319,6 +319,11 @@ period.</p>
<th>Artifact Id</th>
</tr>
<tr>
+ <td>>=2.14.0</td>
+ <td>1.9.x</td>
+ <td>beam-runners-flink-1.9</td>
+</tr>
+<tr>
<td>>=2.13.0</td>
<td>1.8.x</td>
<td>beam-runners-flink-1.8</td>
@@ -484,9 +489,8 @@ provided with the Flink JobManager address.
<span class="kn">from</span> <span class="nn">apache_beam.options.pipeline_options</span> <span class="kn">import</span> <span class="n">PipelineOptions</span>
<span class="n">options</span> <span class="o">=</span> <span class="n">PipelineOptions</span><span class="p">([</span><span class="s">"--runner=PortableRunner"</span><span class="p">,</span> <span class="s">"--job_endpoint=localhost:8099"</span><span class="p">])</span>
-<span class="n">p</span> <span class="o">=</span> <span class="n">beam</span><span class="o">.</span><span class="n">Pipeline</span><span class="p">(</span><span class="n">options</span><span class="p">)</span>
-<span class="o">..</span>
-<span class="n">p</span><span class="o">.</span><span class="n">run</span><span class="p">()</span>
+<span class="k">with</span> <span class="n">beam</span><span class="o">.</span><span class="n">Pipeline</span><span class="p">(</span><span class="n">options</span><span class="p">)</span> <span class="k">as</span> <span class="n">p</span><span class="p">:</span>
+ <span class="o">...</span>
</code></pre>
</div>
@@ -503,6 +507,19 @@ To run on a separate <a href="https://ci.apache.org/projects/flink/flink-docs-re
<p><span class="language-py">3. Submit the pipeline as above.
</span></p>
+<p><span class="language-py">As of Beam 2.15.0, steps 2 and 3 can be automated in Python by using the <code class="highlighter-rouge">FlinkRunner</code>,
+plus the optional <code class="highlighter-rouge">flink_version</code> and <code class="highlighter-rouge">flink_master_url</code> options if required, i.e.
+</span></p>
+
+<div class="language-py highlighter-rouge"><pre class="highlight"><code><span class="kn">import</span> <span class="nn">apache_beam</span> <span class="kn">as</span> <span class="nn">beam</span>
+<span class="kn">from</span> <span class="nn">apache_beam.options.pipeline_options</span> <span class="kn">import</span> <span class="n">PipelineOptions</span>
+
+<span class="n">options</span> <span class="o">=</span> <span class="n">PipelineOptions</span><span class="p">([</span><span class="s">"--runner=FlinkRunner"</span><span class="p">,</span> <span class="s">"--flink_version=1.8"</span><span class="p">,</span> <span class="s">"--flink_master_url=localhost:8081"</span><span class="p">])</span>
+<span class="k">with</span> <span class="n">beam</span><span class="o">.</span><span class="n">Pipeline</span><span class="p">(</span><span class="n">options</span><span class="p">)</span> <span class="k">as</span> <span class="n">p</span><span class="p">:</span>
+ <span class="o">...</span>
+</code></pre>
+</div>
+
<h2 id="additional-information-and-caveats">Additional information and caveats</h2>
<h3 id="monitoring-your-job">Monitoring your job</h3>