You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by me...@apache.org on 2018/09/05 20:45:39 UTC
[beam-site] branch mergebot updated (6932df9 -> 91d5227)
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a change to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git.
from 6932df9 This closes #546
add 27eac2e Prepare repository for deployment.
new 0c32c28 Update Portable Flink cluster run instructions
new 91d5227 This closes #544
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
content/contribute/intellij/index.html | 10 +---------
src/contribute/portability.md | 7 ++++---
2 files changed, 5 insertions(+), 12 deletions(-)
[beam-site] 01/02: Update Portable Flink cluster run instructions
Posted by me...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit 0c32c2823673bcfa5f146be9705b2d469b13d3ab
Author: Ankur <an...@users.noreply.github.com>
AuthorDate: Wed Aug 29 14:42:47 2018 -0700
Update Portable Flink cluster run instructions
---
src/contribute/portability.md | 7 ++++---
1 file changed, 4 insertions(+), 3 deletions(-)
diff --git a/src/contribute/portability.md b/src/contribute/portability.md
index 4e3be37..c3abaad 100644
--- a/src/contribute/portability.md
+++ b/src/contribute/portability.md
@@ -175,7 +175,7 @@ their respective components.
### Status
MVP in progress (near completion for Flink runner). See the
-[Portability support table](https://docs.google.com/spreadsheets/d/1KDa_FGn1ShjomGd-UUDOhuh2q73de2tPz6BqHpzqvNI/edit?usp=sharing)
+[Portability support table](https://s.apache.org/apache-beam-portability-support-table)
for details.
#### Running Python wordcount on Flink
@@ -192,7 +192,8 @@ To run on a separate [Flink cluster](https://ci.apache.org/projects/flink/flink-
1. Start local Flink cluster
2. Create shaded JobService jar: `./gradlew :beam-runners-flink_2.11-job-server:installShadowDist`
-3. Start JobService with Flink web service endpoint: `java -jar ./runners/flink/job-server/build/install/beam-runners-flink_2.11-job-server-shadow/lib/beam-runners-flink_2.11-job-server-*.jar "--job-host=localhost:8099" "--artifacts-dir=/tmp/flink-artifacts" "--flink-master-url=localhost:8081"`
-4. Submit the pipeline.
+3. Optional optimization step: Place the generated JobServer Jar `beam/runners/flink/job-server/build/libs/beam-runners-flink_2.11-job-server-2.7.0-SNAPSHOT.jar` in `flink/lib` and change class loading order for Flink by adding `classloader.resolve-order: parent-first` to `conf/flink-conf.yaml`.
+4. Start JobService with Flink web service endpoint: `./gradlew :beam-runners-flink_2.11-job-server:runShadow -PflinkMasterUrl=localhost:8081`
+5. Submit the pipeline.
Note: A subset of the functionality is also supported in streaming mode; use `--streaming` in the command line to enable it.
[beam-site] 02/02: This closes #544
Posted by me...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit 91d522768cd811cc7549b135961e819d130c7c98
Merge: 27eac2e 0c32c28
Author: Mergebot <me...@apache.org>
AuthorDate: Wed Sep 5 20:45:00 2018 +0000
This closes #544
src/contribute/portability.md | 7 ++++---
1 file changed, 4 insertions(+), 3 deletions(-)