You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by me...@apache.org on 2018/03/29 14:54:38 UTC
[beam-site] branch mergebot updated (cb89a1c -> be90acd)
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a change to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git.
from cb89a1c This closes #409
add 3edacf5 Prepare repository for deployment.
new f56466c Make minor fixes to Nexmark page
new 1b34d6b Use {{ site.release_latest }} instead of [version]
new 4926ca9 Make gs paths coherent for runs on dataflow runner
new be90acd This closes #408
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
content/documentation/sdks/java/nexmark/index.html | 4 ++--
src/documentation/sdks/nexmark.md | 19 +++++++++----------
2 files changed, 11 insertions(+), 12 deletions(-)
--
To stop receiving notification emails like this one, please contact
mergebot-role@apache.org.
[beam-site] 03/04: Make gs paths coherent for runs on dataflow
runner
Posted by me...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit 4926ca9481293d5d9c7a2b77cdbc3ecd63b15dac
Author: Etienne Chauchot <ec...@apache.org>
AuthorDate: Thu Mar 29 10:15:29 2018 +0200
Make gs paths coherent for runs on dataflow runner
---
src/documentation/sdks/nexmark.md | 11 +++++------
1 file changed, 5 insertions(+), 6 deletions(-)
diff --git a/src/documentation/sdks/nexmark.md b/src/documentation/sdks/nexmark.md
index 1c4942a..5e86cd7 100644
--- a/src/documentation/sdks/nexmark.md
+++ b/src/documentation/sdks/nexmark.md
@@ -173,10 +173,9 @@ Available suites are:
--project=<your project> \
--zone=<your zone> \
--workerMachineType=n1-highmem-8 \
- --stagingLocation=<a gs path for staging> \
+ --stagingLocation=gs://<a gs path for staging> \
--runner=DataflowRunner \
- --tempLocation=gs://[your temp location] \
- --stagingLocation=gs://[your staging location] \
+ --tempLocation=gs://<a gs path for temporary files> \
--filesToStage=target/beam-sdks-java-nexmark-{{ site.release_latest }}.jar
### Direct runner specific configuration
@@ -476,7 +475,7 @@ java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-{{ site.release
--project=<your project> \
--zone=<your zone> \
--workerMachineType=n1-highmem-8 \
- --stagingLocation=<a gs path for staging> \
+ --stagingLocation=gs://<a gs path for staging> \
--streaming=true \
--sourceType=PUBSUB \
--pubSubMode=PUBLISH_ONLY \
@@ -510,7 +509,7 @@ java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-{{ site.release
--project=<your project> \
--zone=<your zone> \
--workerMachineType=n1-highmem-8 \
- --stagingLocation=<a gs path for staging> \
+ --stagingLocation=gs://<a gs path for staging> \
--streaming=true \
--sourceType=PUBSUB \
--pubSubMode=SUBSCRIBE_ONLY \
@@ -522,7 +521,7 @@ java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-{{ site.release
--maxNumWorkers=64 \
--suite=SMOKE \
--usePubsubPublishTime=true \
- --outputPath=<a gs path under which log files will be written> \
+ --outputPath=gs://<a gs path under which log files will be written> \
--windowSizeSec=600 \
--occasionalDelaySec=3600 \
--maxLogEvents=10000 \
--
To stop receiving notification emails like this one, please contact
mergebot-role@apache.org.
[beam-site] 01/04: Make minor fixes to Nexmark page
Posted by me...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit f56466c47704412e62c81cb6bdee8d8464e16cf9
Author: Etienne Chauchot <ec...@apache.org>
AuthorDate: Wed Mar 28 15:06:54 2018 +0200
Make minor fixes to Nexmark page
---
src/documentation/sdks/nexmark.md | 12 ++++++------
1 file changed, 6 insertions(+), 6 deletions(-)
diff --git a/src/documentation/sdks/nexmark.md b/src/documentation/sdks/nexmark.md
index c7655f2..0f036cc 100644
--- a/src/documentation/sdks/nexmark.md
+++ b/src/documentation/sdks/nexmark.md
@@ -175,9 +175,9 @@ Available suites are:
--workerMachineType=n1-highmem-8 \
--stagingLocation=<a gs path for staging> \
--runner=DataflowRunner \
- --tempLocation=gs://talend-imejia/nexmark/temp/ \
- --stagingLocation=gs://talend-imejia/nexmark/temp/staging/ \
- --filesToStage=target/beam-sdks-java-nexmark-2.1.0-SNAPSHOT.jar
+ --tempLocation=gs://[your temp location] \
+ --stagingLocation=gs://[your staging location] \
+ --filesToStage=target/beam-sdks-java-nexmark-[version].jar
### Direct runner specific configuration
@@ -470,7 +470,7 @@ Submit to Google Dataflow service:
```
-java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-2.1.0-SNAPSHOT.jar \
+java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-[version].jar \
org.apache.beam.sdk.nexmark.Main \
--runner=DataflowRunner
--project=<your project> \
@@ -504,7 +504,7 @@ java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-2.1.0-SNAPSHOT.
```
```
-java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-2.1.0-SNAPSHOT.jar \
+java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-[version].jar \
org.apache.beam.sdk.nexmark.Main \
--runner=DataflowRunner
--project=<your project> \
@@ -538,4 +538,4 @@ Building package:
Submit to the cluster:
- spark-submit --master yarn-client --class org.apache.beam.sdk.nexmark.Main --driver-memory 512m --executor-memory 512m --executor-cores 1 beam-sdks-java-nexmark-bundled-2.1.0-SNAPSHOT.jar --runner=SparkRunner --query=0 --streamTimeout=60 --streaming=false --manageResources=false --monitorJobs=true
+ spark-submit --master yarn-client --class org.apache.beam.sdk.nexmark.Main --driver-memory 512m --executor-memory 512m --executor-cores 1 beam-sdks-java-nexmark-bundled-[version].jar --runner=SparkRunner --query=0 --streamTimeout=60 --streaming=false --manageResources=false --monitorJobs=true
--
To stop receiving notification emails like this one, please contact
mergebot-role@apache.org.
[beam-site] 04/04: This closes #408
Posted by me...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit be90acd913cc5642f32a7aa16badcdc722d6bb5c
Merge: 3edacf5 4926ca9
Author: Mergebot <me...@apache.org>
AuthorDate: Thu Mar 29 07:54:18 2018 -0700
This closes #408
src/documentation/sdks/nexmark.md | 19 +++++++++----------
1 file changed, 9 insertions(+), 10 deletions(-)
--
To stop receiving notification emails like this one, please contact
mergebot-role@apache.org.
[beam-site] 02/04: Use {{ site.release_latest }} instead of
[version]
Posted by me...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit 1b34d6b7bb946c4eeaad7d14e8a066847fdcee59
Author: Etienne Chauchot <ec...@apache.org>
AuthorDate: Thu Mar 29 10:05:49 2018 +0200
Use {{ site.release_latest }} instead of [version]
---
src/documentation/sdks/nexmark.md | 8 ++++----
1 file changed, 4 insertions(+), 4 deletions(-)
diff --git a/src/documentation/sdks/nexmark.md b/src/documentation/sdks/nexmark.md
index 0f036cc..1c4942a 100644
--- a/src/documentation/sdks/nexmark.md
+++ b/src/documentation/sdks/nexmark.md
@@ -177,7 +177,7 @@ Available suites are:
--runner=DataflowRunner \
--tempLocation=gs://[your temp location] \
--stagingLocation=gs://[your staging location] \
- --filesToStage=target/beam-sdks-java-nexmark-[version].jar
+ --filesToStage=target/beam-sdks-java-nexmark-{{ site.release_latest }}.jar
### Direct runner specific configuration
@@ -470,7 +470,7 @@ Submit to Google Dataflow service:
```
-java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-[version].jar \
+java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-{{ site.release_latest }}.jar \
org.apache.beam.sdk.nexmark.Main \
--runner=DataflowRunner
--project=<your project> \
@@ -504,7 +504,7 @@ java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-[version].jar \
```
```
-java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-[version].jar \
+java -cp sdks/java/nexmark/target/beam-sdks-java-nexmark-bundled-{{ site.release_latest }}.jar \
org.apache.beam.sdk.nexmark.Main \
--runner=DataflowRunner
--project=<your project> \
@@ -538,4 +538,4 @@ Building package:
Submit to the cluster:
- spark-submit --master yarn-client --class org.apache.beam.sdk.nexmark.Main --driver-memory 512m --executor-memory 512m --executor-cores 1 beam-sdks-java-nexmark-bundled-[version].jar --runner=SparkRunner --query=0 --streamTimeout=60 --streaming=false --manageResources=false --monitorJobs=true
+ spark-submit --master yarn-client --class org.apache.beam.sdk.nexmark.Main --driver-memory 512m --executor-memory 512m --executor-cores 1 beam-sdks-java-nexmark-bundled-{{ site.release_latest }}.jar --runner=SparkRunner --query=0 --streamTimeout=60 --streaming=false --manageResources=false --monitorJobs=true
--
To stop receiving notification emails like this one, please contact
mergebot-role@apache.org.