[beam] branch lostluck-testp created (now 75529f9)

[lo...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a change to branch lostluck-testp
in repository https://gitbox.apache.org/repos/asf/beam.git.


      at 75529f9  [GoSDK Infra] Limit simultaneous tests binaries to 3.

This branch includes the following new commits:

     new 75529f9  [GoSDK Infra] Limit simultaneous tests binaries to 3.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.

[beam] 01/01: [GoSDK Infra] Limit simultaneous tests binaries to 3.

[lo...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a commit to branch lostluck-testp
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 75529f95425e729aa15a768274377d5a892737c5
Author: Robert Burke <lo...@users.noreply.github.com>
AuthorDate: Wed Aug 11 16:38:05 2021 -0700

    [GoSDK Infra] Limit simultaneous tests binaries to 3.
    
    Executing all test binaries at the same time seems to be overloading the mini-local Flink runner,
    setting a limit to avoid overwhelming it.
---
 sdks/go/test/run_validatesrunner_tests.sh | 10 +++++++++-
 1 file changed, 9 insertions(+), 1 deletion(-)

diff --git a/sdks/go/test/run_validatesrunner_tests.sh b/sdks/go/test/run_validatesrunner_tests.sh
index 0f404b5..8e42271 100755
--- a/sdks/go/test/run_validatesrunner_tests.sh
+++ b/sdks/go/test/run_validatesrunner_tests.sh
@@ -79,6 +79,9 @@ RUNNER=portable
 # packages are executed in parallel.
 TIMEOUT=1h
 
+# Default limit on simultaneous test binaries/packages being executed.
+PARALLEL=3
+
 # Where to store integration test outputs.
 GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
 
@@ -356,6 +359,11 @@ else
   CONTAINER=apache/beam_go_sdk
 fi
 
+
+# -p dictates the number of parallel test binaries running tests.
+# --parallel indicates within a test binary level of parallism.
+ARGS="$ARGS -p $PARALLEL"
+
 # Assemble test arguments and pipeline options.
 ARGS="$ARGS --timeout=$TIMEOUT"
 ARGS="$ARGS --runner=$RUNNER"
@@ -394,7 +402,7 @@ if [[ "$JENKINS" == true ]]; then
   echo ">>> For Jenkins environment, changing test targets to: $TESTS"
 
   echo ">>> RUNNING $RUNNER integration tests with pipeline options: $ARGS"
-  GOPATH=$TEMP_GOPATH go test -v $TESTS $ARGS \
+  GOPATH=$TEMP_GOPATH go test -v  $TESTS $ARGS \
       || TEST_EXIT_CODE=$? # don't fail fast here; clean up environment before exiting
 else
   echo ">>> RUNNING $RUNNER integration tests with pipeline options: $ARGS"