[beam] 01/01: [GoSDK Infra] Limit simultaneous tests binaries to 3.

[lo...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

lostluck pushed a commit to branch lostluck-testp
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 75529f95425e729aa15a768274377d5a892737c5
Author: Robert Burke <lo...@users.noreply.github.com>
AuthorDate: Wed Aug 11 16:38:05 2021 -0700

    [GoSDK Infra] Limit simultaneous tests binaries to 3.
    
    Executing all test binaries at the same time seems to be overloading the mini-local Flink runner,
    setting a limit to avoid overwhelming it.
---
 sdks/go/test/run_validatesrunner_tests.sh | 10 +++++++++-
 1 file changed, 9 insertions(+), 1 deletion(-)

diff --git a/sdks/go/test/run_validatesrunner_tests.sh b/sdks/go/test/run_validatesrunner_tests.sh
index 0f404b5..8e42271 100755
--- a/sdks/go/test/run_validatesrunner_tests.sh
+++ b/sdks/go/test/run_validatesrunner_tests.sh
@@ -79,6 +79,9 @@ RUNNER=portable
 # packages are executed in parallel.
 TIMEOUT=1h
 
+# Default limit on simultaneous test binaries/packages being executed.
+PARALLEL=3
+
 # Where to store integration test outputs.
 GCS_LOCATION=gs://temp-storage-for-end-to-end-tests
 
@@ -356,6 +359,11 @@ else
   CONTAINER=apache/beam_go_sdk
 fi
 
+
+# -p dictates the number of parallel test binaries running tests.
+# --parallel indicates within a test binary level of parallism.
+ARGS="$ARGS -p $PARALLEL"
+
 # Assemble test arguments and pipeline options.
 ARGS="$ARGS --timeout=$TIMEOUT"
 ARGS="$ARGS --runner=$RUNNER"
@@ -394,7 +402,7 @@ if [[ "$JENKINS" == true ]]; then
   echo ">>> For Jenkins environment, changing test targets to: $TESTS"
 
   echo ">>> RUNNING $RUNNER integration tests with pipeline options: $ARGS"
-  GOPATH=$TEMP_GOPATH go test -v $TESTS $ARGS \
+  GOPATH=$TEMP_GOPATH go test -v  $TESTS $ARGS \
       || TEST_EXIT_CODE=$? # don't fail fast here; clean up environment before exiting
 else
   echo ">>> RUNNING $RUNNER integration tests with pipeline options: $ARGS"