Build failed in Jenkins: beam_LoadTests_Python_GBK_Dataflow_Streaming #16

[Apache Jenkins Server <je...@builds.apache.org>]

See <https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/16/display/redirect?page=changes>

Changes:

[Kamil Wasilewski] [BEAM-10672] Move StatefulLoadGenerator from pardo_test.py

[Kamil Wasilewski] [BEAM-10672] Several fixes to init actions for Dataproc cluster

[Kamil Wasilewski] [BEAM-10672] Add Python Combine Load Tests for streaming on Flink

[Kamil Wasilewski] [BEAM-10672] Use customized image tags

[Kamil Wasilewski] [BEAM-10672] Update Load tests jobs README

[Kamil Wasilewski] fix: separate job for building Docker images


------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-5 (beam) in workspace <https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
 > git init <https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision d4e3729460dc710f954e22c92c36e8f00a24bd4c (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f d4e3729460dc710f954e22c92c36e8f00a24bd4c # timeout=10
Commit message: "Merge pull request #12698: [BEAM-10672] Add Python Combine Load Tests for streaming on Flink"
 > git rev-list --no-walk ba89e76f5daecd496cafb2861dac5ef69480a973 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1
SETUPTOOLS_USE_DISTUTILS=stdlib

[EnvInject] - Variables injected successfully.
[beam_LoadTests_Python_GBK_Dataflow_Streaming] $ /bin/bash -xe /tmp/jenkins5233079169206242082.sh
+ echo '*** GroupByKey Python Load test: 2GB of 100kB records ***'
*** GroupByKey Python Load test: 2GB of 100kB records ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/src/gradlew> -PloadTest.mainClass=apache_beam.testing.load_tests.group_by_key_test -Prunner=DataflowRunner -PwithDataflowWorkerJar=false '-PloadTest.args=--job_name=load-tests-python-dataflow-streaming-gbk-3-0908100214 --project=apache-beam-testing --region=us-central1 --temp_location=gs://temp-storage-for-perf-tests/loadtests --publish_to_big_query=true --metrics_dataset=load_test --metrics_table=python_dataflow_streaming_gbk_3 --influx_measurement=python_streaming_gbk_3 --input_options='{"num_records": 20000,"key_size": 10000,"value_size": 90000}' --iterations=1 --fanout=1 --num_****s=5 --autoscaling_algorithm=NONE --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --streaming --experiments=use_runner_v2 --runner=DataflowRunner' -PpythonVersion=3.7 --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-pull-licenses :sdks:python:apache_beam:testing:load_tests:run
> Task :buildSrc:compileJava NO-SOURCE
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=21e357b6-2f9e-40a1-a125-95a8f56af698, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 23633
  log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-23633.out.log
----- Last  20 lines from daemon log file - daemon-23633.out.log -----
12:05:21.017 [DEBUG] [org.gradle.launcher.daemon.server.DefaultDaemonConnection] thread 99: Received non-IO message from client: Build{id=21e357b6-2f9e-40a1-a125-95a8f56af698, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/src}>
12:05:21.018 [INFO] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Received command: Build{id=21e357b6-2f9e-40a1-a125-95a8f56af698, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/src}.>
12:05:21.018 [DEBUG] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Starting executing command: Build{id=21e357b6-2f9e-40a1-a125-95a8f56af698, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/src}> with connection: socket connection from /0:0:0:0:0:0:0:1:43191 to /0:0:0:0:0:0:0:1:41654.
12:05:21.018 [ERROR] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution: started DaemonCommandExecution[command = Build{id=21e357b6-2f9e-40a1-a125-95a8f56af698, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/src},> connection = DefaultDaemonConnection: socket connection from /0:0:0:0:0:0:0:1:43191 to /0:0:0:0:0:0:0:1:41654] after 0.0 minutes of idle
12:05:21.019 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [70c13ce9-d107-4f9b-82ad-d9fae0235428 port:43191, addresses:[/0:0:0:0:0:0:0:1%lo, /127.0.0.1]]
12:05:21.019 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [70c13ce9-d107-4f9b-82ad-d9fae0235428 port:43191, addresses:[/0:0:0:0:0:0:0:1%lo, /127.0.0.1]]
12:05:21.019 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry.
12:05:21.019 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry.
12:05:21.020 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry.
12:05:21.020 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer
12:05:21.021 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes.
12:05:21.021 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=21e357b6-2f9e-40a1-a125-95a8f56af698, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/src}.> Dispatching build started information...
12:05:21.021 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 26: dispatching class org.gradle.launcher.daemon.protocol.BuildStarted
12:05:21.021 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: {PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games, INFLUXDB_USER=****, RUN_DISPLAY_URL=https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/16/display/redirect, HUDSON_HOME=/home/jenkins/jenkins-home, RUN_CHANGES_DISPLAY_URL=https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/16/display/redirect?page=changes, JOB_URL=https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/, HUDSON_COOKIE=03753f99-250d-4e4b-a31d-20cf33432e95, MAIL=/var/mail/jenkins, JENKINS_SERVER_COOKIE=14925adb602d4986, LOGNAME=jenkins, PWD=<https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/src,> JENKINS_URL=https://ci-beam.apache.org/, SHELL=/bin/bash, BUILD_TAG=jenkins-beam_LoadTests_Python_GBK_Dataflow_Streaming-16, ROOT_BUILD_CAUSE=TIMERTRIGGER, BUILD_CAUSE_TIMERTRIGGER=true, OLDPWD=<https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/src,> GIT_CHECKOUT_DIR=src, JENKINS_HOME=/home/jenkins/jenkins-home, sha1=master, NODE_NAME=apache-beam-jenkins-5, BUILD_DISPLAY_NAME=#16, JOB_DISPLAY_URL=https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/display/redirect, GIT_BRANCH=origin/master, SETUPTOOLS_USE_DISTUTILS=stdlib, SHLVL=1, WORKSPACE_TMP=<https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/@tmp,> GIT_PREVIOUS_COMMIT=ba89e76f5daecd496cafb2861dac5ef69480a973, INFLUXDB_USER_PASSWORD=****, JAVA_HOME=/home/jenkins/tools/java/latest1.8, BUILD_ID=16, LANG=en_US.UTF-8, XDG_SESSION_ID=540, JOB_NAME=beam_LoadTests_Python_GBK_Dataflow_Streaming, SPARK_LOCAL_IP=127.0.0.1, BUILD_CAUSE=TIMERTRIGGER, GIT_PREVIOUS_SUCCESSFUL_COMMIT=ba89e76f5daecd496cafb2861dac5ef69480a973, NODE_LABELS=apache-beam-jenkins-5 beam, HUDSON_URL=https://ci-beam.apache.org/, WORKSPACE=<https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/ws/,> ROOT_BUILD_CAUSE_TIMERTRIGGER=true, _=/usr/bin/java, GIT_COMMIT=d4e3729460dc710f954e22c92c36e8f00a24bd4c, EXECUTOR_NUMBER=0, HUDSON_SERVER_COOKIE=14925adb602d4986, SSH_CLIENT=3.94.149.17 44332 22, JOB_BASE_NAME=beam_LoadTests_Python_GBK_Dataflow_Streaming, USER=jenkins, SSH_CONNECTION=3.94.149.17 44332 10.128.0.72 22, BUILD_NUMBER=16, BUILD_URL=https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/16/, GIT_URL=https://github.com/apache/beam.git, XDG_RUNTIME_DIR=/run/user/1017, HOME=/home/jenkins}
12:05:21.022 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection.
12:05:21.023 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 23633). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-23633.out.log
12:05:21.023 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 4 mins 6.374 secs, performance: 100%]
12:05:21.024 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build.
12:05:21.024 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=73ce1747-a5e9-42e7-88a1-721884603901,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=23633,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xmx4g,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----


FAILURE: Build failed with an exception.

* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org
> Task :buildSrc:compileGroovy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_LoadTests_Python_GBK_Dataflow_Streaming #17

[Apache Jenkins Server <je...@builds.apache.org>]

See <https://ci-beam.apache.org/job/beam_LoadTests_Python_GBK_Dataflow_Streaming/17/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org