You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/10/14 12:11:04 UTC
Build failed in Jenkins: beam_LoadTests_Java_GBK_Dataflow_Streaming
#524
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/524/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-10969] Upgrade Spark to version 2.4.7
[Luke Cwik] [BEAM-9309] Remove the READ urn/payload from the Java SDK harness.
[noreply] Add Relative Path Sensitivity (#12955)
[piotr.szuberski] [BEAM-10885] Add Avro support to Kafka table provider
[piotr.szuberski] Remove booleans, use List of values
[piotr.szuberski] Fixes after CR
[piotr.szuberski] Change payloadFormat to format like in text table provider
[piotr.szuberski] Fix checkstyle
[piotr.szuberski] Use SimpleFunction instead of SerializableFunction
[piotr.szuberski] Remove getSchema() and listFrom(), make abstract generateRow, add
[piotr.szuberski] Remove generification of KafkaTestRecord
[piotr.szuberski] Add missing close paren
[piotr.szuberski] Get rid of getTable() and KafkaTestTable inheritance
[piotr.szuberski] Fix comment
[piotr.szuberski] Inline getRecordValueBytes
[piotr.szuberski] Remove generification of generateProducerRecord
[piotr.szuberski] Add full-stops to javadocs
[piotr.szuberski] Move statistics tests to separate file
[piotr.szuberski] Throw exception instead of returning null.
[piotr.szuberski] Update create-external-table.md
[piotr.szuberski] Update CHANGES.md
[piotr.szuberski] Use ByteArraySerializer as kafka value serializer
[Kenneth Knowles] Enable some supported ZetaSQL functions
[noreply] [BEAM-11056] Fix warning message and rename old APIs (#13080)
[rohde.samuel] Add ability for HotKeyLogger to log a key.
[pawel.pasterz] [BEAM-10800] Update azure-storage-blob dependency
[pawel.pasterz] [BEAM-8674] Update cassandra-driver-core dependency
[pawel.pasterz] [BEAM-10803] Update azure-storage dependency
[pawel.pasterz] [BEAM-10355] Update s3mock dependency
[pawel.pasterz] [BEAM-5905] Update qpid dependency
[pawel.pasterz] [BEAM-5544] Update cassandra-all dependency
[noreply] [BEAM-10861]Adds PubSub Runner API encoding to Read/Write transforms
[noreply] [BEAM-8251] Add worker_region and worker_zone options (#13072)
[noreply] [BEAM-10720] Finish implementing StringMethods (cat, repeat) (#12705)
[noreply] [BEAM-10009] Document micros_instant (#12921)
[noreply] Update CHANGES.md
[noreply] Update
[noreply] Update
[noreply] Update
[noreply] [BEAM-10987] Skip test_with_main_session on windows (#13099)
[noreply] [BEAM-9616] Allow new RegisterDoFn behaviour to be disabled (#13103)
[noreply] [BEAM-11020] Adding multi-window splitting to Go SDF. (#13070)
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-5 (beam) in workspace <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0f3177cad67047a94ecd8c5ee57647397b2a6275 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 0f3177cad67047a94ecd8c5ee57647397b2a6275 # timeout=10
Commit message: "Merge pull request #13093: [BEAM-10355] Update s3mock dependency"
> git rev-list --no-walk f639a7e760dcbe82f2d0236f715e964dd746931d # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
SETUPTOOLS_USE_DISTUTILS=stdlib
[EnvInject] - Variables injected successfully.
[beam_LoadTests_Java_GBK_Dataflow_Streaming] $ /bin/bash -xe /tmp/jenkins1062880010981899072.sh
+ echo '*** Load test: 2GB of 10B records ***'
*** Load test: 2GB of 10B records ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/src/gradlew> -PloadTest.mainClass=org.apache.beam.sdk.loadtests.GroupByKeyLoadTest -Prunner=:runners:google-cloud-dataflow-java -PwithDataflowWorkerJar=false '-PloadTest.args=--project=apache-beam-testing --region=us-central1 --appName=load_tests_Java_Dataflow_streaming_GBK_1 --tempLocation=gs://temp-storage-for-perf-tests/loadtests --publishToBigQuery=true --bigQueryDataset=load_test --bigQueryTable=java_dataflow_streaming_GBK_1 --influxMeasurement=java_streaming_gbk_1 --publishToInfluxDB=true --sourceOptions={"numRecords":200000000,"keySizeBytes":1,"valueSizeBytes":9} --fanout=1 --iterations=1 --numWorkers=5 --autoscalingAlgorithm=NONE --streaming=true --influxDatabase=beam_test_metrics --influxHost=http://10.128.0.96:8086 --inputWindowDurationSec=1200 --runner=DataflowRunner' --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-pull-licenses :sdks:java:testing:load-tests:run
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=15cb4879-e3ca-47f5-b00a-dd3e3a5ecce6, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 23445
log file: /home/jenkins/.gradle/daemon/6.6.1/daemon-23445.out.log
----- Last 20 lines from daemon log file - daemon-23445.out.log -----
2020-10-14T12:11:03.501+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultDaemonConnection] thread 240: Received non-IO message from client: Build{id=15cb4879-e3ca-47f5-b00a-dd3e3a5ecce6, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/src}>
2020-10-14T12:11:03.501+0000 [INFO] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Received command: Build{id=15cb4879-e3ca-47f5-b00a-dd3e3a5ecce6, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/src}.>
2020-10-14T12:11:03.501+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Starting executing command: Build{id=15cb4879-e3ca-47f5-b00a-dd3e3a5ecce6, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/src}> with connection: socket connection from /127.0.0.1:39827 to /127.0.0.1:55020.
2020-10-14T12:11:03.502+0000 [ERROR] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution: started DaemonCommandExecution[command = Build{id=15cb4879-e3ca-47f5-b00a-dd3e3a5ecce6, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/src},> connection = DefaultDaemonConnection: socket connection from /127.0.0.1:39827 to /127.0.0.1:55020] after 0.0 minutes of idle
2020-10-14T12:11:03.502+0000 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [4b6c04c5-c4f4-4972-bfc5-39a32999c8c3 port:39827, addresses:[localhost/127.0.0.1]]
2020-10-14T12:11:03.502+0000 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [4b6c04c5-c4f4-4972-bfc5-39a32999c8c3 port:39827, addresses:[localhost/127.0.0.1]]
2020-10-14T12:11:03.502+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry.
2020-10-14T12:11:03.502+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry.
2020-10-14T12:11:03.503+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry.
2020-10-14T12:11:03.503+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer
2020-10-14T12:11:03.503+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes.
2020-10-14T12:11:03.503+0000 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=15cb4879-e3ca-47f5-b00a-dd3e3a5ecce6, currentDir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/src}.> Dispatching build started information...
2020-10-14T12:11:03.504+0000 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 27: dispatching org.gradle.launcher.daemon.protocol.BuildStarted@b7e47d7
2020-10-14T12:11:03.504+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: {PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games, INFLUXDB_USER=****, RUN_DISPLAY_URL=https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/524/display/redirect, HUDSON_HOME=/home/jenkins/jenkins-home, RUN_CHANGES_DISPLAY_URL=https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/524/display/redirect?page=changes, JOB_URL=https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/, HUDSON_COOKIE=ccf16c67-2dae-4fdb-b4da-7f58f18ab40c, MAIL=/var/mail/jenkins, JENKINS_SERVER_COOKIE=14925adb602d4986, LOGNAME=jenkins, PWD=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/src,> JENKINS_URL=https://ci-beam.apache.org/, SHELL=/bin/bash, BUILD_TAG=jenkins-beam_LoadTests_Java_GBK_Dataflow_Streaming-524, ROOT_BUILD_CAUSE=TIMERTRIGGER, BUILD_CAUSE_TIMERTRIGGER=true, OLDPWD=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/src,> GIT_CHECKOUT_DIR=src, JENKINS_HOME=/home/jenkins/jenkins-home, sha1=master, NODE_NAME=apache-beam-jenkins-5, BUILD_DISPLAY_NAME=#524, JOB_DISPLAY_URL=https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/display/redirect, GIT_BRANCH=origin/master, SETUPTOOLS_USE_DISTUTILS=stdlib, SHLVL=1, WORKSPACE_TMP=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/@tmp,> GIT_PREVIOUS_COMMIT=f639a7e760dcbe82f2d0236f715e964dd746931d, INFLUXDB_USER_PASSWORD=****, JAVA_HOME=/home/jenkins/tools/java/latest1.8, BUILD_ID=524, LANG=en_US.UTF-8, XDG_SESSION_ID=1839, JOB_NAME=beam_LoadTests_Java_GBK_Dataflow_Streaming, SPARK_LOCAL_IP=127.0.0.1, BUILD_CAUSE=TIMERTRIGGER, GIT_PREVIOUS_SUCCESSFUL_COMMIT=f639a7e760dcbe82f2d0236f715e964dd746931d, NODE_LABELS=apache-beam-jenkins-5 beam, HUDSON_URL=https://ci-beam.apache.org/, WORKSPACE=<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/ws/,> ROOT_BUILD_CAUSE_TIMERTRIGGER=true, _=/usr/bin/java, GIT_COMMIT=0f3177cad67047a94ecd8c5ee57647397b2a6275, EXECUTOR_NUMBER=1, HUDSON_SERVER_COOKIE=14925adb602d4986, SSH_CLIENT=3.94.149.17 51018 22, JOB_BASE_NAME=beam_LoadTests_Java_GBK_Dataflow_Streaming, USER=jenkins, SSH_CONNECTION=3.94.149.17 51018 10.128.0.72 22, BUILD_NUMBER=524, BUILD_URL=https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/524/, GIT_URL=https://github.com/apache/beam.git, XDG_RUNTIME_DIR=/run/user/1017, HOME=/home/jenkins}
2020-10-14T12:11:03.505+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection.
2020-10-14T12:11:03.506+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 23445). The daemon log file: /home/jenkins/.gradle/daemon/6.6.1/daemon-23445.out.log
2020-10-14T12:11:03.507+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 4 mins 5.321 secs, performance: 100%]
2020-10-14T12:11:03.507+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build.
2020-10-14T12:11:03.508+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=2c5019bd-9227-43b8-bea3-60b822d04a55,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=23445,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xmx4g,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant]
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_LoadTests_Java_GBK_Dataflow_Streaming #525
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_Streaming/525/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org