You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/02/24 12:24:04 UTC
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #2755
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/2755/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-9 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a537ae6a2f6a4f51b7108b0d036d1cb1563476b2 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a537ae6a2f6a4f51b7108b0d036d1cb1563476b2
Commit message: "[BEAM-9344] Add support for bundle finalization execution to the Beam Java SDK. (#10910)"
> git rev-list --no-walk a537ae6a2f6a4f51b7108b0d036d1cb1563476b2 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5640531336798630998.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755>
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
KUBECONFIG="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755">
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4649943646253722195.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/kubernetes.sh> createNamespace beam-performancetests-avroioit-hdfs-2755
+ KUBECONFIG='"<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"'>
+ KUBERNETES_NAMESPACE=default
+ KUBECTL='kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=default'
+ createNamespace beam-performancetests-avroioit-hdfs-2755
+ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> create namespace beam-performancetests-avroioit-hdfs-2755'
++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> create namespace beam-performancetests-avroioit-hdfs-2755
namespace/beam-performancetests-avroioit-hdfs-2755 created
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
KUBERNETES_NAMESPACE=beam-performancetests-avroioit-hdfs-2755
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7477709740863292226.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml>
+ KUBECONFIG='"<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"'>
+ KUBERNETES_NAMESPACE=beam-performancetests-avroioit-hdfs-2755
+ KUBECTL='kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755'
+ apply <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml>
+ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755 apply -R -f <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml'>
++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 apply -R -f <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml>
service/hadoop created
service/hadoop-datanodes created
statefulset.apps/datanode created
pod/namenode-0 created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3397484549467956695.sh
+ set -eo pipefail
+ eval <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP hadoop
++ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP hadoop
+ sed 's/^/LOAD_BALANCER_IP=/'
+ KUBECONFIG='"<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"'>
+ KUBERNETES_NAMESPACE=beam-performancetests-avroioit-hdfs-2755
+ KUBECTL='kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755'
+ loadBalancerIP hadoop
+ local name=hadoop
+ local 'command=kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ retry 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10
+ local 'command=kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ local max_retries=36
+ local sleep_time=10
+ (( i = 1 ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 1 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 2 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 3 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 4 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig="<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755"> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-2755> --namespace=beam-performancetests-avroioit-hdfs-2755 get svc hadoop '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=35.223.38.101
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n 35.223.38.101 ]]
+ echo 35.223.38.101
+ return 0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'job.properties'
[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g --info -DintegrationTestPipelineOptions=["--bigQueryDataset=beam_performance","--bigQueryTable=avroioit_hdfs_results","--numberOfRecords=225000000","--expectedHash=2f9f5ca33ea464b25109c0297eb6aecb","--datasetSize=1089730000","--numWorkers=5","--autoscalingAlgorithm=NONE","--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs:35.223.38.101:9000\",\"dfs.replication\":1}]","--filenamePrefix=hdfs://35.223.38.101:9000/TEXTIO_IT_"] -Dfilesystem=hdfs -DintegrationTestRunner=dataflow :sdks:java:io:file-based-io-tests:integrationTest --tests org.apache.beam.sdk.io.avro.AvroIOIT
Initialized native services in: /home/jenkins/.gradle/native
The client will now receive all logging from the daemon (pid: 32021). The daemon log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-32021.out.log
Starting 2nd build in daemon [uptime: 4 mins 32.247 secs, performance: 100%]
Using 12 worker leases.
Starting Build
Closing daemon's stdin at end of input.
The daemon will no longer process any standard input.
Using local directory build cache for build ':buildSrc' (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
> Configure project :buildSrc
Evaluating project ':buildSrc' using build file '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/build.gradle'.>
Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin
Selected primary task 'build' from project :
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/test/groovy',> not found
:buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileJava NO-SOURCE
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/java',> not found
Skipping task ':buildSrc:compileJava' as it has no source files and no previous output files.
:buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.005 secs.
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileGroovy FROM-CACHE
Build cache key for task ':buildSrc:compileGroovy' is c9d6a614e8994d7607cb326e2478af42
Task ':buildSrc:compileGroovy' is not up-to-date because:
No history is available.
Origin for org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@7ebb7210: {executionTime=3736, hostName=apache-beam-jenkins-9, operatingSystem=Linux, buildInvocationId=ro26qu3pczaz3nuvzxdqlp3kti, creationTime=1582330916584, identity=:compileGroovy, type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution, userName=jenkins, gradleVersion=5.2.1, rootPath=/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit/src/buildSrc}
Unpacked trees for task ':buildSrc:compileGroovy' from cache.
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.05 secs.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:pluginDescriptors
Build cache key for task ':buildSrc:pluginDescriptors' is db14b8b6679df7db8b87deb94d04a710
Caching disabled for task ':buildSrc:pluginDescriptors': Caching has not been enabled for the task
Task ':buildSrc:pluginDescriptors' is not up-to-date because:
No history is available.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.003 secs.
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:processResources
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/resources',> not found
Build cache key for task ':buildSrc:processResources' is d9c17925b763b8381ce3e616f3244816
Caching disabled for task ':buildSrc:processResources': Caching has not been enabled for the task
Task ':buildSrc:processResources' is not up-to-date because:
No history is available.
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/resources',> not found
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.005 secs.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) started.
> Task :buildSrc:classes
Skipping task ':buildSrc:classes' as it has no actions.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) started.
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=4b3f3d9f-4674-4bcc-b169-983aba6897a0, currentDir=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 32021
log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-32021.out.log
----- Last 20 lines from daemon log file - daemon-32021.out.log -----
:buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.05 secs.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) started.
Build cache key for task ':buildSrc:pluginDescriptors' is db14b8b6679df7db8b87deb94d04a710
Caching disabled for task ':buildSrc:pluginDescriptors': Caching has not been enabled for the task
Task ':buildSrc:pluginDescriptors' is not up-to-date because:
No history is available.
:buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.003 secs.
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) started.
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/resources',> not found
Build cache key for task ':buildSrc:processResources' is d9c17925b763b8381ce3e616f3244816
Caching disabled for task ':buildSrc:processResources': Caching has not been enabled for the task
Task ':buildSrc:processResources' is not up-to-date because:
No history is available.
file or directory '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/buildSrc/src/main/resources',> not found
:buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.005 secs.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) started.
Skipping task ':buildSrc:classes' as it has no actions.
:buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) started.
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
> Task :buildSrc:jar
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PerformanceTests_AvroIOIT_HDFS #2756
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/2756/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org