You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/09/16 18:26:47 UTC
Build failed in Jenkins: beam_PerformanceTests_HadoopFormat #2047
See <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/2047/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-10670] Update Samza to be opt-out for SplittableDoFn.
[noreply] [BEAM-10616] Add missing ParDo test cases for streaming/Flink (#12848)
[noreply] Bump versions of protobuf, shadow, other gradle plugins. (#12821)
[Luke Cwik] [BEAM-10670] Update Jet runner to be opt-out for splittable DoFn
[Luke Cwik] Update runners/jet/build.gradle
[noreply] [BEAM-7523] Fix starting Kafka container twice in KafkaCSVTableIT
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-14 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c8991ba9b65af2f547bad68a0ac327ce720eb00b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c8991ba9b65af2f547bad68a0ac327ce720eb00b # timeout=10
Commit message: "Merge pull request #12616 from lukecwik/beam10670.4"
> git rev-list --no-walk 0f9d0020aaaa338c1916cba55b7877f4ae897e46 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
SETUPTOOLS_USE_DISTUTILS=stdlib
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopFormat] $ /bin/bash -xe /tmp/jenkins4443420361749061441.sh
+ cp /home/jenkins/.kube/config <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047>
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047>
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopFormat] $ /bin/bash -xe /tmp/jenkins940902910230049523.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a
Fetching cluster endpoint and auth data.
kubeconfig entry generated for io-datastores.
[beam_PerformanceTests_HadoopFormat] $ /bin/bash -xe /tmp/jenkins262338821748937933.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/kubernetes.sh> createNamespace beam-performancetests-hadoopformat-2047
+ KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047>
+ KUBERNETES_NAMESPACE=default
+ KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=default'
+ createNamespace beam-performancetests-hadoopformat-2047
+ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> create namespace beam-performancetests-hadoopformat-2047'
++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> create namespace beam-performancetests-hadoopformat-2047
namespace/beam-performancetests-hadoopformat-2047 created
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
KUBERNETES_NAMESPACE=beam-performancetests-hadoopformat-2047
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopFormat] $ /bin/bash -xe /tmp/jenkins1696025858819687992.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/kubernetes.sh> apply <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml>
+ KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047>
+ KUBERNETES_NAMESPACE=beam-performancetests-hadoopformat-2047
+ KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047'
+ apply <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml>
+ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml'>
++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 apply -R -f <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml>
service/postgres-for-dev created
replicationcontroller/postgres created
[beam_PerformanceTests_HadoopFormat] $ /bin/bash -xe /tmp/jenkins7332536145322083374.sh
+ set -eo pipefail
+ eval <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP postgres-for-dev
++ <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/.test-infra/kubernetes/kubernetes.sh> loadBalancerIP postgres-for-dev
+ sed 's/^/LOAD_BALANCER_IP=/'
+ KUBECONFIG=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047>
+ KUBERNETES_NAMESPACE=beam-performancetests-hadoopformat-2047
+ KUBECTL='kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047'
+ loadBalancerIP postgres-for-dev
+ local name=postgres-for-dev
+ local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ retry 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\''' 36 10
+ local 'command=kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+ local max_retries=36
+ local sleep_time=10
+ (( i = 1 ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 1 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 2 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 3 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n '' ]]
+ [[ 4 == \3\6 ]]
+ sleep 10
+ (( i++ ))
+ (( i <= max_retries ))
+ local output
++ eval 'kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev -ojsonpath='\''{.status.loadBalancer.ingress[0].ip}'\'''
+++ kubectl --kubeconfig=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/config-beam-performancetests-hadoopformat-2047> --namespace=beam-performancetests-hadoopformat-2047 get svc postgres-for-dev '-ojsonpath={.status.loadBalancer.ingress[0].ip}'
+ output=35.222.222.106
+ local status=0
+ [[ 0 == 0 ]]
+ [[ -n 35.222.222.106 ]]
+ echo 35.222.222.106
+ return 0
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties file path 'job.properties'
[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/gradlew> --continue --max-****s=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-pull-licenses --info -DintegrationTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--numberOfRecords=600000","--bigQueryDataset=beam_performance","--bigQueryTable=hadoopformatioit_results","--influxMeasurement=hadoopformatioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--postgresUsername=postgres","--postgresPassword=uuinkks","--postgresDatabaseName=postgres","--postgresServerName=35.222.222.106","--postgresSsl=false","--postgresPort=5432","--numWorkers=5","--autoscalingAlgorithm=NONE"] -DintegrationTestRunner=dataflow :sdks:java:io:hadoop-format:integrationTest --tests org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT
Initialized native services in: /home/jenkins/.gradle/native
Removing 0 daemon stop events from registry
Starting a Gradle Daemon, 3 busy Daemons could not be reused, use --status for details
Starting process 'Gradle build daemon'. Working directory: /home/jenkins/.gradle/daemon/6.6.1 Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Xmx4g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/wrapper/dists/gradle-6.6.1-all/ejrtlte9hlw8v6ii20a9584rs/gradle-6.6.1/lib/gradle-launcher-6.6.1.jar org.gradle.launcher.daemon.bootstrap.GradleDaemon 6.6.1
Successfully started process 'Gradle build daemon'
An attempt to start the daemon took 1.051 secs.
The client will now receive all logging from the daemon (pid: 23781). The daemon log file: /home/jenkins/.gradle/daemon/6.6.1/daemon-23781.out.log
Starting build in new daemon [memory: 3.8 GB]
Closing daemon's stdin at end of input.
The daemon will no longer process any standard input.
Using 12 **** leases.
Starting Build
Downloading https://plugins.gradle.org/m2/com/gradle/gradle-enterprise-gradle-plugin/3.4.1/gradle-enterprise-gradle-plugin-3.4.1.jar to /tmp/gradle_download6195273482182382305bin
Downloading https://plugins.gradle.org/m2/com/gradle/gradle-enterprise-gradle-plugin/3.4.1/gradle-enterprise-gradle-plugin-3.4.1.jar to /tmp/gradle_download1182227911377372185bin
Downloading https://plugins.gradle.org/m2/com/gradle/gradle-enterprise-gradle-plugin/3.4.1/gradle-enterprise-gradle-plugin-3.4.1.jar to /tmp/gradle_download1281300065043774653bin
FAILURE: Build failed with an exception.
* What went wrong:
Could not resolve all artifacts for configuration 'classpath'.
> Could not download gradle-enterprise-gradle-plugin-3.4.1.jar (com.gradle:gradle-enterprise-gradle-plugin:3.4.1)
> Could not get resource 'https://plugins.gradle.org/m2/com/gradle/gradle-enterprise-gradle-plugin/3.4.1/gradle-enterprise-gradle-plugin-3.4.1.jar'.
> Read timed out
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 5m 23s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PerformanceTests_HadoopFormat #2048
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/2048/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org