You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/02/09 00:59:47 UTC
Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT_HDFS
#959
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/959/display/redirect?page=changes>
Changes:
[github] Update python-pipeline-dependencies.md
[valentyn] Use BeamDeprecationWarning in BQ client code.
[valentyn] Make pydocs happy.
[ehudm] [BEAM-6636] Remove --kmsKey usage
[aaltay] Restrict pyvcf dependency to Python 2 and link Jira issues tracking Py3
[iemejia] Revert "[BEAM-5987] Remove @Nullable annotation from
[iemejia] [BEAM-6426] Use vendored guava class for kryo registration in Spark
------------------------------------------
[...truncated 142.11 KB...]
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Feb 09, 2019 12:57:59 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 269 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Feb 09, 2019 12:57:59 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
WARNING: Skipping non-existent file to stage ${dataflowWorkerJar}.
Feb 09, 2019 12:57:59 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
WARNING: Skipping non-existent file to stage <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/resources/test.>
Feb 09, 2019 12:57:59 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
WARNING: Skipping non-existent file to stage <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/classes/java/main.>
Feb 09, 2019 12:57:59 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
WARNING: Skipping non-existent file to stage <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/resources/main.>
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/hadoop-file-system/build/libs/beam-sdks-java-io-hadoop-file-system-2.11.0-SNAPSHOT.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-sdks-java-io-hadoop-file-system-2.11.0-SNAPSHOT-Gu1txhR0D43h1RJWfjIfmw.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/4.10.3/workerMain/gradle-worker.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/gradle-worker-OjT5LQkNohsc1sf13pfbUg.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.pholser/junit-quickcheck-core/0.8/859d412973c1b9201faf5d48605a73c95a300e32/junit-quickcheck-core-0.8.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/junit-quickcheck-core-0.8-EgEvYI3gIP_d2fBpDZJ42w.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-mapreduce-client-jobclient/2.7.3/5fa80f09065a661227da50ba7df3ec5a0e9425d3/hadoop-mapreduce-client-jobclient-2.7.3.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/hadoop-mapreduce-client-jobclient-2.7.3-WVyLKmbOTJDY0PG_muBeSQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-spanner-v1/0.19.0/4f98ecdbe822b34c69d973ff34e4aa22467b9787/grpc-google-cloud-spanner-v1-0.19.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/grpc-google-cloud-spanner-v1-0.19.0-AEAGDZYGHkdgD30rgX5_mg.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.curator/curator-recipes/2.7.1/a2c180efc6a38a4f8c9197eb35bb4eb5716cd2fa/curator-recipes-2.7.1.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/curator-recipes-2.7.1-FWrTD7mZWwchda5g-7NSpQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/runners/core-java/build/libs/beam-runners-core-java-2.11.0-SNAPSHOT.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-runners-core-java-2.11.0-SNAPSHOT-71w-GizBJm0mZMl1wc4ppQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.apis/google-api-services-dataflow/v1b3-rev20181107-1.27.0/d0b3764765916d65fd75a52ae1a8cf13a150450a/google-api-services-dataflow-v1b3-rev20181107-1.27.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/google-api-services-dataflow-v1b3-rev20181107-1.27.0-ZCpCwXOULzPs_S2gBBH7TA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/runners/direct-java/build/libs/beam-runners-direct-java-2.11.0-SNAPSHOT.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-runners-direct-java-2.11.0-SNAPSHOT-S4z8D2rQvBa10UIrMCJVeg.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.11.0-SNAPSHOT-tests.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-sdks-java-io-google-cloud-platform-2.11.0-SNAPSHOT-tests-wmqk6_7UmAFrKgHCcyj7yg.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.powermock/powermock-api-mockito/1.6.4/4b905ef602077f7f88a20bfcc4a9df6d8cff7655/powermock-api-mockito-1.6.4-sources.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/powermock-api-mockito-1.6.4-sources-Igcf0nTcxej7WvUt3KrpnA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.11.0-SNAPSHOT.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-sdks-java-io-google-cloud-platform-2.11.0-SNAPSHOT-bQM_FLChGiOgog4JGI-daw.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/runners/core-java/build/libs/beam-runners-core-java-2.11.0-SNAPSHOT-tests.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-runners-core-java-2.11.0-SNAPSHOT-tests-7QaTvJR2XyphNMbp67U3VQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/libs/beam-runners-google-cloud-dataflow-java-2.11.0-SNAPSHOT.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-runners-google-cloud-dataflow-java-2.11.0-SNAPSHOT-5twDfs3OZBl-jgjFgKLjnQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-testing/1.13.1/bc0a38e3a32a80cfa1a11e60dd8bd454016372ee/grpc-testing-1.13.1.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/grpc-testing-1.13.1-YgV-LG6hgSM4untyiLrAsg.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-bigtable-v2/0.19.0/cca0b6c257f2409573d54cf00500025f5e32c9e5/proto-google-cloud-bigtable-v2-0.19.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/proto-google-cloud-bigtable-v2-0.19.0-hYwRnuQXQg2j-h0yOLTnJA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/extensions/google-cloud-platform-core/build/libs/beam-sdks-java-extensions-google-cloud-platform-core-2.11.0-SNAPSHOT.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-sdks-java-extensions-google-cloud-platform-core-2.11.0-SNAPSHOT-mAQ_qaqS0_hXMwziuQCe0w.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/xml/build/libs/beam-sdks-java-io-xml-2.11.0-SNAPSHOT.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-sdks-java-io-xml-2.11.0-SNAPSHOT-EidF7PZ_o3JrSm00Luz09A.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/io.opencensus/opencensus-api/0.12.3/743f074095f29aa985517299545e72cc99c87de0/opencensus-api-0.12.3.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/opencensus-api-0.12.3-MKiYXUtnACUQtjeYR3VDrw.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-pubsub-v1/1.18.0/7f76b679efbca66162e35c60eca25665a5a16642/grpc-google-cloud-pubsub-v1-1.18.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/grpc-google-cloud-pubsub-v1-1.18.0-E1prc1wk1jKpxE_eDXp9oQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.parquet/parquet-avro/1.10.0/4ed2c46a4794a180ff08f02732e8f4ea02f3d1ce/parquet-avro-1.10.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/parquet-avro-1.10.0-60Q4vOZrbMinS7_6BO7sOA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.guava/guava-testlib/20.0/e3666edd0d7b10ddfa5242b998efd831e4b264ff/guava-testlib-20.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/guava-testlib-20.0-NCHfheF5thYzZpyVaOvySA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.25/bccda40ebc8067491b32a88f49615a747d20082d/slf4j-jdk14-1.7.25.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/slf4j-jdk14-1.7.25-lEPyQGtDduRgOFY4C9MlVA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/runners/direct-java/build/libs/beam-runners-direct-java-2.11.0-SNAPSHOT-tests.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-runners-direct-java-2.11.0-SNAPSHOT-tests-FXAncnMKwkTW41DuLzvqhA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.apis/google-api-services-pubsub/v1-rev20181105-1.27.0/31f49e03ec44c72845a6a0572ccba74d7aee1f57/google-api-services-pubsub-v1-rev20181105-1.27.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/google-api-services-pubsub-v1-rev20181105-1.27.0-_3JmrTY281LX4AcOiP7LkQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/classes/java/test> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/test-8Led_C1-T-Q1HMI7k0sUJA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/grpc-google-cloud-bigtable-v2/0.19.0/d5ffc1f10e26efc8a679d14159e07d41fc27349c/grpc-google-cloud-bigtable-v2-0.19.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/grpc-google-cloud-bigtable-v2-0.19.0-nLHDQSa4P3qyGUcauq0bdA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud/google-cloud-bigquery/1.27.0/619c5ec74c457b9b00b02534b5c666ae0b71e157/google-cloud-bigquery-1.27.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/google-cloud-bigquery-1.27.0-EeS9c3VbPdL1cGj9GqOYng.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.http-client/google-http-client-protobuf/1.27.0/b81859b8a284ea416d74644a70524c4d6be3e9a/google-http-client-protobuf-1.27.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/google-http-client-protobuf-1.27.0-1E0HsNaSwDtqOduUs-NssA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/runners/google-cloud-dataflow-java/build/libs/beam-runners-google-cloud-dataflow-java-2.11.0-SNAPSHOT-tests.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-runners-google-cloud-dataflow-java-2.11.0-SNAPSHOT-tests-P9PtY8UFSWJvkzhU1Ci-SA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/extensions/google-cloud-platform-core/build/libs/beam-sdks-java-extensions-google-cloud-platform-core-2.11.0-SNAPSHOT-tests.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-sdks-java-extensions-google-cloud-platform-core-2.11.0-SNAPSHOT-tests-C4A3-n0p6T8sSpttvuNUpg.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/common/build/libs/beam-sdks-java-io-common-2.11.0-SNAPSHOT.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-sdks-java-io-common-2.11.0-SNAPSHOT-ADdtLBrq7jdNM1gd5ckfww.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.cloud.datastore/datastore-v1-proto-client/1.6.0/8b2516336fdf191d86d9979588b23cd502aa8f73/datastore-v1-proto-client-1.6.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/datastore-v1-proto-client-1.6.0-uyyLKzyVhahFJuvTiE8isw.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-protobuf-lite/1.13.1/6ca13585100ad99e1c6140a7c8138dd96596aaf5/grpc-protobuf-lite-1.13.1.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/grpc-protobuf-lite-1.13.1-y57exuzF5as7dYGQwFo5cg.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.powermock/powermock-module-junit4/1.6.4/8692eb1d9bb8eb1310ffe8a20c2da7ee6d1b5994/powermock-module-junit4-1.6.4.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/powermock-module-junit4-1.6.4-PCd3j2QMfAheO2EN2Z4d-Q.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.apis/google-api-services-cloudresourcemanager/v1-rev20181015-1.27.0/354796285db3b2fce9089147db3fe1f2a8cca444/google-api-services-cloudresourcemanager-v1-rev20181015-1.27.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/google-api-services-cloudresourcemanager-v1-rev20181015-1.27.0-SQfpsiUEwOlTbzfnWC4EzA.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.7.3/455420e0d0a9e645d9489e8c7d34d0b02cd1c36f/hadoop-yarn-common-2.7.3.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/hadoop-yarn-common-2.7.3-Ieb1Tq82tLznLP06CJpWew.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/xml/build/libs/beam-sdks-java-io-xml-2.11.0-SNAPSHOT-tests.jar> to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/beam-sdks-java-io-xml-2.11.0-SNAPSHOT-tests-_ly_3EExfrkYcC_9m10Qbw.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api.grpc/proto-google-cloud-datastore-v1/0.19.0/e5d5895d382d9afc39de7c6cdcd6ce3c6c561326/proto-google-cloud-datastore-v1-0.19.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/proto-google-cloud-datastore-v1-0.19.0-fWa-CNGmo6Ekul1TJ7INyQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.apis/google-api-services-clouddebugger/v2-rev20180801-1.27.0/2866c6cfca03ef7bbf687ba3b62fa843377e664b/google-api-services-clouddebugger-v2-rev20180801-1.27.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/google-api-services-clouddebugger-v2-rev20180801-1.27.0-xrIcl7yUGCktYEb9_xtvjQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.api/gax-grpc/1.29.0/ca2a2853c6f9fc4a25fccd0068f88d98b28e9e35/gax-grpc-1.29.0.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/gax-grpc-1.29.0-zTd_Ed8L8exEKsPYvEo82Q.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-auth/2.7.3/7d1236a477accb4c67fc9615ed67732097fb9af9/hadoop-auth-2.7.3.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/hadoop-auth-2.7.3-RxdgtirzHjv-Tmpzkpho1w.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.sun.jersey/jersey-json/1.9/1aa73e1896bcc7013fed247157d7f676226eb432/jersey-json-1.9.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/jersey-json-1.9-F8prDUntjbFZt4J7be-mtg.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.hamcrest/hamcrest-library/1.3/4785a3c21320980282f9f33d0d1264a69040538f/hamcrest-library-1.3.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/hamcrest-library-1.3-EQrS6oT3AxoXmGSLazGOeQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.powermock/powermock-module-junit3/1.6.4/3fbdbc0a435a45d9fa9db8cafc0c0b3fc0e3776a/powermock-module-junit3-1.6.4.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/powermock-module-junit3-1.6.4-ubMpYIiOciKneJxfj2Jp6Q.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.hamcrest/hamcrest-core/1.3/42a25dc3219429f0e5d060061f71acb49bf010a0/hamcrest-core-1.3.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/hamcrest-core-1.3-Y5M2O0fdy7qCMhEQw-B1GQ.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/javax.xml.bind/jaxb-api/2.2.12/4c83805595b15acf41d71d49e3add7c0e85baaed/jaxb-api-2.2.12.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/jaxb-api-2.2.12-YiKXN-VwBR0qzkhZL699Tg.jar
Feb 09, 2019 12:58:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-annotations/2.7.3/a55da50d8b25df34dc4ecab9cbd3a5a24664594/hadoop-annotations-2.7.3.jar to gs://temp-storage-for-perf-tests/parquetioit0writethenreadall-jenkins-0209005759-fae40c50/output/results/staging/hadoop-annotations-2.7.3-BBROoTqh1lTD9XiUFTuqBQ.jar
Gradle Test Executor 1 finished executing tests.
> Task :beam-sdks-java-io-file-based-io-tests:integrationTest FAILED
org.apache.beam.sdk.io.parquet.ParquetIOIT > writeThenReadAll FAILED
java.lang.RuntimeException: Error while staging packages
at org.apache.beam.runners.dataflow.util.PackageUtil.stageClasspathElements(PackageUtil.java:403)
at org.apache.beam.runners.dataflow.util.PackageUtil.stageClasspathElements(PackageUtil.java:273)
at org.apache.beam.runners.dataflow.util.GcsStager.stageFiles(GcsStager.java:82)
at org.apache.beam.runners.dataflow.util.GcsStager.stageDefaultFiles(GcsStager.java:70)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:713)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:98)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:350)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:331)
at org.apache.beam.sdk.io.parquet.ParquetIOIT.writeThenReadAll(ParquetIOIT.java:133)
Caused by:
java.lang.OutOfMemoryError: unable to create new native thread
Finished generating test XML results (0.017 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.029 secs) into: <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
:beam-sdks-java-io-file-based-io-tests:integrationTest (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 8.69 secs.
93 actionable tasks: 1 executed, 92 up-to-date
Publishing build scan...
https://gradle.com/s/oxigumg5v3vvw
STDERR:
1 test completed, 1 failed
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-sdks-java-io-file-based-io-tests:integrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
Run with --debug option to get more log output. Run with --scan to get full insights.
* Exception is:
org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':beam-sdks-java-io-file-based-io-tests:integrationTest'.
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:110)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:77)
at org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51)
at org.gradle.api.internal.tasks.execution.SkipCachedTaskExecuter.execute(SkipCachedTaskExecuter.java:105)
at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ResolveBuildCacheKeyExecuter.execute(ResolveBuildCacheKeyExecuter.java:79)
at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101)
at org.gradle.api.internal.tasks.execution.FinalizeInputFilePropertiesTaskExecuter.execute(FinalizeInputFilePropertiesTaskExecuter.java:44)
at org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91)
at org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62)
at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:59)
at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43)
at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.run(EventFiringTaskExecuter.java:51)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:301)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:293)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:175)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:91)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:46)
at org.gradle.execution.taskgraph.LocalTaskInfoExecutor.execute(LocalTaskInfoExecutor.java:42)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:277)
at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareWorkItemExecutor.execute(DefaultTaskExecutionGraph.java:262)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:135)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:130)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.execute(DefaultTaskPlanExecutor.java:200)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.executeWithWork(DefaultTaskPlanExecutor.java:191)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$ExecutorWorker.run(DefaultTaskPlanExecutor.java:130)
at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
Caused by: org.gradle.api.GradleException: There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
at org.gradle.api.tasks.testing.AbstractTestTask.handleTestFailures(AbstractTestTask.java:612)
at org.gradle.api.tasks.testing.AbstractTestTask.executeTests(AbstractTestTask.java:484)
at org.gradle.api.tasks.testing.Test.executeTests(Test.java:603)
at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:46)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:39)
at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:26)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:801)
at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:768)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:131)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:301)
at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:293)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:175)
at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:91)
at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:120)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:99)
... 33 more
* Get more help at https://help.gradle.org
BUILD FAILED in 23s
2019-02-09 00:58:02,671 4eee0efa MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 732, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 587, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-02-09 00:58:02,672 4eee0efa MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2019-02-09 00:58:02,672 4eee0efa MainThread beam_integration_benchmark(1/1) INFO Running: kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-959> delete -f <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml> --ignore-not-found
2019-02-09 00:59:47,264 4eee0efa MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 872, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 732, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 587, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-02-09 00:59:47,265 4eee0efa MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-02-09 00:59:47,265 4eee0efa MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-02-09 00:59:47,265 4eee0efa MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/runs/4eee0efa/pkb.log>
2019-02-09 00:59:47,265 4eee0efa MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/runs/4eee0efa/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PerformanceTests_ParquetIOIT_HDFS #960
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/960/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org