You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/11/04 23:04:17 UTC
Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #1483
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/1483/display/redirect>
Changes:
------------------------------------------
[...truncated 272.73 KB...]
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Caching has not been enabled for the task
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.388 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is fea621d49dbec766a7a84e8985cbf2bb
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with JDK Java compiler API.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Created classpath snapshot for incremental compilation in 0.111 secs. 910 duplicate classes found in classpath (see all with --debug).
Stored cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key fea621d49dbec766a7a84e8985cbf2bb
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 5.639 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Could not read file path '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test'.>
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 5,5,main]) completed. Took 0.2 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Created classpath snapshot for incremental compilation in 0.657 secs. 316 duplicate classes found in classpath (see all with --debug).
Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 055206016b328dfea3c914df437c510b
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Daemon ****,5,main]) completed. Took 13.546 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Daemon ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar
Could not read file path '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/resources/main'.>
Could not read file path '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/original_sources_to_package'.>
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Caching disabled for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' because:
Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/resources/main',> not found
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/original_sources_to_package',> not found
*******************
GRADLE SHADOW STATS
Total Jars: 16 (includes project)
Total Time: 3.205s [3205ms]
Average Time/Jar: 0.2003125s [200.3125ms]
*******************
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Daemon ****,5,main]) completed. Took 4.355 secs.
:sdks:java:io:kafka:integrationTest (Thread[Daemon ****,5,main]) started.
Gradle Test Executor 9 started executing tests.
> Task :sdks:java:io:kafka:integrationTest
Custom actions are attached to task ':sdks:java:io:kafka:integrationTest'.
Build cache key for task ':sdks:java:io:kafka:integrationTest' is 3217e5f41a9900f738774c88ffbadd6c
Task ':sdks:java:io:kafka:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 9'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"100000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=kafkaioit_results_sdf_wrapper","--influxMeasurement=kafkaioit_results_sdf_wrapper","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--kafkaBootstrapServerAddresses=35.194.13.87:32400,35.202.98.75:32401,34.71.121.182:32402","--kafkaTopic=beam","--readTimeout=900","--numWorkers=5","--autoscalingAlgorithm=NONE","--experiments=beam_fn_api,use_runner_v2,use_unified_****","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.26.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/6.6.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 9'
Successfully started process 'Gradle Test Executor 9'
org.apache.beam.sdk.io.kafka.KafkaIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.26.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOWrapperReadWithRunnerV2 STANDARD_ERROR
Nov 04, 2020 11:04:06 PM org.apache.beam.sdk.coders.SerializableCoder checkEqualsMethodDefined
WARNING: Can't verify serialized elements of type Shard have well defined equals method. This may produce incorrect results on some PipelineRunner
Nov 04, 2020 11:04:07 PM org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory tryCreateDefaultBucket
INFO: No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
Nov 04, 2020 11:04:07 PM org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
Nov 04, 2020 11:04:07 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Nov 04, 2020 11:04:08 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 209 files. Enable logging at DEBUG level to see which files will be staged.
Nov 04, 2020 11:04:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 210 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes forFileToStage
INFO: Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.26.0-SNAPSHOT-w0NepJQLmuhmoeCWxPNZ0nhtu3XRS5MCHu2hngX01Sc.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /tmp/test5981604060043744119.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-bxHcjRRFKxq3usVNg1or1ODCF8Ybl7nqegxKaWL1E7c.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/direct-java/build/libs/beam-runners-direct-java-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-direct-java-2.26.0-SNAPSHOT-_RANE3ozTUJLoefwcWH4hcaAxRj3eXcgeeCpa1bpE3U.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/expansion-service/build/libs/beam-sdks-java-expansion-service-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-expansion-service-2.26.0-SNAPSHOT-mDnjJyWUqtqEj1CFdhwEsul_ZrULZzuvLGNl0H02G5Q.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /tmp/main9124889668921327449.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-LHWmpjukuWA_ihmIZFMJ2G3GnKwy1iygD9z4q6sTRjU.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/extensions/google-cloud-platform-core/build/libs/beam-sdks-java-extensions-google-cloud-platform-core-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-extensions-google-cloud-platform-core-2.26.0-SNAPSHOT-tests-MGqYIT6NYzeycmBHWTEu_tqvNylNCHOwCZFg6FU-4KE.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/vendor/sdks-java-extensions-protobuf/build/libs/beam-vendor-sdks-java-extensions-protobuf-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-vendor-sdks-java-extensions-protobuf-2.26.0-SNAPSHOT-APYjsrkK8_CABHDWT-Olov53bzbMGt4Dd2akb5vdrqI.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/testing/test-utils/build/libs/beam-sdks-java-test-utils-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-test-utils-2.26.0-SNAPSHOT-p6rT5oDP6A-jwW-_MoOw2TEnZlgd6cbsRoF6c5qcSQA.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/core-construction-java/build/libs/beam-runners-core-construction-java-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-core-construction-java-2.26.0-SNAPSHOT-vzLXE88wqqdh9LEDjGHSvonf2emVH2rGcu2td9LZonE.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/build/libs/beam-runners-google-cloud-dataflow-java-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-google-cloud-dataflow-java-2.26.0-SNAPSHOT-n-TBEZ5zAZWfdAezJ6u6ophQykAnBWHneEZWkA7XDio.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-google-cloud-platform-2.26.0-SNAPSHOT-tests-tmYz57CAUnfSfjyzUUJ0pc5xKytnj0kGx9JsIFHgwfw.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-google-cloud-platform-2.26.0-SNAPSHOT-qGJgG2Bo_iwP3eNQp-ToPPCdCBTWx6LzPhD4VZdBG8Y.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-core-2.26.0-SNAPSHOT-2DhQcrF_-a5Nmy48BqHR-JSEoxxYNbZqaEB5Rb30bsY.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/build/libs/beam-runners-google-cloud-dataflow-java-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-google-cloud-dataflow-java-2.26.0-SNAPSHOT-tests-BRa1nnM5Gj6UxdSTZ3sw_iQNmJg-R2p3MlQ5lyRYmGM.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/synthetic/build/libs/beam-sdks-java-io-synthetic-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-synthetic-2.26.0-SNAPSHOT-diSe61xO7vRqywuiNptds9iZQ7EWd_TMrrPX7D0DVEI.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/extensions/google-cloud-platform-core/build/libs/beam-sdks-java-extensions-google-cloud-platform-core-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-extensions-google-cloud-platform-core-2.26.0-SNAPSHOT-bWF7_CpLWHANLIOYnKdjwZ6GJ0IzfOu2_m-LWTEMeto.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/testing/test-utils/build/libs/beam-sdks-java-test-utils-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-test-utils-2.26.0-SNAPSHOT-tests--vY9ds7zyxfZTGMZ8l-GgXJRoukC0M8EkZA8_DghhWg.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/common/build/libs/beam-sdks-java-io-common-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-common-2.26.0-SNAPSHOT-gdspKeQWlQgKTsFxPbRiN3H1ux2ztLVXFjfwO5UQ7xE.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/java-fn-execution/build/libs/beam-runners-java-fn-execution-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-java-fn-execution-2.26.0-SNAPSHOT-k07lw5LhqEF54sHqVH-a8TR3nn9ao8Bg0stkEeNPcZ0.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/fn-execution/build/libs/beam-sdks-java-fn-execution-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-fn-execution-2.26.0-SNAPSHOT-Em5IjGrt72GRo9YDTYnUtqrrHjIJfQuuVvZ4x2mRa5s.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/common/build/libs/beam-sdks-java-io-common-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-common-2.26.0-SNAPSHOT-tests-K6flv-RkyuDtTr5E5nje5xVG2NLDD25wsF0agzOE5vY.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/extensions/protobuf/build/libs/beam-sdks-java-extensions-protobuf-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-extensions-protobuf-2.26.0-SNAPSHOT-z93oW6s1p8D5E4gHswqu1YCUAjNHH65c0OvSb9HQxrQ.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-core-2.26.0-SNAPSHOT-tests-H-DwhNlByn1fEDEFXFhPIqZvpswQzUwOf0aiApQTZAA.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-google-cloud-dataflow-java-legacy-****-2.26.0-SNAPSHOT-w0NepJQLmuhmoeCWxPNZ0nhtu3XRS5MCHu2hngX01Sc.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/model/pipeline/build/libs/beam-model-pipeline-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-model-pipeline-2.26.0-SNAPSHOT-i6gC4UDcx_CSHC9b2N_KYxk1ZZL_SlMrWxsj44Ny4r8.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/model/job-management/build/libs/beam-model-job-management-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-model-job-management-2.26.0-SNAPSHOT-xuSQwLnbKtc5nGTYenP10y1wh04q0ugx6zopH92xtDU.jar
Nov 04, 2020 11:04:10 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/model/fn-execution/build/libs/beam-model-fn-execution-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-model-fn-execution-2.26.0-SNAPSHOT-_j9OdcBgRMHyjw9sx9SCyOdbf5imzBAM2ArKw3wwb5E.jar
Nov 04, 2020 11:04:12 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 184 files cached, 26 files newly uploaded in 2 seconds
Nov 04, 2020 11:04:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate records/Impulse as step s1
Nov 04, 2020 11:04:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate records/ParDo(OutputSingleSource) as step s2
Nov 04, 2020 11:04:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate records/ParDo(BoundedSourceAsSDFWrapper) as step s3
Nov 04, 2020 11:04:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Measure write time as step s4
Nov 04, 2020 11:04:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to Kafka/Kafka ProducerRecord/Map as step s5
Nov 04, 2020 11:04:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to Kafka/KafkaIO.WriteRecords/ParDo(KafkaWriter) as step s6
Nov 04, 2020 11:04:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://dataflow-staging-us-central1-844138762903/temp/staging/
Nov 04, 2020 11:04:13 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <94847 bytes, hash 04bdb694173d11cb006de361fc5f90d546f046b7a0c0aef68894f74bf318d4f7> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-BL22lBc9EcsAbeNh_F-Q1UbwRregwK72iJT3S_MY1Pc.pb
Nov 04, 2020 11:04:13 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.26.0-SNAPSHOT
Nov 04, 2020 11:04:13 PM org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs.
Gradle Test Executor 9 finished executing tests.
> Task :sdks:java:io:kafka:integrationTest FAILED
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOWrapperReadWithRunnerV2 FAILED
java.lang.RuntimeException: Failed to create a workflow job: (52dda40b997cd251): The workflow could not be created. Causes: (52dda40b997cd17e): An internal service error occurred. Please contact customer support. Please include the message id if one is provided.
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:1127)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:196)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:320)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:351)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:332)
at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOWrapperReadWithRunnerV2(KafkaIOIT.java:128)
Caused by:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
POST https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "(52dda40b997cd251): The workflow could not be created. Causes: (52dda40b997cd17e): An internal service error occurred. Please contact customer support. Please include the message id if one is provided.",
"reason" : "badRequest"
} ],
"message" : "(52dda40b997cd251): The workflow could not be created. Causes: (52dda40b997cd17e): An internal service error occurred. Please contact customer support. Please include the message id if one is provided.",
"status" : "INVALID_ARGUMENT"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:149)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:112)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:39)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:443)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1108)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:541)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:474)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:591)
at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:62)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:1113)
... 5 more
1 test completed, 1 failed
Finished generating test XML results (0.021 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
:sdks:java:io:kafka:integrationTest (Thread[Daemon ****,5,main]) completed. Took 11.823 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 17s
85 actionable tasks: 84 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/h2xdqv7dmllwu
Stopped 8 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PerformanceTests_Kafka_IO
#1485
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/1485/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #1484
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/1484/display/redirect>
Changes:
------------------------------------------
[...truncated 272.79 KB...]
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Caching has not been enabled for the task
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.273 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is a0a5afab5d4b2fd8d742d1ec2a80d7ea
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with JDK Java compiler API.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Created classpath snapshot for incremental compilation in 0.123 secs. 910 duplicate classes found in classpath (see all with --debug).
Stored cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key a0a5afab5d4b2fd8d742d1ec2a80d7ea
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 6.52 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Could not read file path '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test'.>
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.05 secs.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Created classpath snapshot for incremental compilation in 0.201 secs. 316 duplicate classes found in classpath (see all with --debug).
Stored cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 53a4be2174e96363db71f1fd7f3fb202
:runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 14.49 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 9,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar
Could not read file path '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/resources/main'.>
Could not read file path '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/original_sources_to_package'.>
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'.
Caching disabled for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' because:
Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/resources/main',> not found
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/original_sources_to_package',> not found
*******************
GRADLE SHADOW STATS
Total Jars: 16 (includes project)
Total Time: 3.19s [3190ms]
Average Time/Jar: 0.199375s [199.375ms]
*******************
:runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 3.953 secs.
:sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) started.
Gradle Test Executor 9 started executing tests.
> Task :sdks:java:io:kafka:integrationTest
Custom actions are attached to task ':sdks:java:io:kafka:integrationTest'.
Build cache key for task ':sdks:java:io:kafka:integrationTest' is fd13bd36e0dc232f4547b98a342034be
Task ':sdks:java:io:kafka:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 9'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"100000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=kafkaioit_results_sdf_wrapper","--influxMeasurement=kafkaioit_results_sdf_wrapper","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--kafkaBootstrapServerAddresses=35.222.231.178:32400,34.123.137.228:32401,146.148.92.32:32402","--kafkaTopic=beam","--readTimeout=900","--numWorkers=5","--autoscalingAlgorithm=NONE","--experiments=beam_fn_api,use_runner_v2,use_unified_****","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.26.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/6.6.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 9'
Successfully started process 'Gradle Test Executor 9'
org.apache.beam.sdk.io.kafka.KafkaIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.26.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOWrapperReadWithRunnerV2 STANDARD_ERROR
Nov 04, 2020 11:44:16 PM org.apache.beam.sdk.coders.SerializableCoder checkEqualsMethodDefined
WARNING: Can't verify serialized elements of type Shard have well defined equals method. This may produce incorrect results on some PipelineRunner
Nov 04, 2020 11:44:17 PM org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory tryCreateDefaultBucket
INFO: No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
Nov 04, 2020 11:44:17 PM org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
Nov 04, 2020 11:44:17 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Nov 04, 2020 11:44:18 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 209 files. Enable logging at DEBUG level to see which files will be staged.
Nov 04, 2020 11:44:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 210 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil$PackageAttributes forFileToStage
INFO: Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.26.0-SNAPSHOT-rAV1CoIevQZB47RMftmRurYF9xd2gYAVkRPnlvZT1CQ.jar
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /tmp/test598357885276094265.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-d45sdy5pY9wYDmyVzmDMYgi25yLdrliFgDQDOFlTCRI.jar
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-google-cloud-platform-2.26.0-SNAPSHOT-tests-ncEL6M23Pd3lYTaG6fcudHvuVo64aVBz3CU8W4cz7Qc.jar
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/testing/test-utils/build/libs/beam-sdks-java-test-utils-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-test-utils-2.26.0-SNAPSHOT-tests-zrqHiV-8GlyliMh3rAB1amt1BPhJqafq7LMqyvGv0SE.jar
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/build/libs/beam-runners-google-cloud-dataflow-java-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-google-cloud-dataflow-java-2.26.0-SNAPSHOT-xBPusrw8Jf_pMZNS1uZR7GpbkPXvoKrmMJ4-R74R0Qk.jar
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /tmp/main4491057965656746103.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-ZeenyDRfRbxz9CKrZYhP4kFveEt1Ej5ycTXZzyi6FVY.jar
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/expansion-service/build/libs/beam-sdks-java-expansion-service-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-expansion-service-2.26.0-SNAPSHOT-fw1zlqL2QCumOZc_Rmnh8FCPuuNDMjCBM-0WARB7Z9Y.jar
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/common/build/libs/beam-sdks-java-io-common-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-common-2.26.0-SNAPSHOT-tests-qcEgNWE7hzpk1bv3c1TNCRZv7smTV9JdFqoSnMQblso.jar
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/core-construction-java/build/libs/beam-runners-core-construction-java-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-core-construction-java-2.26.0-SNAPSHOT-wA3TWAVVNdxd_pLuYXUGPC73c2x9lRR4OKGsNJ_q1wA.jar
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/build/libs/beam-runners-google-cloud-dataflow-java-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-google-cloud-dataflow-java-2.26.0-SNAPSHOT-tests-gQzoKwp22CIFuPAf6bL8eC8c5XAGxMcPAXyZbesYNHw.jar
Nov 04, 2020 11:44:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-google-cloud-platform-2.26.0-SNAPSHOT-2NinbVm7jxjI0UpqzHk4PnERdMflIzWdsvRDgXnWoGI.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/synthetic/build/libs/beam-sdks-java-io-synthetic-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-synthetic-2.26.0-SNAPSHOT-MT6KZ49SV-Fq7t7GGem7isb3xX57q8MC9ojJLAoeaak.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/testing/test-utils/build/libs/beam-sdks-java-test-utils-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-test-utils-2.26.0-SNAPSHOT-P-kkHguYqxdjDy4duVmsFlJ0I-FZ_OZFzm6bLoDFwCQ.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/extensions/protobuf/build/libs/beam-sdks-java-extensions-protobuf-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-extensions-protobuf-2.26.0-SNAPSHOT-C-P01YjpHRDnbwSrgLutFc9K9yr-K6d2NOGk8T4LWYQ.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/extensions/google-cloud-platform-core/build/libs/beam-sdks-java-extensions-google-cloud-platform-core-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-extensions-google-cloud-platform-core-2.26.0-SNAPSHOT-7zSx5Knsxx8hK0PeuVTmLz0gW4D4BjzDYkjWvn-SJ-g.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/common/build/libs/beam-sdks-java-io-common-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-io-common-2.26.0-SNAPSHOT-v2IULgk2Qu_kFEJ3_2sq5pITQdB_bX46AN0zLtRw2B4.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/fn-execution/build/libs/beam-sdks-java-fn-execution-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-fn-execution-2.26.0-SNAPSHOT-dmTU7OiRykCPHnPf6wtkmh-P11rAUPWldiab2vZy02s.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-core-2.26.0-SNAPSHOT-tests-wNYV9M4l3YxYldphM87jsXzPpNXrTn7dphybgF7iBCk.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/direct-java/build/libs/beam-runners-direct-java-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-direct-java-2.26.0-SNAPSHOT-mYCsPvs_2Ah9W5V2-FgXgEg0afD21kKdhf8Qr61hhxc.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/extensions/google-cloud-platform-core/build/libs/beam-sdks-java-extensions-google-cloud-platform-core-2.26.0-SNAPSHOT-tests.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-extensions-google-cloud-platform-core-2.26.0-SNAPSHOT-tests-2m4Mu3jt05WOJPBmESvURUBYYs_R9q_DFLiBsIhRP2Q.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/java-fn-execution/build/libs/beam-runners-java-fn-execution-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-java-fn-execution-2.26.0-SNAPSHOT-L4EVTrSnadVcwOsyOOiB606-rCvQAYKSchhhcOJv1Ts.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/vendor/sdks-java-extensions-protobuf/build/libs/beam-vendor-sdks-java-extensions-protobuf-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-vendor-sdks-java-extensions-protobuf-2.26.0-SNAPSHOT-DPKeNxZ6WHvaL6yYXsWREhUZrJB6U_tsot41eA4gfwI.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-sdks-java-core-2.26.0-SNAPSHOT-vH8RXUyU_jckOsLQAfyaH30CXHzYq7OzhT6HBEDQ1u4.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-runners-google-cloud-dataflow-java-legacy-****-2.26.0-SNAPSHOT-rAV1CoIevQZB47RMftmRurYF9xd2gYAVkRPnlvZT1CQ.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/model/job-management/build/libs/beam-model-job-management-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-model-job-management-2.26.0-SNAPSHOT-8u9q7-uSKvPDVYi0SFkuqwd07iZ_8RYJMAHxl2rwkDM.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/model/pipeline/build/libs/beam-model-pipeline-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-model-pipeline-2.26.0-SNAPSHOT-jE93PTj8AmT6NuSnNnQwO-gwLzF0UfQ7XzK6gtP0X74.jar
Nov 04, 2020 11:44:21 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/model/fn-execution/build/libs/beam-model-fn-execution-2.26.0-SNAPSHOT.jar> to gs://dataflow-staging-us-central1-844138762903/temp/staging/beam-model-fn-execution-2.26.0-SNAPSHOT-X13Aveb4OSV1d8lm1_qPhj40AQQK1lnKFX2d8ZfMDGY.jar
Nov 04, 2020 11:44:23 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 184 files cached, 26 files newly uploaded in 2 seconds
Nov 04, 2020 11:44:23 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate records/Impulse as step s1
Nov 04, 2020 11:44:23 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate records/ParDo(OutputSingleSource) as step s2
Nov 04, 2020 11:44:23 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Generate records/ParDo(BoundedSourceAsSDFWrapper) as step s3
Nov 04, 2020 11:44:23 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Measure write time as step s4
Nov 04, 2020 11:44:23 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to Kafka/Kafka ProducerRecord/Map as step s5
Nov 04, 2020 11:44:23 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Write to Kafka/KafkaIO.WriteRecords/ParDo(KafkaWriter) as step s6
Nov 04, 2020 11:44:23 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://dataflow-staging-us-central1-844138762903/temp/staging/
Nov 04, 2020 11:44:23 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <94856 bytes, hash 5d4830efa1a43c7758d6eefcf6a34becfbe5cb14f2b9a188049732bd7691a572> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-XUgw76GkPHdY1u789qNL7PvlyxTyuaGIBJcyvXaRpXI.pb
Nov 04, 2020 11:44:23 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.26.0-SNAPSHOT
Nov 04, 2020 11:44:24 PM org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
WARNING: Request failed with code 400, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs.
Gradle Test Executor 9 finished executing tests.
> Task :sdks:java:io:kafka:integrationTest FAILED
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOWrapperReadWithRunnerV2 FAILED
java.lang.RuntimeException: Failed to create a workflow job: (8b898fd7b73e9075): The workflow could not be created. Causes: (8b898fd7b73e9de2): An internal service error occurred. Please contact customer support. Please include the message id if one is provided.
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:1127)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:196)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:320)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:351)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:332)
at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOWrapperReadWithRunnerV2(KafkaIOIT.java:128)
Caused by:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request
POST https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs
{
"code" : 400,
"errors" : [ {
"domain" : "global",
"message" : "(8b898fd7b73e9075): The workflow could not be created. Causes: (8b898fd7b73e9de2): An internal service error occurred. Please contact customer support. Please include the message id if one is provided.",
"reason" : "badRequest"
} ],
"message" : "(8b898fd7b73e9075): The workflow could not be created. Causes: (8b898fd7b73e9de2): An internal service error occurred. Please contact customer support. Please include the message id if one is provided.",
"status" : "INVALID_ARGUMENT"
}
at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:149)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:112)
at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:39)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:443)
at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1108)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:541)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:474)
at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:591)
at org.apache.beam.runners.dataflow.DataflowClient.createJob(DataflowClient.java:62)
at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:1113)
... 5 more
1 test completed, 1 failed
Finished generating test XML results (0.022 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
:sdks:java:io:kafka:integrationTest (Thread[Execution **** for ':' Thread 9,5,main]) completed. Took 12.697 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 33s
85 actionable tasks: 84 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/zvau5in5dhcpa
Stopped 8 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org