You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/05/02 03:02:14 UTC
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #417
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/417/display/redirect>
Changes:
------------------------------------------
[...truncated 359.41 KB...]
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 5,5,main]) completed. Took 0.351 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is d038216814ef34e71c916d2b552d5c28
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key d038216814ef34e71c916d2b552d5c28
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.557 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.044 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:synthetic:compileJava
Note: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/synthetic/src/main/java/org/apache/beam/sdk/io/synthetic/SyntheticBoundedSource.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Class dependency analysis for incremental compilation took 0.371 secs.
Created classpath snapshot for incremental compilation in 0.495 secs.
Stored cache entry for task ':sdks:java:io:synthetic:compileJava' with cache key 3096dea3546950151460a9c559c03aef
:sdks:java:io:synthetic:compileJava (Thread[Execution **** Thread 2,5,main]) completed. Took 12.649 secs.
Resolve mutations for :sdks:java:io:synthetic:classes (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:io:synthetic:classes (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:synthetic:classes (Thread[Execution **** Thread 4,5,main]) started.
> Task :sdks:java:io:synthetic:classes
Skipping task ':sdks:java:io:synthetic:classes' as it has no actions.
:sdks:java:io:synthetic:classes (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:synthetic:jar (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:synthetic:jar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:synthetic:jar (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:synthetic:jar
Caching disabled for task ':sdks:java:io:synthetic:jar' because:
Not worth caching
Task ':sdks:java:io:synthetic:jar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/synthetic/build/resources/main',> not found
:sdks:java:io:synthetic:jar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.02 secs.
work action resolve beam-sdks-java-io-synthetic.jar (project :sdks:java:io:synthetic) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:sparkreceiver:2:compileJava
Class dependency analysis for incremental compilation took 0.275 secs.
Created classpath snapshot for incremental compilation in 0.825 secs.
Stored cache entry for task ':sdks:java:io:sparkreceiver:2:compileJava' with cache key 6abe905eb3c7cf768a39577575606e23
:sdks:java:io:sparkreceiver:2:compileJava (Thread[included builds,5,main]) completed. Took 16.366 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:classes (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:classes (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:classes (Thread[Execution **** Thread 2,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:classes
Skipping task ':sdks:java:io:sparkreceiver:2:classes' as it has no actions.
:sdks:java:io:sparkreceiver:2:classes (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:compileTestJava (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:compileTestJava (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:compileTestJava (Thread[Execution ****,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:compileTestJava
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:compileTestJava'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:compileTestJava' is 0d2ef49d000ad69fc4574e22cdbae6f0
Task ':sdks:java:io:sparkreceiver:2:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':sdks:java:io:sparkreceiver:2:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
Class dependency analysis for incremental compilation took 0.265 secs.
Created classpath snapshot for incremental compilation in 0.758 secs.
Stored cache entry for task ':sdks:java:io:sparkreceiver:2:compileTestJava' with cache key 0d2ef49d000ad69fc4574e22cdbae6f0
:sdks:java:io:sparkreceiver:2:compileTestJava (Thread[Execution ****,5,main]) completed. Took 3.933 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 7,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:testClasses
Skipping task ':sdks:java:io:sparkreceiver:2:testClasses' as it has no actions.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[included builds,5,main]) started.
producer locations for task group 0 (Thread[Execution ****,5,main]) started.
producer locations for task group 0 (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 3 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is 317c2597bbf5b094c14a742d8f011f69
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 3'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@35.224.228.225:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 3'
Successfully started process 'Gradle Test Executor 3'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-8PlDRrtDuaU45Vm31wjH7MQknWuljheUNWMuEMUqr78.jar
[pool-8-thread-21] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main6589184766990030845.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-fK3qiyIREW8FUGfuPobcV6BoCH7cW_R1bqPrr0v2F_M.jar
[pool-8-thread-9] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test1079032752872655892.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-9mLHVSOi2x4Ok3Ro4JJdhJaeTBWRYcvqJJ_oQPxRDPE.jar
[pool-8-thread-19] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test6789065377154360728.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-Bw3mlkYTPaJ0-cieGlntlzNKH26JbXsiKkSQBCeV91E.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160941 bytes, hash 9d37689958737ba38dbd2d8575b1d6957cbd8b8f9fb1b42d074578c8e0aeb077> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-nTdomVhze6ONvS2FdbHWlXy9i4-fsbQtB0V4yOCusHc.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-01_19_32_08-13131192774309352108?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-01_19_32_08-13131192774309352108
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-01_19_32_08-13131192774309352108
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:11.566Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-l6w0. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:25.428Z: Worker configuration: e2-standard-4 in us-central1-f.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.394Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94472278689483 address: 94472475528565 address: 94472475507553 address: 94472475495083 address: 94472475499403 address: 94472475953532 address: 94472425132740 address: 94472433681938 address: 94472377780510 address: 140476757764057 address: 140476757194399 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 17762864291302136166 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.471Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.507Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.534Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.598Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.654Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.680Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.714Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.748Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.779Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.803Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.834Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.855Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:27.889Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:28.206Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:28.280Z: Starting 1 ****s in us-central1-f...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:29.336Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:32:45.859Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:33:08.484Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:33:49.273Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:33:51.145Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:44:42.046Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94472278689483 address: 94472475528565 address: 94472475507553 address: 94472475495083 address: 94472475499403 address: 94472475953532 address: 94472475488740 address: 94472300021765 address: 94472377783816 address: 140476757764057 address: 140476757194399 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 8908420933963020027 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T02:56:42.593Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94472278689483 address: 94472475528565 address: 94472475507553 address: 94472475495083 address: 94472475499403 address: 94472475953532 address: 94472475488740 address: 94472300021765 address: 94472377783816 address: 140476757764057 address: 140476757194399 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 8908420933963022312 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4730000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 3 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
1 test completed, 1 failed
Finished generating test XML results (0.024 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.032 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[included builds,5,main]) completed. Took 40 mins 34.856 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 41m 21s
145 actionable tasks: 89 executed, 54 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/z7z4tnbqxndx2
Stopped 2 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PerformanceTests_SparkReceiver_IO #434
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/434/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #433
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/433/display/redirect>
Changes:
------------------------------------------
[...truncated 367.73 KB...]
Skipping task ':runners:google-cloud-dataflow-java:classes' as it has no actions.
:runners:google-cloud-dataflow-java:classes (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:jar (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:jar (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution ****,5,main]) completed. Took 0.066 secs.
work action resolve beam-runners-google-cloud-dataflow-java.jar (project :runners:google-cloud-dataflow-java) (Thread[included builds,5,main]) started.
work action null (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[included builds,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[included builds,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 2,5,main]) started.
:runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution **** Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 0fbb4bfa0715bd74be82a12155798bbd
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Class dependency analysis for incremental compilation took 0.139 secs.
Created classpath snapshot for incremental compilation in 0.84 secs.
Stored cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 0fbb4bfa0715bd74be82a12155798bbd
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 2,5,main]) completed. Took 11.913 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[included builds,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:compileJava
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:compileJava' is db9d4021c5d23d2f94ac73d692bc1013
Task ':runners:google-cloud-dataflow-java:****:compileJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:****:compileJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.046 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Class dependency analysis for incremental compilation took 0.172 secs.
Created classpath snapshot for incremental compilation in 0.048 secs.
Stored cache entry for task ':runners:google-cloud-dataflow-java:****:compileJava' with cache key db9d4021c5d23d2f94ac73d692bc1013
:runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution **** Thread 3,5,main]) completed. Took 1 mins 20.921 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[included builds,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is af1cdac611e8e0860f84649f93b60574
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/original_sources_to_package',> not found
*******************
GRADLE SHADOW STATS
Total Jars: 15 (includes project)
Total Time: 3.29s [3290ms]
Average Time/Jar: 0.21933333333330002s [219.3333333333ms]
*******************
Stored cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key af1cdac611e8e0860f84649f93b60574
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[included builds,5,main]) completed. Took 5.46 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 7,5,main]) started.
work action null (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 2,5,main]) started.
producer locations for task group 0 (Thread[included builds,5,main]) started.
producer locations for task group 0 (Thread[included builds,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 5 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is a8f551bca6290309192e8025b37b1501
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 5'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@34.135.223.22:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 5'
Successfully started process 'Gradle Test Executor 5'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-NjK7EMYMJApmUrAO-XsFK7DyVs6EHDuc3Cs6jBUn5aA.jar
[pool-8-thread-21] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main32316258769229269.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-ziS2kTzpIqBeX8t7n6S73BzZ1fOcomrs5MQP0BJhlNQ.jar
[pool-8-thread-19] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test4127034078174248480.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-Fbt4vsywU5v1xUseOw2IuywbNH8mzuCe5yCcpOgE94M.jar
[pool-8-thread-8] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test3932714954168014232.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-szZrRRIWP4aeFFoi9rLFOoMxYMJCSuzIQCG68-oa8u8.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160955 bytes, hash 76a29a5f19de6a803fa645cd3e8af9ba97311bbfbba6f93ecec88cd99632794b> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-dqKaXxneaoA_pkXNPor5upcxG7-7pvk-zsiM2ZYyeUs.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-09_19_35_16-4280600003196287578?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-09_19_35_16-4280600003196287578
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-09_19_35_16-4280600003196287578
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:19.616Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-i2i. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:40.697Z: Worker configuration: e2-standard-4 in us-central1-b.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:43.566Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94195180740331 address: 94195383438313 address: 94195383417946 address: 94195383406567 address: 94195383409739 address: 94195383863631 address: 94195336981188 address: 94195345414157 address: 94195285208744 address: 140671976298457 address: 140671975728799 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 3840719923485143146 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:43.643Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:43.684Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:43.709Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:43.774Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:43.850Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:43.883Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:43.916Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:43.948Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:43.980Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:44.015Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:44.038Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:44.062Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:44.089Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:44.543Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:44.598Z: Starting 1 ****s in us-central1-b...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:35:46.696Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:36:00.912Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:36:25.358Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:36:56.147Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:36:58.935Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T02:48:02.943Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94195180740331 address: 94195383438313 address: 94195383417946 address: 94195383406567 address: 94195383409739 address: 94195383863631 address: 94195383400132 address: 94195283255653 address: 94195285208838 address: 140671976298457 address: 140671975728799 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 5477808464422340027 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.sdk.metrics.MetricsEnvironment - Reporting metrics are not supported in the current execution environment.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-10T03:00:00.250Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94195180740331 address: 94195383438313 address: 94195383417946 address: 94195383406567 address: 94195383409739 address: 94195383863631 address: 94195383400132 address: 94195283255653 address: 94195285208838 address: 140671976298457 address: 140671975728799 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 5477808464422338984 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4700000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 5 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.025 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.033 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 2,5,main]) completed. Took 41 mins 31.912 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 44m 19s
145 actionable tasks: 95 executed, 48 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/k7ornjxszfvq4
Stopped 4 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #432
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/432/display/redirect?page=changes>
Changes:
[noreply] [release] Improve Java Artifact Validation Logic (#26564)
------------------------------------------
[...truncated 356.50 KB...]
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 5,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:compileTestJava'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:compileTestJava' is 176a56e4a311ae7110f071033f03d417
Task ':sdks:java:io:sparkreceiver:2:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:sparkreceiver:2:compileTestJava' with cache key 176a56e4a311ae7110f071033f03d417
:sdks:java:io:sparkreceiver:2:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 0.639 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:sparkreceiver:2:testClasses' as it has no actions.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:compileJava' is 063e9191691fef762901208a26762ce2
Task ':runners:google-cloud-dataflow-java:****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:compileJava' with cache key 063e9191691fef762901208a26762ce2
:runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution **** Thread 2,5,main]) completed. Took 0.49 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[included builds,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[included builds,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is ab93a319b3633fc9eed9b303bd1fd869
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key ab93a319b3633fc9eed9b303bd1fd869
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.412 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[included builds,5,main]) started.
work action null (Thread[included builds,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 14811152482dcdacb33489d28db21b62
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 14811152482dcdacb33489d28db21b62
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 5,5,main]) completed. Took 1.016 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.341 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.001 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 3888cfc42cbfee487cb07150a2300301
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 3888cfc42cbfee487cb07150a2300301
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 5,5,main]) completed. Took 0.365 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution ****,5,main]) completed. Took 0.033 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution ****,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 2,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is bd935769c87aca860568b4fcb585a99f
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@35.223.68.23:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-18] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test3532462662505663562.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-GAco1qXFpZgJ6zYKObZ3nUG4tuFrhS_iInewW4VWSMc.jar
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-nCFOzPlm5obg9XO3v8txfCvO5Zin8lX96oBC-ZfN-G4.jar
[pool-8-thread-25] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test4874413290378972444.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-8VEN_aV0Rq2cZuSvNqjPdLOIwggjUudQSVDYDPI3OH8.jar
[pool-8-thread-21] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main5701407994646891382.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-KRDdf59eppqEGDU8aFKC1FcyhNqWvslU5tCOlIaZDz0.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160953 bytes, hash a6a749bdab39a891480294de7d5dd236a37d410b0627bccd6b167cb3e4a89835> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-pqdJvas5qJFIApTefV3SNqN9QQsGJ7zNaxZ8s-SomDU.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-09_07_35_37-6456321842131439859?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-09_07_35_37-6456321842131439859
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-09_07_35_37-6456321842131439859
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:40.130Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-6xvv. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:56.390Z: Worker configuration: e2-standard-4 in us-central1-c.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:58.612Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94688231661291 address: 94688434359273 address: 94688434338906 address: 94688434327527 address: 94688434330699 address: 94688434784591 address: 94688387902148 address: 94688396335117 address: 94688336129704 address: 139943969384409 address: 139943968814751 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 18387169460838436673 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:58.682Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:58.722Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:58.751Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:58.816Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:58.894Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:58.927Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:58.960Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:58.992Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:59.015Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:59.040Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:59.066Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:59.099Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:59.123Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:59.498Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:35:59.583Z: Starting 1 ****s in us-central1-c...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:36:00.651Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:36:02.753Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:36:50.675Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:37:21.494Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:37:24.325Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T14:48:14.479Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94688231661291 address: 94688434359273 address: 94688434338906 address: 94688434327527 address: 94688434330699 address: 94688434784591 address: 94688434321092 address: 94688334176613 address: 94688336129798 address: 139943969384409 address: 139943968814751 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 3136933257041891955 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T15:00:14.103Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94688231661291 address: 94688434359273 address: 94688434338906 address: 94688434327527 address: 94688434330699 address: 94688434784591 address: 94688434321092 address: 94688334176613 address: 94688336129798 address: 139943969384409 address: 139943968814751 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 3136933257041891500 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4710000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
1 test completed, 1 failed
Finished generating test XML results (0.03 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.04 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution ****,5,main]) completed. Took 41 mins 40.822 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 42m 14s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/5asut75uikah6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #431
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/431/display/redirect>
Changes:
------------------------------------------
[...truncated 354.09 KB...]
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 5,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:sparkreceiver:2:testClasses' as it has no actions.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 8c980e172a6e23c3021d6a0d3875db09
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 8c980e172a6e23c3021d6a0d3875db09
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) started.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.253 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) completed. Took 0.073 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is ab93a319b3633fc9eed9b303bd1fd869
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key ab93a319b3633fc9eed9b303bd1fd869
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.555 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[included builds,5,main]) started.
work action null (Thread[included builds,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[included builds,5,main]) started.
work action null (Thread[included builds,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 14811152482dcdacb33489d28db21b62
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 14811152482dcdacb33489d28db21b62
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 2,5,main]) completed. Took 0.652 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.33 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 3888cfc42cbfee487cb07150a2300301
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 3888cfc42cbfee487cb07150a2300301
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 0.424 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.033 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 3,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 7,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is bd935769c87aca860568b4fcb585a99f
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@34.27.242.75:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-nCFOzPlm5obg9XO3v8txfCvO5Zin8lX96oBC-ZfN-G4.jar
[pool-8-thread-4] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test1030619658035824103.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-0ttiCCO_5fYdPv9I-4PWolzmjbBtARxDRFJGmAqeftY.jar
[pool-8-thread-18] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test5767332047855851055.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-yjC9Iazba7rXh42EGSUIRZZLhmH_HSBMjsRGXNwUx80.jar
[pool-8-thread-20] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main5008933798244469824.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-UzW6zTeI6FgqpCdro6Hn48g8gpc2B9ljYjocwSbdBPA.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 3 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160953 bytes, hash b3c874edd32e19a238eeabac017b1393c7633e3a407acd85027a05d86e68007e> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-s8h07dMuGaI47qusAXsTk8djPjpAes2FAnoF2G5oAH4.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-08_19_31_07-10257873468162822437?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-08_19_31_07-10257873468162822437
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-08_19_31_07-10257873468162822437
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:15.306Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-xjky. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:34.555Z: Worker configuration: e2-standard-4 in us-central1-c.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:41.987Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 93908321804011 address: 93908524501993 address: 93908524481626 address: 93908524470247 address: 93908524473419 address: 93908524927311 address: 93908478044868 address: 93908486477837 address: 93908426272424 address: 140070568757209 address: 140070568187551 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 3886220743238850515 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:42.824Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:42.864Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:42.896Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:42.962Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.019Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.044Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.076Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.105Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.132Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.165Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.198Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.220Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.254Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.878Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:43.951Z: Starting 1 ****s in us-central1-c...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:46.025Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:31:57.541Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:32:22.642Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:32:53.420Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:32:56.040Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:43:58.585Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 93908321804011 address: 93908524501993 address: 93908524481626 address: 93908524470247 address: 93908524473419 address: 93908524927311 address: 93908524463812 address: 93908424319333 address: 93908426272518 address: 140070568757209 address: 140070568187551 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 14572931393657635887 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-09T02:55:59.044Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 93908321804011 address: 93908524501993 address: 93908524481626 address: 93908524470247 address: 93908524473419 address: 93908524927311 address: 93908524463812 address: 93908424319333 address: 93908426272518 address: 140070568757209 address: 140070568187551 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 14572931393657636390 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4750000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.03 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.037 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 3,5,main]) completed. Took 39 mins 34.359 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 40m 7s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/odffaa5jbdpfk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #430
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/430/display/redirect?page=changes>
Changes:
[noreply] [Tour of Beam] Learning content for "Core Transforms" module (#26582)
------------------------------------------
[...truncated 353.49 KB...]
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 5,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:compileJava' is 063e9191691fef762901208a26762ce2
Task ':runners:google-cloud-dataflow-java:****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:compileJava' with cache key 063e9191691fef762901208a26762ce2
:runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution ****,5,main]) completed. Took 0.482 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) completed. Took 0.07 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution **** Thread 7,5,main]) started.
work action null (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is ab93a319b3633fc9eed9b303bd1fd869
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key ab93a319b3633fc9eed9b303bd1fd869
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.399 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 14811152482dcdacb33489d28db21b62
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 14811152482dcdacb33489d28db21b62
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.654 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.327 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution **** Thread 3,5,main]) started.
work action null (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 3888cfc42cbfee487cb07150a2300301
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 3888cfc42cbfee487cb07150a2300301
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.319 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution ****,5,main]) completed. Took 0.031 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 2,5,main]) started.
producer locations for task group 0 (Thread[Execution ****,5,main]) started.
producer locations for task group 0 (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is bd935769c87aca860568b4fcb585a99f
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@34.28.151.220:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-nCFOzPlm5obg9XO3v8txfCvO5Zin8lX96oBC-ZfN-G4.jar
[pool-8-thread-18] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test1365411916286616436.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-oJDP1SZzwu8GcfuJ-XlNXRDZmGN3RjFeNyNTsMUuib4.jar
[pool-8-thread-23] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test6061774832213310917.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-ql3zfZE7Eng1IxlTGYjLbfIa8kWIGa8Bdzachq_1eDk.jar
[pool-8-thread-20] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main9095269908425153428.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-Ps5ZA8Mi_LSjRU9A4T3GV18cS55fx6Ux-t-8rEvrseI.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 3 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160954 bytes, hash d34e25730a11e4a6f246c26a4dc4ecf65cc2cc91991a59cc9484469e8a36fe40> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-004lcwoR5KbyRsJqTcTs9lzCzJGZGlnMlIRGnoo2_kA.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-08_07_30_09-12101490635204134599?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-08_07_30_09-12101490635204134599
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-08_07_30_09-12101490635204134599
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:12.992Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-kmkd. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:31.326Z: Worker configuration: e2-standard-4 in us-central1-b.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:33.783Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94790327312107 address: 94790530010089 address: 94790529989722 address: 94790529978343 address: 94790529981515 address: 94790530435407 address: 94790483552964 address: 94790491985933 address: 94790431780520 address: 140128605775833 address: 140128605206175 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 5064774094018387025 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:33.874Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:33.900Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:33.927Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:33.984Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.049Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.087Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.126Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.152Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.180Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.206Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.236Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.258Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.288Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.689Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:34.763Z: Starting 1 ****s in us-central1-b...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:36.848Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:30:43.959Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:31:14.538Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:31:51.268Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:31:54.187Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:42:51.364Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94790327312107 address: 94790530010089 address: 94790529989722 address: 94790529978343 address: 94790529981515 address: 94790530435407 address: 94790529971908 address: 94790429827429 address: 94790431780614 address: 140128605775833 address: 140128605206175 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 18005649905903123307 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T14:54:51.200Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94790327312107 address: 94790530010089 address: 94790529989722 address: 94790529978343 address: 94790529981515 address: 94790530435407 address: 94790529971908 address: 94790429827429 address: 94790431780614 address: 140128605775833 address: 140128605206175 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 18005649905903124186 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4820000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.029 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 2,5,main]) completed. Took 38 mins 28.531 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 38m 57s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/tfgecmkgold7e
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #429
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/429/display/redirect?page=changes>
Changes:
[noreply] Adds kwargs to allow env variables to be set for RunInference (#26553)
------------------------------------------
[...truncated 354.93 KB...]
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.069 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is ab93a319b3633fc9eed9b303bd1fd869
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key ab93a319b3633fc9eed9b303bd1fd869
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.404 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[included builds,5,main]) started.
work action null (Thread[included builds,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
This JVM does not support getting OS memory, so no OS memory status updates will be broadcast
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 14811152482dcdacb33489d28db21b62
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 14811152482dcdacb33489d28db21b62
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.754 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.33 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[included builds,5,main]) started.
work action null (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:compileTestJava
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:compileTestJava'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:compileTestJava' is 176a56e4a311ae7110f071033f03d417
Task ':sdks:java:io:sparkreceiver:2:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':sdks:java:io:sparkreceiver:2:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Starting process 'Gradle Worker Daemon 1'. Working directory: /home/jenkins/.gradle/****s Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar -Xmx512m -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Worker Daemon 1'
Successfully started process 'Gradle Worker Daemon 1'
Started Gradle **** daemon (0.579 secs) with fork options DaemonForkOptions{executable=/usr/lib/jvm/java-8-openjdk-amd64/bin/java, minHeapSize=null, maxHeapSize=null, jvmArgs=[-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar], keepAliveMode=SESSION}.
Compiling with JDK Java compiler API.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 3888cfc42cbfee487cb07150a2300301
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 3888cfc42cbfee487cb07150a2300301
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.392 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.038 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:sparkreceiver:2:compileTestJava
Class dependency analysis for incremental compilation took 0.085 secs.
Created classpath snapshot for incremental compilation in 0.963 secs.
Stored cache entry for task ':sdks:java:io:sparkreceiver:2:compileTestJava' with cache key 176a56e4a311ae7110f071033f03d417
:sdks:java:io:sparkreceiver:2:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 6.717 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 2,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:testClasses
Skipping task ':sdks:java:io:sparkreceiver:2:testClasses' as it has no actions.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[included builds,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 7,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 2 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is bd935769c87aca860568b4fcb585a99f
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 2'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@34.134.11.185:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 2'
Successfully started process 'Gradle Test Executor 2'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-20] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main5132246930232421495.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-xC5J0fa9F9mq0EvH5zCvM1wTR3LKWracR1uUlJ1t0Is.jar
[pool-8-thread-12] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test1438466707827170587.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-R1hWDOavCuH5kcrq70rmK4kuWZE2HtmHxFEuVbuiTXk.jar
[pool-8-thread-6] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test8117779320401657290.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-OEjTnDR_TnqYd8iFmsNzRhKJwmyovvu7eUd0k_aseBo.jar
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-nCFOzPlm5obg9XO3v8txfCvO5Zin8lX96oBC-ZfN-G4.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160953 bytes, hash b61f4b29ff2fd1751a9768aba8880cb5585a90bf473650592c535c4df3637ff3> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-th9LKf8v0XUal2irqIgMtVhakL9HNlBZLFNcTfNjf_M.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-07_19_30_07-14237071743617338351?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-07_19_30_07-14237071743617338351
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-07_19_30_07-14237071743617338351
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:10.834Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-b674. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:24.981Z: Worker configuration: e2-standard-4 in us-central1-c.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:26.885Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94593459265259 address: 94593661963241 address: 94593661942874 address: 94593661931495 address: 94593661934667 address: 94593662388559 address: 94593615506116 address: 94593623939085 address: 94593563733672 address: 140644048644057 address: 140644048074399 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 18321895414059471169 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:26.963Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:26.990Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.017Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.101Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.163Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.191Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.208Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.230Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.252Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.275Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.316Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.347Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.371Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.702Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:27.782Z: Starting 1 ****s in us-central1-c...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:28.312Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:30:47.113Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:31:07.624Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:31:40.814Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:31:42.799Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:42:41.174Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94593459265259 address: 94593661963241 address: 94593661942874 address: 94593661931495 address: 94593661934667 address: 94593662388559 address: 94593661925060 address: 94593561780581 address: 94593563733766 address: 140644048644057 address: 140644048074399 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 8748454713933826942 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-08T02:54:41.500Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94593459265259 address: 94593661963241 address: 94593661942874 address: 94593661931495 address: 94593661934667 address: 94593662388559 address: 94593661925060 address: 94593561780581 address: 94593563733766 address: 140644048644057 address: 140644048074399 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 8748454713933825985 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4890000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 2 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.022 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.028 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[included builds,5,main]) completed. Took 38 mins 34.224 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 39m 8s
145 actionable tasks: 87 executed, 56 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/dfrxruadxzpny
Stopped 1 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #428
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/428/display/redirect>
Changes:
------------------------------------------
[...truncated 353.30 KB...]
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is b73a56ab5cff6794badc2fe3ffc6cb63
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key b73a56ab5cff6794badc2fe3ffc6cb63
:sdks:java:extensions:protobuf:generateTestProto (Thread[included builds,5,main]) completed. Took 0.016 secs.
Resolve mutations for :sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 8c980e172a6e23c3021d6a0d3875db09
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 8c980e172a6e23c3021d6a0d3875db09
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.084 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.067 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[included builds,5,main]) started.
work action null (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is a1b3e9cf7f932161bd24aa216db04d35
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key a1b3e9cf7f932161bd24aa216db04d35
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.364 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 49a21ff038aae1ac52732a192af837d6
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 49a21ff038aae1ac52732a192af837d6
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.577 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.316 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[included builds,5,main]) started.
work action null (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 48a97dc458ade4f8ec0255e0f4223403
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 48a97dc458ade4f8ec0255e0f4223403
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.318 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.035 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 4,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is 550679bfdef763b376fbea1438ef5547
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@34.27.235.81:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-s3PMqysKb2Sq2Z2sevSr6COjviBZaAJklgrSOYJUecg.jar
[pool-8-thread-21] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main934009688823199471.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-8yvAY6L2Oujs1cymPBkIARnCOQm_g6mtOTQoeTQvqw8.jar
[pool-8-thread-23] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test1608971311729745722.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-I-OdUdeCd_5zqU8mwEC_6IArQpVR8oUEQhqOK3KoKGk.jar
[pool-8-thread-17] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test5381124842201261130.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-1elHWTsa5Fj3CIWfQ9iC52XwaOjpR1jruYdutIQRjiA.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160953 bytes, hash 9e7ffb3db348840effee6cc3388552a26504cc8187a1e357cf98fba496c4dd6c> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-nn_7PbNIhA7_7mzDOIVSomUEzIGHoeNXz5j7pJbE3Ww.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-07_07_32_06-6194990412722329739?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-07_07_32_06-6194990412722329739
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-07_07_32_06-6194990412722329739
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:09.891Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-i8xc. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:22.080Z: Worker configuration: e2-standard-4 in us-central1-c.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:23.600Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94615282228971 address: 94615484926953 address: 94615484906586 address: 94615484895207 address: 94615484898379 address: 94615485352271 address: 94615438469828 address: 94615446902797 address: 94615386697384 address: 140381806888921 address: 140381806319263 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 17693607438183950884 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:23.680Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:23.707Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:23.743Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:23.808Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:23.919Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:23.955Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:23.982Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:24.014Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:24.049Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:24.081Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:24.112Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:24.146Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:24.169Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:24.355Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:24.516Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:24.624Z: Starting 1 ****s in us-central1-c...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:32:25.133Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:33:03.579Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:33:36.640Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:33:39.150Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:44:36.440Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94615282228971 address: 94615484926953 address: 94615484906586 address: 94615484895207 address: 94615484898379 address: 94615485352271 address: 94615484888772 address: 94615384744293 address: 94615386697478 address: 140381806888921 address: 140381806319263 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 6694837644971494311 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T14:56:36.736Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94615282228971 address: 94615484926953 address: 94615484906586 address: 94615484895207 address: 94615484898379 address: 94615485352271 address: 94615484888772 address: 94615384744293 address: 94615386697478 address: 140381806888921 address: 140381806319263 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 6694837644971495188 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4750000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.022 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.028 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) completed. Took 40 mins 41.747 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 41m 9s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/ao7hrn5o3hzm6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #427
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/427/display/redirect>
Changes:
------------------------------------------
[...truncated 353.34 KB...]
:runners:google-cloud-dataflow-java:****:classes (Thread[included builds,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:classes (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 8c980e172a6e23c3021d6a0d3875db09
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 8c980e172a6e23c3021d6a0d3875db09
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.119 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) completed. Took 0.073 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[included builds,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is a1b3e9cf7f932161bd24aa216db04d35
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key a1b3e9cf7f932161bd24aa216db04d35
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 5,5,main]) started.
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.629 secs.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 49a21ff038aae1ac52732a192af837d6
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 49a21ff038aae1ac52732a192af837d6
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[included builds,5,main]) completed. Took 0.886 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.33 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 48a97dc458ade4f8ec0255e0f4223403
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 48a97dc458ade4f8ec0255e0f4223403
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 3,5,main]) completed. Took 0.326 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 5,5,main]) completed. Took 0.035 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 5,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 6,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is 550679bfdef763b376fbea1438ef5547
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@35.223.155.15:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-21] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test2760688824024458705.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-p0W4PnBQ550Ny9rhgShkzbKGhh-k5OZ46evLsFKA-dA.jar
[pool-8-thread-18] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test713576648107038528.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-NxvAm5-Cz8H4vNhMUBAyZ1GPPraH3aJkHEzD5zev9vk.jar
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-s3PMqysKb2Sq2Z2sevSr6COjviBZaAJklgrSOYJUecg.jar
[pool-8-thread-20] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main1604388483217958455.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-iUl_VD0cvmGI90OPnF0L9Haw2NsMsWT7_aUcT88M3z8.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160954 bytes, hash 7fc3905110960af455992aa885098eac62a9d1f9812e56a1601e53b55a101754> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-f8OQURCWCvRVmSqohQmOrGKp0fmBLlahYB5TtVoQF1Q.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-06_19_32_51-7556075758864812515?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-06_19_32_51-7556075758864812515
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-06_19_32_51-7556075758864812515
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:32:54.155Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-8nrj. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:09.022Z: Worker configuration: e2-standard-4 in us-central1-c.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:10.830Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94290183823083 address: 94290386521065 address: 94290386500698 address: 94290386489319 address: 94290386492491 address: 94290386946383 address: 94290340063940 address: 94290348496909 address: 94290288291496 address: 140546617165785 address: 140546616596127 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 7859126832460598385 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:10.899Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:10.941Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:10.970Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.038Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.101Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.130Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.158Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.191Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.214Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.247Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.281Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.315Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.341Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.682Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:11.756Z: Starting 1 ****s in us-central1-c...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:12.818Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:33:18.489Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:34:03.050Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:34:35.603Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:34:38.185Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:45:25.791Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94290183823083 address: 94290386521065 address: 94290386500698 address: 94290386489319 address: 94290386492491 address: 94290386946383 address: 94290386482884 address: 94290286338405 address: 94290288291590 address: 140546617165785 address: 140546616596127 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 6087093636737885406 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-07T02:57:25.447Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94290183823083 address: 94290386521065 address: 94290386500698 address: 94290386489319 address: 94290386492491 address: 94290386946383 address: 94290386482884 address: 94290286338405 address: 94290288291590 address: 140546617165785 address: 140546616596127 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 6087093636737887897 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4670000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
1 test completed, 1 failed
Finished generating test XML results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.029 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 5,5,main]) completed. Took 41 mins 18.915 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 41m 49s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/u2skkcrji7mvo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #426
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/426/display/redirect?page=changes>
Changes:
[noreply] Bigtable: enable batch write flow control (#26573)
------------------------------------------
[...truncated 356.21 KB...]
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) completed. Took 0.207 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[included builds,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is a1b3e9cf7f932161bd24aa216db04d35
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key a1b3e9cf7f932161bd24aa216db04d35
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) completed. Took 0.52 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 7,5,main]) started.
work action null (Thread[Execution **** Thread 7,5,main]) completed. Took 0.001 secs.
This JVM does not support getting OS memory, so no OS memory status updates will be broadcast
> Task :sdks:java:io:google-cloud-platform:compileTestJava
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 49a21ff038aae1ac52732a192af837d6
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Starting process 'Gradle Worker Daemon 1'. Working directory: /home/jenkins/.gradle/****s Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar -Xmx512m -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Worker Daemon 1'
Successfully started process 'Gradle Worker Daemon 1'
Started Gradle **** daemon (0.396 secs) with fork options DaemonForkOptions{executable=/usr/lib/jvm/java-8-openjdk-amd64/bin/java, minHeapSize=null, maxHeapSize=null, jvmArgs=[-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar], keepAliveMode=SESSION}.
Compiling with JDK Java compiler API.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Class dependency analysis for incremental compilation took 0.337 secs.
Created classpath snapshot for incremental compilation in 0.84 secs.
Stored cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 49a21ff038aae1ac52732a192af837d6
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[included builds,5,main]) completed. Took 28.382 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.323 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 48a97dc458ade4f8ec0255e0f4223403
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Class dependency analysis for incremental compilation took 0.085 secs.
Created classpath snapshot for incremental compilation in 0.383 secs.
Stored cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 48a97dc458ade4f8ec0255e0f4223403
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 3,5,main]) completed. Took 7.111 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[included builds,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.031 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 3,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 7,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 2 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is 550679bfdef763b376fbea1438ef5547
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 2'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@34.170.130.196:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 2'
Successfully started process 'Gradle Test Executor 2'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-s3PMqysKb2Sq2Z2sevSr6COjviBZaAJklgrSOYJUecg.jar
[pool-8-thread-18] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test257654525952281829.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-qtK06BFh69vMiKCt0AzussHuSNSl2ZFke3f6mP5EO7w.jar
[pool-8-thread-3] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test1907503901704076392.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-FsyOn8YWa-tI6qt60tVutJWzWllDabkxb-f1IqZr-kA.jar
[pool-8-thread-21] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main4005803006208140446.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-L3Xi1atHvRJQy_wNaZkUiyGCN21XEpz5JE2wM5Nx_Tk.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160955 bytes, hash a391c2a7b266ca65aacd43be53ad2426cefd1e960fc8d1c8b5c6a1614c8fa125> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-o5HCp7JmymWqzUO-U60kJs79HpYPyNHItcahYUyPoSU.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-06_07_32_42-13926289117028748444?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-06_07_32_42-13926289117028748444
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-06_07_32_42-13926289117028748444
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:32:45.970Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-cj3z. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:03.724Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:04.013Z: Worker configuration: e2-standard-4 in us-central1-b.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.186Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94173299056363 address: 94173501754345 address: 94173501733978 address: 94173501722599 address: 94173501725771 address: 94173502179663 address: 94173455297220 address: 94173463730189 address: 94173403524776 address: 140694132742105 address: 140694132172447 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 10536246929553858637 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.274Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.343Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.382Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.441Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.522Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.564Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.591Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.623Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.646Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.679Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.702Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.729Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:06.754Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:07.228Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:07.302Z: Starting 1 ****s in us-central1-b...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:08.387Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:33:36.211Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:34:14.203Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:34:16.986Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:45:25.099Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94173299056363 address: 94173501754345 address: 94173501733978 address: 94173501722599 address: 94173501725771 address: 94173502179663 address: 94173501716164 address: 94173401571685 address: 94173403524870 address: 140694132742105 address: 140694132172447 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 12604932126396459904 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T14:57:23.868Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94173299056363 address: 94173501754345 address: 94173501733978 address: 94173501722599 address: 94173501725771 address: 94173502179663 address: 94173501716164 address: 94173401571685 address: 94173403524870 address: 140694132742105 address: 140694132172447 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 12604932126396457085 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4770000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 2 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.044 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.053 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 3,5,main]) completed. Took 40 mins 42.212 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 41m 44s
145 actionable tasks: 88 executed, 55 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/mhnvqzt5zapjo
Stopped 1 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #425
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/425/display/redirect>
Changes:
------------------------------------------
[...truncated 354.07 KB...]
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is b73a56ab5cff6794badc2fe3ffc6cb63
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key b73a56ab5cff6794badc2fe3ffc6cb63
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** Thread 7,5,main]) completed. Took 0.018 secs.
Resolve mutations for :sdks:java:extensions:protobuf:compileTestJava (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 8c980e172a6e23c3021d6a0d3875db09
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 8c980e172a6e23c3021d6a0d3875db09
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 5,5,main]) completed. Took 0.097 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 5,5,main]) started.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) completed. Took 0.068 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[included builds,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is 343c039cdc66103c1ad62a8ad8d41a48
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key 343c039cdc66103c1ad62a8ad8d41a48
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.402 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 53cc6af09a18b599113d8cc63f40e6ed
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 53cc6af09a18b599113d8cc63f40e6ed
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[included builds,5,main]) completed. Took 0.573 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution ****,5,main]) completed. Took 0.321 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 7a40067cdac05121e75e9d6d3df29f7d
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 7a40067cdac05121e75e9d6d3df29f7d
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 3,5,main]) completed. Took 0.329 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 5,5,main]) completed. Took 0.032 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 3,5,main]) started.
work action null (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 5,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 4,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is d6e29c23b887d2760d0ad45521287a6f
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@35.232.200.225:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-s3PMqysKb2Sq2Z2sevSr6COjviBZaAJklgrSOYJUecg.jar
[pool-8-thread-20] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main6921971295131957411.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-vatSRH___4H28QN1ioKjDT1rrC3cTMfCm8sYqnlyg2M.jar
[pool-8-thread-19] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test8390924869666594174.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-oaJB3p9GFr53SALY2iljEY3L32nqd2IAk_DdxuHtTvk.jar
[pool-8-thread-3] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test6717560570492317419.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-v6kVGjXX8kvTYqGV3EAD2eBtqel1JcDmf_vbrjAGGfs.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160955 bytes, hash e5a2de0e605dc5cd1c98613ed2f7a741368e54fbd133784058b17433af3aa62b> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-5aLeDmBdxc0cmGE-0venQTaOVPvRM3hAWLF0M686pis.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-05_19_30_18-11401261642277525711?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-05_19_30_18-11401261642277525711
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-05_19_30_18-11401261642277525711
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:29.679Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-2vb5. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:45.672Z: Worker configuration: e2-standard-4 in us-central1-b.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:47.680Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94368923492075 address: 94369126190057 address: 94369126169690 address: 94369126158311 address: 94369126161483 address: 94369126615375 address: 94369079732932 address: 94369088165901 address: 94369027960488 address: 140033721448409 address: 140033720878751 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 4387604080110176623 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:47.761Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:47.799Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:47.835Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:47.889Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.008Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.046Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.072Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.095Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.135Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.189Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.222Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.290Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.322Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.699Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:48.792Z: Starting 1 ****s in us-central1-b...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:49.851Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:30:52.937Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:31:39.735Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:32:08.715Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:32:11.404Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:43:04.872Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94368923492075 address: 94369126190057 address: 94369126169690 address: 94369126158311 address: 94369126161483 address: 94369126615375 address: 94369126151876 address: 94369026007397 address: 94369027960582 address: 140033721448409 address: 140033720878751 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 6417071125008850117 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-06T02:55:04.530Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94368923492075 address: 94369126190057 address: 94369126169690 address: 94369126158311 address: 94369126161483 address: 94369126615375 address: 94369126151876 address: 94369026007397 address: 94369027960582 address: 140033721448409 address: 140033720878751 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 6417071125008849386 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4830000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.03 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.038 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 5,5,main]) completed. Took 38 mins 42.32 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 39m 10s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/ycdr3pfpkpncc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #424
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/424/display/redirect?page=changes>
Changes:
[noreply] Bump cloud.google.com/go/bigquery from 1.51.0 to 1.51.1 in /sdks
------------------------------------------
[...truncated 354.51 KB...]
> Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE
Build cache key for task ':sdks:java:extensions:protobuf:generateTestProto' is 5983d0b6661372d40ed44caa84224b5e
Task ':sdks:java:extensions:protobuf:generateTestProto' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:generateTestProto' with cache key 5983d0b6661372d40ed44caa84224b5e
:sdks:java:extensions:protobuf:generateTestProto (Thread[Execution **** Thread 4,5,main]) completed. Took 0.021 secs.
Resolve mutations for :sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:compileTestJava (Thread[included builds,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 48ed4f8c655d511b211d98137626e821
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 48ed4f8c655d511b211d98137626e821
:sdks:java:extensions:protobuf:compileTestJava (Thread[included builds,5,main]) completed. Took 0.105 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution ****,5,main]) completed. Took 0.075 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 5,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is c326bb697a40a22610b5dd29fc0768c4
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key c326bb697a40a22610b5dd29fc0768c4
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.405 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is bcb25f58701e5a53de89e49a01691a0d
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key bcb25f58701e5a53de89e49a01691a0d
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 5,5,main]) completed. Took 0.71 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 5,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.335 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution **** Thread 3,5,main]) started.
work action null (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 5,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is e6f7b30de11830f8cf8e16c2be9a04c0
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key e6f7b30de11830f8cf8e16c2be9a04c0
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.365 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.034 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 6,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is ecfd9a0dad1d672ca4405165254870e4
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@34.28.21.65:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-s3PMqysKb2Sq2Z2sevSr6COjviBZaAJklgrSOYJUecg.jar
[pool-8-thread-12] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test3995833200397809068.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-sBhtKCVtlW3uVA8nXsB0fmeseb4Wj9dJJAPd2-roxMc.jar
[pool-8-thread-20] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main3855135850734874130.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-Imw849JUCfbLMNWvlGTvCsr8bEJTyLWzbNKQyfyZl4k.jar
[pool-8-thread-7] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test2206921623893526155.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-xkfNaagOhDGfaZjJvDMbE5cNDp-5k1xD-5m_9ufBBcc.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160952 bytes, hash 832c3375bc1b2692af1c35ec584889f5b315e7c6e4d9abfb8ee68a8387c07666> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-gywzdbwbJpKvHDXsWEiJ9bMV58bk2av7juaKg4fAdmY.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-05_07_31_52-16867953061596073987?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-05_07_31_52-16867953061596073987
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-05_07_31_52-16867953061596073987
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:31:55.218Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-cocm. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:09.648Z: Worker configuration: e2-standard-4 in us-central1-f.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:11.713Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 93856746544875 address: 93856949242857 address: 93856949222490 address: 93856949211111 address: 93856949214283 address: 93856949668175 address: 93856902785732 address: 93856911218701 address: 93856851013288 address: 140458561144793 address: 140458560575135 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 8372586771145410893 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:11.782Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:11.819Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:11.847Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:11.902Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:11.970Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:12.006Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:12.034Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:12.054Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:12.078Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:12.106Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:12.141Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:12.173Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:12.199Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:12.604Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:12.710Z: Starting 1 ****s in us-central1-f...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:13.744Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:31.913Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:32:50.334Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:33:38.948Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:33:41.339Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:44:26.746Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 93856746544875 address: 93856949242857 address: 93856949222490 address: 93856949211111 address: 93856949214283 address: 93856949668175 address: 93856949204676 address: 93856849060197 address: 93856851013382 address: 140458561144793 address: 140458560575135 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 5094166394086587948 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T14:56:26.132Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 93856746544875 address: 93856949242857 address: 93856949222490 address: 93856949211111 address: 93856949214283 address: 93856949668175 address: 93856949204676 address: 93856849060197 address: 93856851013382 address: 140458561144793 address: 140458560575135 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 5094166394086585265 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4800000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.027 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.033 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) completed. Took 40 mins 18.586 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 40m 54s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/3tbue3ho6vite
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #423
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/423/display/redirect>
Changes:
------------------------------------------
[...truncated 353.55 KB...]
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 6,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:sparkreceiver:2:testClasses' as it has no actions.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 48ed4f8c655d511b211d98137626e821
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 48ed4f8c655d511b211d98137626e821
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 3,5,main]) completed. Took 0.153 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 3,5,main]) started.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.001 secs.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 5,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.092 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[included builds,5,main]) started.
work action null (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 5,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is c326bb697a40a22610b5dd29fc0768c4
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key c326bb697a40a22610b5dd29fc0768c4
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) completed. Took 0.575 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 7,5,main]) started.
work action null (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is bcb25f58701e5a53de89e49a01691a0d
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key bcb25f58701e5a53de89e49a01691a0d
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 3,5,main]) completed. Took 1.05 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 5,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.339 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is e6f7b30de11830f8cf8e16c2be9a04c0
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key e6f7b30de11830f8cf8e16c2be9a04c0
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 0.441 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 5,5,main]) completed. Took 0.035 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 2,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 6,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is ecfd9a0dad1d672ca4405165254870e4
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@34.70.209.109:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-s3PMqysKb2Sq2Z2sevSr6COjviBZaAJklgrSOYJUecg.jar
[pool-8-thread-19] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main68126217400408275.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-6Lyo02IWdZzTi3lFuual5CtRdtpzMoZdvAuz3PcKBNg.jar
[pool-8-thread-17] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test2148000103273298800.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-0a-WGfCE6A4TlTAvSv9kVrbiK1_DK0zCXDK9U2uqU8g.jar
[pool-8-thread-15] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test4059291281836876445.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-HKBYBE2TzIrELaYDRXKJIiwr8S1DM-dG5okJd0F3XkE.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 1 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160954 bytes, hash bd03c0ca65d2aaa9ae6ca5562072876835fad4d75f8f5476d22b27814b747e9a> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-vQPAymXSqqmubKVWIHKHaDX61Ndfj1R20isngUt0fpo.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-04_19_30_35-9831033192795979977?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-04_19_30_35-9831033192795979977
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-04_19_30_35-9831033192795979977
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:38.711Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-ccc0. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:56.369Z: Worker configuration: e2-standard-4 in us-central1-f.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:57.102Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.219Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94685940729547 address: 94686137568629 address: 94686137547617 address: 94686137535147 address: 94686137539467 address: 94686137993596 address: 94686087172804 address: 94686095722002 address: 94686039820574 address: 140549004179417 address: 140549003609759 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 3679893075110783348 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.295Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.334Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.351Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.393Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.446Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.467Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.490Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.532Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.555Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.576Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.600Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.632Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:58.665Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:59.030Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:30:59.095Z: Starting 1 ****s in us-central1-f...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:31:00.194Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:31:39.839Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:32:08.775Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:32:11.684Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:43:15.518Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94685940729547 address: 94686137568629 address: 94686137547617 address: 94686137535147 address: 94686137539467 address: 94686137993596 address: 94686137528804 address: 94685962061829 address: 94686039823880 address: 140549004179417 address: 140549003609759 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 13525474801609847792 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-05T02:55:14.829Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94685940729547 address: 94686137568629 address: 94686137547617 address: 94686137535147 address: 94686137539467 address: 94686137993596 address: 94686137528804 address: 94685962061829 address: 94686039823880 address: 140549004179417 address: 140549003609759 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 13525474801609850719 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4840000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.036 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.049 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 2,5,main]) completed. Took 38 mins 56.136 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 39m 35s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://ge.apache.org/s/zgbrqloddua7q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #422
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/422/display/redirect?page=changes>
Changes:
[noreply] Updating libraries bom version (#26525)
------------------------------------------
[...truncated 392.98 KB...]
Resolve mutations for :runners:google-cloud-dataflow-java:jar (Thread[included builds,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:jar
Caching disabled for task ':runners:google-cloud-dataflow-java:jar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:jar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:jar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.092 secs.
work action resolve beam-runners-google-cloud-dataflow-java.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution **** Thread 3,5,main]) started.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:compileTestJava
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.5.1/fileHashes/fileHashes.bin
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.5.1/fileHashes/resourceHashesCache.bin
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is e6f7b30de11830f8cf8e16c2be9a04c0
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:compileTestJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.5.1/fileContent/java-modules.bin
Invalidating in-memory cache of /home/jenkins/.gradle/caches/7.5.1/fileContent/annotation-processors.bin
Compiling with JDK Java compiler API.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Class dependency analysis for incremental compilation took 0.512 secs.
Created classpath snapshot for incremental compilation in 0.539 secs.
Stored cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key e6f7b30de11830f8cf8e16c2be9a04c0
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 14.923 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:compileJava
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:compileJava' is eecd76d500d8ada94aede6092af88e3e
Task ':runners:google-cloud-dataflow-java:****:compileJava' is not up-to-date because:
No history is available.
The input changes require a full rebuild for incremental task ':runners:google-cloud-dataflow-java:****:compileJava'.
Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments.
Compiling with toolchain '/usr/lib/jvm/java-8-openjdk-amd64'.
Compiling with JDK Java compiler API.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.065 secs.
> Task :runners:google-cloud-dataflow-java:****:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
Class dependency analysis for incremental compilation took 0.493 secs.
Created classpath snapshot for incremental compilation in 0.138 secs.
Stored cache entry for task ':runners:google-cloud-dataflow-java:****:compileJava' with cache key eecd76d500d8ada94aede6092af88e3e
:runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution **** Thread 3,5,main]) completed. Took 1 mins 33.757 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is c326bb697a40a22610b5dd29fc0768c4
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/original_sources_to_package',> not found
*******************
GRADLE SHADOW STATS
Total Jars: 15 (includes project)
Total Time: 3.702s [3702ms]
Average Time/Jar: 0.24680000000000002s [246.8ms]
*******************
Stored cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key c326bb697a40a22610b5dd29fc0768c4
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) completed. Took 5.621 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 3,5,main]) started.
work action null (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 2,5,main]) completed. Took 0.001 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 3,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 2,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 6 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is e1cdd57a5f921d3786ce8a58b58c12e1
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 6'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@35.222.28.158:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 6'
Successfully started process 'Gradle Test Executor 6'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-s3PMqysKb2Sq2Z2sevSr6COjviBZaAJklgrSOYJUecg.jar
[pool-8-thread-26] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test2592215780451505892.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-TQaywthQy95Ltv0d1-ap7ZkwKJsftGZeMGIjL9a7DR8.jar
[pool-8-thread-16] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test8729550403736814736.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-HzpXNKZoolFlajx3BfXVEpqIcsDf6jgUSFT5Toae4Rk.jar
[pool-8-thread-14] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main1465270654415929353.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-_QSYA8mFR3XM0L5NEz4tbP3HCqKPuD-AN-xE1jXpbIc.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 3 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160953 bytes, hash 7e6e7c96397c4b3067ddc9454dc4d2d8734bc34b2bc3b802bd72140901daf0e8> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-fm58ljl8SzBn3clFTcTS2HNLw0srw7gCvXIUCQHa8Og.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-04_09_03_08-12819880023756036261?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-04_09_03_08-12819880023756036261
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-04_09_03_08-12819880023756036261
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:14.570Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-ydau. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:28.858Z: Worker configuration: e2-standard-4 in us-central1-c.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:30.891Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94276243211979 address: 94276440051061 address: 94276440030049 address: 94276440017579 address: 94276440021899 address: 94276440476028 address: 94276389655236 address: 94276398204434 address: 94276342303006 address: 140071089784793 address: 140071089215135 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 14196934210839047501 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:30.977Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.007Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.044Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.099Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.160Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.208Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.240Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.272Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.294Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.332Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.362Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.394Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.417Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.825Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:31.899Z: Starting 1 ****s in us-central1-c...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:32.981Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:03:36.064Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:04:28.697Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:04:57.763Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:05:00.520Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:15:46.931Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94276243211979 address: 94276440051061 address: 94276440030049 address: 94276440017579 address: 94276440021899 address: 94276440476028 address: 94276440011236 address: 94276264544261 address: 94276342306312 address: 140071089784793 address: 140071089215135 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 1066305515594182770 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T16:27:46.941Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94276243211979 address: 94276440051061 address: 94276440030049 address: 94276440017579 address: 94276440021899 address: 94276440476028 address: 94276440011236 address: 94276264544261 address: 94276342306312 address: 140071089784793 address: 140071089215135 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 1066305515594185645 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4810000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 6 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.021 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.028 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 3,5,main]) completed. Took 37 mins 59.681 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 43m 1s
145 actionable tasks: 98 executed, 45 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/5dnltc44sgjs6
Stopped 5 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #421
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/421/display/redirect>
Changes:
------------------------------------------
[...truncated 353.98 KB...]
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 4,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.112 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:compileTestJava'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:compileTestJava' is 621b9d42546f284fda65504c31b90633
Task ':sdks:java:io:sparkreceiver:2:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:sparkreceiver:2:compileTestJava' with cache key 621b9d42546f284fda65504c31b90633
:sdks:java:io:sparkreceiver:2:compileTestJava (Thread[included builds,5,main]) completed. Took 0.648 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) started.
> Task :sdks:java:io:sparkreceiver:2:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:sparkreceiver:2:testClasses' as it has no actions.
:sdks:java:io:sparkreceiver:2:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is b3d616f93174fc01c20fba8d40b6c620
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key b3d616f93174fc01c20fba8d40b6c620
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.547 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 7303aaf6bc0e045820d2c73845e62ddb
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 7303aaf6bc0e045820d2c73845e62ddb
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 3,5,main]) completed. Took 1.218 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.352 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 3,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is de735e282eabb5736e536d40022c5b95
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key de735e282eabb5736e536d40022c5b95
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 3,5,main]) completed. Took 0.365 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.041 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution ****,5,main]) completed. Took 0.001 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) started.
producer locations for task group 0 (Thread[Execution ****,5,main]) started.
producer locations for task group 0 (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is 8f28f0a1b9fb168f23adcf628c9c6e97
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@34.134.230.66:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-s3PMqysKb2Sq2Z2sevSr6COjviBZaAJklgrSOYJUecg.jar
[pool-8-thread-17] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test2817980019071046720.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-3yx95NKCsShoajgzhCfEC7q4H5eQPd8BOuh1F6q5GaA.jar
[pool-8-thread-18] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test4743511177503297893.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-6Gc4KvGKXb-3VS_3fXOFBGm6Ml7ewTXuOYW7JZVfj5Q.jar
[pool-8-thread-22] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main2748238399146684203.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-BFotvL-DdicJpw2mP0uaoczbM0sDKs66nbCvZS15sDY.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160940 bytes, hash 0e3f5bc546cd83632f3d66fae714b45eb7d237aa85c82d948dadbd3151bdc174> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-Dj9bxUbNg2MvPWb65xS0XrfSN6qFyC2Uja29MVG9wXQ.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-03_19_30_13-6927678132892868339?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-03_19_30_13-6927678132892868339
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-03_19_30_13-6927678132892868339
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:16.858Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-rw8z. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:27.907Z: Worker configuration: e2-standard-4 in us-central1-b.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.478Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94434916671211 address: 94435119369193 address: 94435119348826 address: 94435119337447 address: 94435119340619 address: 94435119794511 address: 94435072912068 address: 94435081345037 address: 94435021139624 address: 139707346720729 address: 139707346151071 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 14714999614534770743 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.556Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.594Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.634Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.701Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.771Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.807Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.823Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.842Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.875Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.898Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.930Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.956Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:29.981Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:30.007Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:30.360Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:30.439Z: Starting 1 ****s in us-central1-b...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:30:30.964Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:31:10.212Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:31:41.109Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:31:43.729Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:42:43.902Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94434916671211 address: 94435119369193 address: 94435119348826 address: 94435119337447 address: 94435119340619 address: 94435119794511 address: 94435119331012 address: 94435019186533 address: 94435021139718 address: 139707346720729 address: 139707346151071 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 8119718381226447465 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-04T02:54:45.669Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94434916671211 address: 94435119369193 address: 94435119348826 address: 94435119337447 address: 94435119340619 address: 94435119794511 address: 94435119331012 address: 94435019186533 address: 94435021139718 address: 139707346720729 address: 139707346151071 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 8119718381226447628 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4910000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
1 test completed, 1 failed
Finished generating test XML results (0.022 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.028 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) completed. Took 38 mins 24.904 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 39m 1s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/qeov7guskapi4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #420
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/420/display/redirect?page=changes>
Changes:
[noreply] Use vendor guava for sdks/java/extensions/sql (#26463)
------------------------------------------
[...truncated 353.88 KB...]
> Task :runners:google-cloud-dataflow-java:****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:classes (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 2,5,main]) completed. Took 0.001 secs.
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 0056672902bbe7c083c3e4667ce4ef5d
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 0056672902bbe7c083c3e4667ce4ef5d
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.107 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 2,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) completed. Took 0.096 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution **** Thread 2,5,main]) started.
work action null (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 3,5,main]) completed. Took 0.001 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[included builds,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is b3d616f93174fc01c20fba8d40b6c620
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key b3d616f93174fc01c20fba8d40b6c620
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) completed. Took 0.43 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 7,5,main]) started.
work action null (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 7303aaf6bc0e045820d2c73845e62ddb
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 7303aaf6bc0e045820d2c73845e62ddb
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[included builds,5,main]) completed. Took 0.823 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.338 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution **** Thread 7,5,main]) started.
work action null (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[included builds,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[included builds,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is de735e282eabb5736e536d40022c5b95
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key de735e282eabb5736e536d40022c5b95
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 0.363 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.043 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 6,5,main]) started.
work action null (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 6,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is 8f28f0a1b9fb168f23adcf628c9c6e97
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@35.188.133.230:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-19] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test5212865486335179243.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-AbczCTbRuzRN0Tfe_PkD3T--7twAMGhgalHRKzdGugg.jar
[pool-8-thread-16] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main8491831571365691672.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-V4DKiWXiM6Z1WkChC9trL9Udkai1V4uGYrSIcXUepEA.jar
[pool-8-thread-18] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test6924557251235793860.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-Qbxww09ve-3aQAzGUQidyBKvhqreuzzjQZMl05dGVJM.jar
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-s3PMqysKb2Sq2Z2sevSr6COjviBZaAJklgrSOYJUecg.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160941 bytes, hash eca531e5321310f7369509cb348bc5f7a70ec22edbdfa87a8998b684b25ca36b> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-7KUx5TITEPc2lQnLNIvF96cOwi7b36h6iZi2hLJco2s.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-03_07_34_15-5319850715036188844?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-03_07_34_15-5319850715036188844
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-03_07_34_15-5319850715036188844
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:18.550Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-hiil. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:29.081Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:35.256Z: Worker configuration: e2-standard-4 in us-central1-b.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.084Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 93999543721707 address: 93999746419689 address: 93999746399322 address: 93999746387943 address: 93999746391115 address: 93999746845007 address: 93999699962564 address: 93999708395533 address: 93999648190120 address: 140002965911513 address: 140002965341855 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 863052960750703827 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.169Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.196Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.220Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.287Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.359Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.391Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.418Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.454Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.484Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.529Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.553Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.585Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:37.607Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:38.003Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:38.079Z: Starting 1 ****s in us-central1-b...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:34:39.111Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:35:18.023Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:35:47.585Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:35:49.648Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:46:53.958Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 93999543721707 address: 93999746419689 address: 93999746399322 address: 93999746387943 address: 93999746391115 address: 93999746845007 address: 93999746381508 address: 93999646237029 address: 93999648190214 address: 140002965911513 address: 140002965341855 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 1915944628069212525 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.sdk.metrics.MetricsEnvironment - Reporting metrics are not supported in the current execution environment.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T14:58:52.665Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 93999543721707 address: 93999746419689 address: 93999746399322 address: 93999746387943 address: 93999746391115 address: 93999746845007 address: 93999746381508 address: 93999646237029 address: 93999648190214 address: 140002965911513 address: 140002965341855 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 1915944628069215402 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4760000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
1 test completed, 1 failed
Finished generating test XML results (0.051 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.057 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) completed. Took 41 mins 15.795 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 41m 55s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/6snen753ybbwi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #419
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/419/display/redirect>
Changes:
------------------------------------------
[...truncated 353.33 KB...]
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 6,5,main]) started.
> Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:extensions:protobuf:compileTestJava'.
Build cache key for task ':sdks:java:extensions:protobuf:compileTestJava' is 0056672902bbe7c083c3e4667ce4ef5d
Task ':sdks:java:extensions:protobuf:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:extensions:protobuf:compileTestJava' with cache key 0056672902bbe7c083c3e4667ce4ef5d
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 5,5,main]) completed. Took 0.101 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testClasses (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) started.
:sdks:java:extensions:protobuf:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 5,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution ****,5,main]) started.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 5,5,main]) completed. Took 0.074 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[included builds,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is b3d616f93174fc01c20fba8d40b6c620
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key b3d616f93174fc01c20fba8d40b6c620
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.407 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 4,5,main]) started.
work action null (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution **** Thread 5,5,main]) started.
work action null (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 7303aaf6bc0e045820d2c73845e62ddb
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 7303aaf6bc0e045820d2c73845e62ddb
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[included builds,5,main]) completed. Took 0.666 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[included builds,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[included builds,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 7,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.325 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution **** Thread 3,5,main]) started.
work action null (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[included builds,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[included builds,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is de735e282eabb5736e536d40022c5b95
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key de735e282eabb5736e536d40022c5b95
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.351 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.032 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 3,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is 8f28f0a1b9fb168f23adcf628c9c6e97
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@34.28.109.56:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-s3PMqysKb2Sq2Z2sevSr6COjviBZaAJklgrSOYJUecg.jar
[pool-8-thread-18] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main6887795244080156192.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-HOKh1gIPN_lTJGTOPRXcN9Pob08EzDT6saKJc5Mso1I.jar
[pool-8-thread-7] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test3076521443132873139.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-0L1qsdWPpt2eYnwb_Cr4BzFvykx_x-PslHZ475oaRuk.jar
[pool-8-thread-16] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test1154098286260658491.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-tZuyI-dxmleJ-fWlqGiOXk8NAR529Z3QkUag8ChbaIs.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160939 bytes, hash a276f5f691f6d13200930838440ad71c5ace3c6fd3e14c2afc11aa8f94a8f9a3> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-onb19pH20TIAkwg4RArXHFrOPG_T4Uwq_BGqj5So-aM.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-02_19_31_45-2981205873148086106?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-02_19_31_45-2981205873148086106
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-02_19_31_45-2981205873148086106
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:31:50.458Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-47a0. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:06.002Z: Worker configuration: e2-standard-4 in us-central1-c.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:07.926Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94380742198987 address: 94380939038069 address: 94380939017057 address: 94380939004587 address: 94380939008907 address: 94380939463036 address: 94380888642244 address: 94380897191442 address: 94380841290014 address: 140418249656281 address: 140418249086623 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 11123433568749030850 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.007Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.039Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.058Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.111Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.186Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.218Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.252Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.289Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.327Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.356Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.377Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.399Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:08.428Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:09.169Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:09.227Z: Starting 1 ****s in us-central1-c...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:10.040Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:11.424Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:32:51.248Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:33:21.414Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:33:24.219Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:44:23.555Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94380742198987 address: 94380939038069 address: 94380939017057 address: 94380939004587 address: 94380939008907 address: 94380939463036 address: 94380938998244 address: 94380763531269 address: 94380841293320 address: 140418249656281 address: 140418249086623 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 5312521319314222888 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-03T02:56:23.227Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94380742198987 address: 94380939038069 address: 94380939017057 address: 94380939004587 address: 94380939008907 address: 94380939463036 address: 94380938998244 address: 94380763531269 address: 94380841293320 address: 140418249656281 address: 140418249086623 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 5312521319314221145 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4750000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
1 test completed, 1 failed
Finished generating test XML results (0.021 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 7,5,main]) completed. Took 40 mins 26.42 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 40m 57s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/pcgxh4qli3lxi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_SparkReceiver_IO #418
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/418/display/redirect?page=changes>
Changes:
[noreply] [Playground] Make fields "categories" and "context_line" optional in
------------------------------------------
[...truncated 353.73 KB...]
:sdks:java:extensions:protobuf:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 0.11 secs.
> Task :sdks:java:extensions:protobuf:testClasses
Skipping task ':sdks:java:extensions:protobuf:testClasses' as it has no actions.
:sdks:java:extensions:protobuf:testClasses (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:compileJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:compileJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:compileJava' is 3c52cb6cf8dceffbfe157dd3d7a73cf1
Task ':runners:google-cloud-dataflow-java:****:compileJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:compileJava' with cache key 3c52cb6cf8dceffbfe157dd3d7a73cf1
:runners:google-cloud-dataflow-java:****:compileJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.455 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution ****,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:classes (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 7,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:classes
Skipping task ':runners:google-cloud-dataflow-java:****:classes' as it has no actions.
:runners:google-cloud-dataflow-java:****:classes (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) started.
> Task :sdks:java:extensions:protobuf:testJar
Caching disabled for task ':sdks:java:extensions:protobuf:testJar' because:
Not worth caching
Task ':sdks:java:extensions:protobuf:testJar' is not up-to-date because:
No history is available.
:sdks:java:extensions:protobuf:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.074 secs.
work action resolve beam-sdks-java-extensions-protobuf-tests.jar (project :sdks:java:extensions:protobuf) (Thread[included builds,5,main]) started.
work action null (Thread[included builds,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:****:shadowJar FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:shadowJar'.
Build cache key for task ':runners:google-cloud-dataflow-java:****:shadowJar' is 3a0ec095ffa37e617ee4c1744ae1e0f2
Task ':runners:google-cloud-dataflow-java:****:shadowJar' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:shadowJar' with cache key 3a0ec095ffa37e617ee4c1744ae1e0f2
:runners:google-cloud-dataflow-java:****:shadowJar (Thread[Execution ****,5,main]) completed. Took 0.451 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
work action resolve beam-runners-google-cloud-dataflow-java-legacy-****.jar (project :runners:google-cloud-dataflow-java:****) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Custom actions are attached to task ':sdks:java:io:google-cloud-platform:compileTestJava'.
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava' is 6ed849100e375aa0da198381724e71d2
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':sdks:java:io:google-cloud-platform:compileTestJava' with cache key 6ed849100e375aa0da198381724e71d2
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution **** Thread 6,5,main]) completed. Took 0.927 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testClasses (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution ****,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because:
Not worth caching
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** Thread 3,5,main]) completed. Took 0.323 secs.
work action resolve beam-sdks-java-io-google-cloud-platform-tests.jar (project :sdks:java:io:google-cloud-platform) (Thread[Execution ****,5,main]) started.
work action null (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'.
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is d038216814ef34e71c916d2b552d5c28
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because:
No history is available.
Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key d038216814ef34e71c916d2b552d5c28
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution ****,5,main]) completed. Took 0.338 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 2,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because:
Not worth caching
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found
:runners:google-cloud-dataflow-java:testJar (Thread[Execution ****,5,main]) completed. Took 0.034 secs.
work action resolve beam-runners-google-cloud-dataflow-java-tests.jar (project :runners:google-cloud-dataflow-java) (Thread[Execution **** Thread 7,5,main]) started.
work action null (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution ****,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 6,5,main]) started.
producer locations for task group 0 (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
Custom actions are attached to task ':sdks:java:io:sparkreceiver:2:integrationTest'.
Build cache key for task ':sdks:java:io:sparkreceiver:2:integrationTest' is 317c2597bbf5b094c14a742d8f011f69
Task ':sdks:java:io:sparkreceiver:2:integrationTest' is not up-to-date because:
Task.upToDateWhen is false.
Starting process 'Gradle Test Executor 1'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--sourceOptions={\"numRecords\":\"5000000\",\"keySizeBytes\":\"1\",\"valueSizeBytes\":\"90\"}","--bigQueryDataset=beam_performance","--bigQueryTable=sparkreceiverioit_results","--influxMeasurement=sparkreceiverioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--rabbitMqBootstrapServerAddress=amqp://guest:guest@35.222.226.137:5672","--streamName=rabbitMqTestStream","--readTimeout=1800","--numWorkers=1","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar","--region=us-central1"]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.internal.****.tmpdir=<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/tmp/integrationTest/work> -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/7.5.1/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 1'
Successfully started process 'Gradle Test Executor 1'
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-simple/1.7.30/e606eac955f55ecf1d8edcccba04eb8ac98088dd/slf4j-simple-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/runners/google-cloud-dataflow-java/****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory]
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset STANDARD_ERROR
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT - 5000000 records were successfully written to RabbitMQ
[Test ****] INFO org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIO - ReadFromSparkReceiverWithOffsetDoFn started reading
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowRunner - Prefer --sdkContainerImage over deprecated legacy option --****HarnessContainerImage.
[Test ****] INFO org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory - No tempLocation specified, attempting to use default bucket: dataflow-staging-us-central1-844138762903
[Test ****] WARN org.apache.beam.sdk.extensions.gcp.util.RetryHttpRequestInitializer - Request failed with code 409, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://storage.googleapis.com/storage/v1/b?predefinedAcl=projectPrivate&predefinedDefaultObjectAcl=projectPrivate&project=apache-beam-testing.
[Test ****] INFO org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory - No stagingLocation provided, falling back to gcpTempLocation
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 427 files. Enable logging at DEBUG level to see which files will be staged.
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading 428 files from PipelineOptions.filesToStage to staging location to prepare for execution.
[pool-8-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging custom dataflow-****.jar as beam-runners-google-cloud-dataflow-java-legacy-****-2.48.0-SNAPSHOT-8PlDRrtDuaU45Vm31wjH7MQknWuljheUNWMuEMUqr78.jar
[pool-8-thread-19] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/main9097383307159592766.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/main-TLKvtANRAFDZAXEFzDTd-u8x2-7jSvDgNEtLYzjFg_w.jar
[pool-8-thread-17] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test8906217511641172906.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-rErSpxS0yoVDPg-t0pPNpE-12iUGwgpSYFVVIF89hDw.jar
[pool-8-thread-8] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading /tmp/test6942824789001491037.zip to gs://dataflow-staging-us-central1-844138762903/temp/staging/test-CgMI5fK-qXBgdUlD2QqaryhYKa_i3QCd7Eo8CyZK5Yc.jar
[Test ****] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Staging files complete: 425 files cached, 3 files newly uploaded in 2 seconds
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Staging portable pipeline proto to gs://dataflow-staging-us-central1-844138762903/temp/staging/
[pool-15-thread-1] INFO org.apache.beam.runners.dataflow.util.PackageUtil - Uploading <160941 bytes, hash a61165fe23a3e8bc0865714325a42c7bb0372581b0527e8f93371dc429a7a1cc> to gs://dataflow-staging-us-central1-844138762903/temp/staging/pipeline-phFl_iOj6LwIZXFDJaQse7A3JYGwUn6PkzcdxCmnocw.pb
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse as step s1
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction as step s2
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction as step s3
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows as step s4
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map as step s5
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/ProcessKeyedElements as step s6
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Measure read time as step s7
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowPipelineTranslator - Adding Counting element as step s8
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Dataflow SDK version: 2.48.0-SNAPSHOT
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-05-02_07_33_28-4558228771193536976?project=apache-beam-testing
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - Submitted job: 2023-05-02_07_33_28-4558228771193536976
[Test ****] INFO org.apache.beam.runners.dataflow.DataflowRunner - To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-05-02_07_33_28-4558228771193536976
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:36.460Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: sparkreceiverioit0testsparkreceiverioreadsinstreamingwitho-dxcc. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:51.021Z: Worker configuration: e2-standard-4 in us-central1-f.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:52.933Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94773081589451 address: 94773278428533 address: 94773278407521 address: 94773278395051 address: 94773278399371 address: 94773278853500 address: 94773228032708 address: 94773236581906 address: 94773180680478 address: 140496873957337 address: 140496873387679 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 14162911436194826093 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:52.996Z: Expanding CoGroupByKey operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.037Z: Expanding SplittableProcessKeyed operations into optimizable parts.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.068Z: Expanding GroupByKey operations into streaming Read/Write steps
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.132Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.204Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.237Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.262Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.284Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.319Z: Fusing consumer Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.349Z: Fusing consumer s6/GroupByKeyRaw/WriteStream into Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.381Z: Fusing consumer s6/SplittableProcess into s6/GroupByKeyRaw/ReadStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.415Z: Fusing consumer Measure read time into s6/SplittableProcess
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:33:53.437Z: Fusing consumer Counting element into Measure read time
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:34:03.833Z: Executing operation s6/GroupByKeyRaw/ReadStream+s6/SplittableProcess+Measure read time+Counting element
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:34:03.911Z: Starting 1 ****s in us-central1-f...
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:34:04.973Z: Executing operation Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/Impulse+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Pair with initial restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Split restriction+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Explode windows+Read from unbounded RabbitMq/SparkReceiverIO.ReadFromSparkReceiverViaSdf/ParDo(ReadFromSparkReceiverWithOffset)/ParMultiDo(ReadFromSparkReceiverWithOffset)/Assign unique key/AddKeys/Map+s6/GroupByKeyRaw/WriteStream
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:34:07.508Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:34:56.931Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:37:54.901Z: Workers have started successfully.
[Test ****] INFO org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:37:56.910Z: All ****s have finished the startup processes and began to receive work requests.
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:46:14.299Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94773081589451 address: 94773278428533 address: 94773278407521 address: 94773278395051 address: 94773278399371 address: 94773278853500 address: 94773278388708 address: 94773102921733 address: 94773180683784 address: 140496873957337 address: 140496873387679 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 5954613187309250024 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler - 2023-05-02T14:58:13.445Z: Querying the configuration of Pub/Sub subscription _starting_signal/ failed. If the ack deadline on the subscription has been changed from the default value, this may affect performance. Also, this prevents Dataflow from checking for unsupported settings on the subscription. See https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#accessing_pubsub for further details. If the error is not correctable, the job may be updated with a valid Pub/Sub configuration. Specific error: INVALID_ARGUMENT: [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.StackTraceProto] { stack_top_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } address: 94773081589451 address: 94773278428533 address: 94773278407521 address: 94773278395051 address: 94773278399371 address: 94773278853500 address: 94773278388708 address: 94773102921733 address: 94773180683784 address: 140496873957337 address: 140496873387679 } [dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax_extensions/workflow/cloud/service/pubsub_subscription_util.cc" line: 592 } } } [dist_proc.dax.MessageCode] { argument { string_val: "_starting_signal/" key: "subscription_name" } argument { string_val: "Invalid resource name given (name=_starting_signal/). Refer to https://cloud.google.com/pubsub/docs/admin#resource_names for more information." key: "error" } origin_id: 5954613187309248813 [dist_proc.dax.pubsub_resource_message_ext]: GETTING_PUBSUB_SUBSCRIPTION_FAILED }']
[Test ****] WARN org.apache.beam.runners.dataflow.DataflowPipelineJob - No terminal state was returned within allotted timeout. State value RUNNING
org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT > testSparkReceiverIOReadsInStreamingWithOffset FAILED
java.lang.AssertionError: expected:<5000000> but was:<4190000>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.beam.sdk.io.sparkreceiver.SparkReceiverIOIT.testSparkReceiverIOReadsInStreamingWithOffset(SparkReceiverIOIT.java:337)
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:sparkreceiver:2:integrationTest
1 test completed, 1 failed
Finished generating test XML results (0.024 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.032 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest>
> Task :sdks:java:io:sparkreceiver:2:integrationTest FAILED
:sdks:java:io:sparkreceiver:2:integrationTest (Thread[Execution ****,5,main]) completed. Took 42 mins 13.073 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:sparkreceiver:2:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_SparkReceiver_IO/ws/src/sdks/java/io/sparkreceiver/2/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 42m 43s
145 actionable tasks: 86 executed, 57 from cache, 2 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/vd75zumvpuyiw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org