You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/01/07 13:16:42 UTC
Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #3531
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3531/display/redirect?page=changes>
Changes:
[samuelw] Modify windmill DirectStreamObserver to call isReady only every 10
[noreply] [#21384] Add unit tests to the sql package (#24811)
------------------------------------------
[...truncated 920.78 KB...]
Jan 07, 2023 12:51:33 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka version: 2.4.1
Jan 07, 2023 12:51:33 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 07, 2023 12:51:33 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673095893996
Jan 07, 2023 12:51:34 PM org.apache.kafka.clients.Metadata update
INFO: [Consumer clientId=consumer-1, groupId=null] Cluster ID: VWLNFPUyRty4r3POQ4mXRQ
Jan 07, 2023 12:51:34 PM org.apache.beam.sdk.io.kafka.KafkaUnboundedSource split
INFO: Partitions assigned to split 0 (total 1): beam-sdf-0
Jan 07, 2023 12:51:34 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Read(KafkaUnboundedSource)/StripIds as step s2
Jan 07, 2023 12:51:34 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Measure read time as step s3
Jan 07, 2023 12:51:34 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Map records to strings/Map as step s4
Jan 07, 2023 12:51:34 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Counting element as step s5
Jan 07, 2023 12:51:34 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.45.0-SNAPSHOT
Jan 07, 2023 12:51:34 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-01-07_04_51_34-2314933504835324705?project=apache-beam-testing
Jan 07, 2023 12:51:34 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-01-07_04_51_34-2314933504835324705
Jan 07, 2023 12:51:34 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-01-07_04_51_34-2314933504835324705
Jan 07, 2023 12:51:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-01-07T12:51:39.611Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: kafkaioit0testkafkaioreadsandwritescorrectlyinstreaming-je-hyc8. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:51.099Z: Worker configuration: e2-standard-2 in us-central1-f.
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:52.699Z: Expanding SplittableParDo operations into optimizable parts.
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:52.747Z: Expanding CollectionToSingleton operations into optimizable parts.
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:52.806Z: Expanding CoGroupByKey operations into optimizable parts.
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:52.841Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:52.863Z: Expanding GroupByKey operations into streaming Read/Write steps
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:52.901Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:52.981Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:53.020Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Impulse
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:53.042Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor)
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:53.062Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/SplitWithSizing into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:53.149Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous) into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/ProcessElementAndRestrictionWithSizing
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:53.175Z: Fusing consumer Measure read time/ParMultiDo(TimeMonitor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous)
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:53.207Z: Fusing consumer Map records to strings/Map/ParMultiDo(Anonymous) into Measure read time/ParMultiDo(TimeMonitor)
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:53.235Z: Fusing consumer Counting element/ParMultiDo(Counting) into Map records to strings/Map/ParMultiDo(Anonymous)
Jan 07, 2023 12:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:53.331Z: Running job using Streaming Engine
Jan 07, 2023 12:51:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:54.619Z: Starting 5 ****s in us-central1-f...
Jan 07, 2023 12:51:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:51:55.597Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 07, 2023 12:52:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:52:38.903Z: Autoscaling: Raised the number of ****s to 2 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 07, 2023 12:52:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:52:38.938Z: Autoscaling: Resized **** pool to 2, though goal was 5. This could be a quota issue.
Jan 07, 2023 12:52:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:52:48.725Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 07, 2023 12:53:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:53:39.569Z: Workers have started successfully.
Jan 07, 2023 12:53:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-07T12:53:40.910Z: All ****s have finished the startup processes and began to receive work requests.
Jan 07, 2023 1:16:35 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
Jan 07, 2023 1:16:35 PM org.apache.kafka.common.config.AbstractConfig logAll
INFO: AdminClientConfig values:
bootstrap.servers = [34.28.102.76:32404, 34.172.64.33:32405, 34.134.85.255:32406]
client.dns.lookup = default
client.id =
connections.max.idle.ms = 300000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 120000
retries = 5
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
Jan 07, 2023 1:16:35 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka version: 2.4.1
Jan 07, 2023 1:16:35 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 07, 2023 1:16:35 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673097395128
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:kafka:integrationTest FAILED
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED
java.lang.AssertionError: actual number of records 29984071 smaller than expected: 100000000.
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:224)
1 test completed, 1 failed
Finished generating test XML results (0.027 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.033 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
:sdks:java:io:kafka:integrationTest (Thread[Execution **** Thread 6,5,main]) completed. Took 42 mins 44.344 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 7,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 4,5,main]) started.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because:
Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230107123259
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230107123259
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a519032b30416a4cc9f257673b899f8f1a749541dbcab89c3d4e245f95995322
Deleted: sha256:47e5ea810fd6f1781c5e0550bcda8d0251153695d3d1f8f55ef54259622b6fe9
Deleted: sha256:c59a2535217b9ed2e724636f4bf7ef0315399dd04bdfa6d2257dae4f8a3590bf
Deleted: sha256:dcb44fb6fe198278420fcbe20abafc8ce02f4ad0b2141d909e4728ebc1a2c88e
Deleted: sha256:77c9a9392050b76f8de37064347fb8ceb0eb1cab6c2212c1d1352e4168b51b4d
Deleted: sha256:7daad5404d67590834e556b3770cf2a07a94973ead75f410dae25fe4249d0c60
Deleted: sha256:10b7ebbaa9375b79660e6d48b612dbeef0fb44cf2b4cb50566665642221effa9
Deleted: sha256:be2377513a8317028542a13669dbdef2aecd92af67659aad4f2397662b3c3434
Deleted: sha256:0034676dfe78b8f6186aab38907c7cb37bdfda069b3102bc71ec402ee9232ee7
Deleted: sha256:2bf9082732495524d68a59ca92d9b9e26211d88e3f3dd4aed7cf99db1cae2aff
Deleted: sha256:e90d75711c19dfdbb3fab3dcd42d0db3e055a29edf8a1e59f4d69cd3b43c92f5
Deleted: sha256:45c586c078d9336b72bb78dc062dc4f889a4f6e3d2987db4dcfc25b08cbc2091
Deleted: sha256:811da6c50f440f1a8fb072bbc35f9a817d076b38575df0ae9bb548c4f4dc8330
Deleted: sha256:e093023587c3826747dafd64e4e12471a17bb834a3e4517ec1d26df6e591e75b
Deleted: sha256:be82e66c3e36efd64369393b2ea87d04bb38f05ea2c65b4435e8d01d71be5527
Deleted: sha256:ea4431bce9cbda4e4a335fbc4cc20a18ed2c5d85f85ea170623060b9b6aa11bf
Deleted: sha256:16d3b22aad7e4cdc4dd418299ecf8c703c926c9a7259918b018d4dc5bc8ed774
Deleted: sha256:a478ecd1201a9d04d2671002c6d8971b1c48d066980fd7f83067fa91d9ca8016
Deleted: sha256:921d779d4b0982e8195d60a9b719f9f0140e324554ac1c86da4e9407c430e02a
Deleted: sha256:a22e9a9524a12c0ba15a4b0df4092a158a527a03d79dacb6352daf604b75e5c0
Deleted: sha256:756b6308728a627312c4a7b026a91cfd799da4533d1e13764ffe6b0f4679697c
Deleted: sha256:1e0a39a48c9af63d8162e16e6c9aca6b1fb710943fcbcd5c97626d71709c2423
Deleted: sha256:28b2465cbb431d89c4fbd301ca2040012590074b2cd6b460c5a6de877b20e38e
Deleted: sha256:523cd8c18949a0bb88cf7856ee9b340c7fe8bb9426734240da278b3cdf8886e0
Deleted: sha256:0f197f38d3f760ecb1394d76babf14b9df07f85537cf78f8983f2d56cda3db58
Deleted: sha256:8e9f2c5277de277c8b40f9e28643d25b9c37307c5c00a1b3b4c6f69b7557e278
Deleted: sha256:c6cb4220dfd4dfe305919e048625e195ed9900e4d0c7d7c764182df4c2b31f6f
Deleted: sha256:df774217013631fe22626a78cee858fbbe5282b13465a413183f07ccf439a1d1
Deleted: sha256:3fdb955105fec4eacb7a897d8938287d5f5db4a920ab2d78cbfc0550740b7a46
Deleted: sha256:108b87246264a75547bb97ff0813b1ab12f50554366d896f72c13f9367fba439
Deleted: sha256:2e82bfd7de61cf66a999a031dd336bc52ae2e232357020bbdd528bedefcf981a
Deleted: sha256:70d0d7c7fa9fbaac52f4781c073a26b268f81b6f80a405b37e10971ec177270a
Deleted: sha256:545174b06c81707aae59aafd2acdd6b5c2ada65da11d46210b2bfa8a851d0d03
Deleted: sha256:71de6be1976cb889af4cfb5b26883457d3c1f95f30ce67111d089fb94a8c3f4a
Deleted: sha256:8d9a9090370735e95c339417341a33a068a9b11c55d2ebdb589480f1d708ce9a
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230107123259
Successfully started process 'command 'gcloud''
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230107123259]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a519032b30416a4cc9f257673b899f8f1a749541dbcab89c3d4e245f95995322]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230107123259] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a519032b30416a4cc9f257673b899f8f1a749541dbcab89c3d4e245f95995322])].
Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java
Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh''
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a519032b30416a4cc9f257673b899f8f1a749541dbcab89c3d4e245f95995322
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a519032b30416a4cc9f257673b899f8f1a749541dbcab89c3d4e245f95995322
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a519032b30416a4cc9f257673b899f8f1a749541dbcab89c3d4e245f95995322].
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 4,5,main]) completed. Took 4.658 secs.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:kafka:cleanUp
Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 43m 56s
157 actionable tasks: 98 executed, 55 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/v54qcvz3ed54u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PerformanceTests_Kafka_IO #3538
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3538/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #3537
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3537/display/redirect>
Changes:
------------------------------------------
[...truncated 928.18 KB...]
INFO: Kafka startTimeMs: 1673355163687
Jan 10, 2023 12:52:44 PM org.apache.kafka.clients.Metadata update
INFO: [Consumer clientId=consumer-1, groupId=null] Cluster ID: 2l3Ru8SZSJiqnmCixKELmg
Jan 10, 2023 12:52:44 PM org.apache.beam.sdk.io.kafka.KafkaUnboundedSource split
INFO: Partitions assigned to split 0 (total 1): beam-sdf-0
Jan 10, 2023 12:52:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Read(KafkaUnboundedSource)/StripIds as step s2
Jan 10, 2023 12:52:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Measure read time as step s3
Jan 10, 2023 12:52:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Map records to strings/Map as step s4
Jan 10, 2023 12:52:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Counting element as step s5
Jan 10, 2023 12:52:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.45.0-SNAPSHOT
Jan 10, 2023 12:52:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-01-10_04_52_44-1942865625766760611?project=apache-beam-testing
Jan 10, 2023 12:52:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-01-10_04_52_44-1942865625766760611
Jan 10, 2023 12:52:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-01-10_04_52_44-1942865625766760611
Jan 10, 2023 12:54:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-01-10T12:54:24.804Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: kafkaioit0testkafkaioreadsandwritescorrectlyinstreaming-je-2bfj. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:42.623Z: Worker configuration: e2-standard-2 in us-central1-f.
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:48.986Z: Expanding SplittableParDo operations into optimizable parts.
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.152Z: Expanding CollectionToSingleton operations into optimizable parts.
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.231Z: Expanding CoGroupByKey operations into optimizable parts.
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.264Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.285Z: Expanding GroupByKey operations into streaming Read/Write steps
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.329Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.386Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.426Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Impulse
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.453Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor)
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.479Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/SplitWithSizing into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.509Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous) into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/ProcessElementAndRestrictionWithSizing
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.534Z: Fusing consumer Measure read time/ParMultiDo(TimeMonitor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous)
Jan 10, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.569Z: Fusing consumer Map records to strings/Map/ParMultiDo(Anonymous) into Measure read time/ParMultiDo(TimeMonitor)
Jan 10, 2023 12:54:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.604Z: Fusing consumer Counting element/ParMultiDo(Counting) into Map records to strings/Map/ParMultiDo(Anonymous)
Jan 10, 2023 12:54:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:49.712Z: Running job using Streaming Engine
Jan 10, 2023 12:54:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:51.025Z: Starting 5 ****s in us-central1-f...
Jan 10, 2023 12:54:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:54:54.762Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 10, 2023 12:55:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:55:26.237Z: Autoscaling: Raised the number of ****s to 3 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2023 12:55:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:55:26.265Z: Autoscaling: Resized **** pool to 3, though goal was 5. This could be a quota issue.
Jan 10, 2023 12:55:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:55:35.550Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2023 12:56:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:56:39.068Z: All ****s have finished the startup processes and began to receive work requests.
Jan 10, 2023 12:56:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T12:56:41.952Z: Workers have started successfully.
Jan 10, 2023 1:17:44 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
Jan 10, 2023 1:17:44 PM org.apache.kafka.common.config.AbstractConfig logAll
INFO: AdminClientConfig values:
bootstrap.servers = [35.232.238.97:32404, 34.173.135.147:32405, 34.133.21.88:32406]
client.dns.lookup = default
client.id =
connections.max.idle.ms = 300000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 120000
retries = 5
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
Jan 10, 2023 1:17:44 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka version: 2.4.1
Jan 10, 2023 1:17:44 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 10, 2023 1:17:44 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673356664854
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:kafka:integrationTest FAILED
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED
java.lang.AssertionError: actual number of records 22690636 smaller than expected: 100000000.
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:225)
1 test completed, 1 failed
Finished generating test XML results (0.023 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
:sdks:java:io:kafka:integrationTest (Thread[Execution **** Thread 6,5,main]) completed. Took 43 mins 29.321 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution ****,5,main]) started.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because:
Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230110123309
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230110123309
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5d42024f67126ca143474d7fffdf9234ab22d0f4512260fdc7a5223b737f14ed
Deleted: sha256:5a2309ad26be1e600aa7ac41aad9b32b3cf040c3150c5d2f7efe6876f18837b0
Deleted: sha256:c1f7e45f21567676c28021dcf05d7d504594096386229894a70d3f7ca978cc28
Deleted: sha256:89461180684fb2092014d07689d0a7a014da9d6f04999ddd3fb09ebe64abe651
Deleted: sha256:5a747331c8d23544fa32802f810b69c8b30d78f0241f8895501f400f964a9310
Deleted: sha256:559dfffaa52bb5ec6d61813fd5b536e3eafd891becbe96c7fa42685c93f648b2
Deleted: sha256:3fbe90781390b28e40063ce2dec45530139ef90059b9a03e02dcdd82c4925cc9
Deleted: sha256:71e8289231cf28fee6e41843a34d3ecbec0a7ccb52f0fdff7205a6177b31904e
Deleted: sha256:aba117ab3becf42d80dfc0c21864fa4e2ba932d5220b602182de1da858c84ebc
Deleted: sha256:3aa5a13a2fb53992b5049dc05e8c532da44886364926f8d660155776f1a015e5
Deleted: sha256:40a307c2cf602941d15fa082321959df4d8e6467ed71b03081c235c86857fe13
Deleted: sha256:463d9023a80b1fef591d06c06dd8f95ea72f2c8922295ac6832cf8029f72bdc5
Deleted: sha256:40e6b997c07950407cf00a80d95c0180a4fbb8256b6ba6c0dc1fea8ad7a052e8
Deleted: sha256:2eeb04d24efc68ceb20020dea2aff6076508b1d7fe48d9617658f9dc48f0af49
Deleted: sha256:6b95aa670cb256c97de59c5f64a8959ad63452a75d58221bef1d0fd38f96c403
Deleted: sha256:14253b5029e76bbfac3edefd5c411d13d2e800d54c2957540d04eb6c0f3b6fc5
Deleted: sha256:d8524ca4c8d08ad66157df10a5a49198a1586bf674574d74a22d4bf020f25399
Deleted: sha256:e35243fb9814c6c08ba1129fb5d6b513f55cd196e0329c433111dee27401dc5c
Deleted: sha256:277a70b14205cc7cce5a167466601761adc4464bb7f5e38082dba3d8101272fa
Deleted: sha256:2c12e8889244fbb57f4c668da6b90193d965110e662cadf82781a7a1d2f2b870
Deleted: sha256:a0e8cbd2aba71583a420bda376b56025d332fefaecda30ccffe27ace1b1a22b3
Deleted: sha256:4245fdb289a7304c52ad35a1e9650007acac0fcc2822673f187b4daedac88dbb
Deleted: sha256:44fa1963909a1448ce651c8886b4ad12f269de3de51299045b6e680051c4b6a4
Deleted: sha256:80e065b4777d00e836bc33388aad3f47acb435eda8d4f409e31f113bc6a7140b
Deleted: sha256:9d93293086547cfd6309897d499162a1af607912070f94a823e0634228e35e1d
Deleted: sha256:2fb2187cc13915a79c08e88485f996fcd2ac6a84108ca542b82331816ec43892
Deleted: sha256:f2818f5050cd24601d8326195eb00f0b8cdd546fda86ab5e35a9f91d51491ecf
Deleted: sha256:365c72684672888d03e832b555af1783a62ab6f41ecf9965fdd8b828be4ce1df
Deleted: sha256:68d70a3603722125e6f4f1787376213838dbc80932489fb4439d3bf8d3d22a08
Deleted: sha256:f83181631dcf322579a67a337202bfe7c958f644570fbd02aa4a8bfc156e2c27
Deleted: sha256:dfec2663a6298331ea86fdb038d1cff0a983472f4abb361991392cecfacc1056
Deleted: sha256:e6f0bd9c22f0f76d5c559b24288b3496736eeeb7121ae72067bb7f92bb9d8629
Deleted: sha256:00c87c14438a3d80a2d4a46c9dbeccefba7127f4b97efc78d894c3c5f24338a8
Deleted: sha256:ddf765e99185a865f71224383e490e17a4555c7e3b6c23fbe814e8b36cb81b41
Deleted: sha256:0bfe1a87c41a7a1932ed372e53bfa4d8187d3eddc9edf19ef99e4ca0e83652ff
Deleted: sha256:d0c277e41f2fc043e7f6c713a4f38c9d9521cea5579e911efc208ebf54db8304
Deleted: sha256:c94dc4f8e7853ca9a8989bc75818a2b4d0d057fe0b51437dcd819e2be4c7484e
Deleted: sha256:02315170af3c3ed65ecd895c4f615ac9f629dbc0703294f86ccdb6d6b6b7684a
Deleted: sha256:cfafbd271a87da639ae13e9d9b7749cd6763f97d8ec8382f9f81d7309ade07b4
Deleted: sha256:05b140b9ef6f9c61c44d7810710937f4568fbfc5023606fe170de51049a1a1a7
Deleted: sha256:89394df8b473db7ef09c66ab1efeb7f0e5c35628c9794a99d95ff7bd47f9efe5
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230110123309
Successfully started process 'command 'gcloud''
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230110123309]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5d42024f67126ca143474d7fffdf9234ab22d0f4512260fdc7a5223b737f14ed]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230110123309] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5d42024f67126ca143474d7fffdf9234ab22d0f4512260fdc7a5223b737f14ed])].
Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java
Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh''
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5d42024f67126ca143474d7fffdf9234ab22d0f4512260fdc7a5223b737f14ed
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5d42024f67126ca143474d7fffdf9234ab22d0f4512260fdc7a5223b737f14ed
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5d42024f67126ca143474d7fffdf9234ab22d0f4512260fdc7a5223b737f14ed].
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution ****,5,main]) completed. Took 4.423 secs.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 2,5,main]) started.
> Task :sdks:java:io:kafka:cleanUp
Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 44m 59s
157 actionable tasks: 98 executed, 55 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/3ch2a7vff7eoi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #3536
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3536/display/redirect?page=changes>
Changes:
[noreply] Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#24915)
[noreply] update Beam GCP BOM (#24929)
[noreply] [#24931][Go SDK] Make element checkpoints independant (#24932)
[noreply] Update Kafka watermark based on policy when records poll empty (#24205)
[noreply] Grafana dashboard - Github actions postcommit workflows mapping (#24176)
[noreply] Shard Python PreCommit (#24866)
[noreply] reapply single executor to storage write API writes (#24950)
[noreply] [#21368] Clean-up and use the FixedExecutorProvider (#24952)
------------------------------------------
[...truncated 928.76 KB...]
INFO: Kafka version: 2.4.1
Jan 10, 2023 12:54:52 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 10, 2023 12:54:52 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673312092672
Jan 10, 2023 12:54:53 AM org.apache.kafka.clients.Metadata update
INFO: [Consumer clientId=consumer-1, groupId=null] Cluster ID: zD1r1TvIRM6BEyPqEqmjNA
Jan 10, 2023 12:54:53 AM org.apache.beam.sdk.io.kafka.KafkaUnboundedSource split
INFO: Partitions assigned to split 0 (total 1): beam-sdf-0
Jan 10, 2023 12:54:53 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Read(KafkaUnboundedSource)/StripIds as step s2
Jan 10, 2023 12:54:53 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Measure read time as step s3
Jan 10, 2023 12:54:53 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Map records to strings/Map as step s4
Jan 10, 2023 12:54:53 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Counting element as step s5
Jan 10, 2023 12:54:53 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.45.0-SNAPSHOT
Jan 10, 2023 12:54:53 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-01-09_16_54_53-1145977912783962470?project=apache-beam-testing
Jan 10, 2023 12:54:53 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-01-09_16_54_53-1145977912783962470
Jan 10, 2023 12:54:53 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-01-09_16_54_53-1145977912783962470
Jan 10, 2023 12:55:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-01-10T00:55:03.091Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: kafkaioit0testkafkaioreadsandwritescorrectlyinstreaming-je-fcbk. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jan 10, 2023 12:55:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:20.609Z: Worker configuration: e2-standard-2 in us-central1-f.
Jan 10, 2023 12:55:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:24.709Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 10, 2023 12:55:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:26.698Z: Expanding SplittableParDo operations into optimizable parts.
Jan 10, 2023 12:55:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:26.767Z: Expanding CollectionToSingleton operations into optimizable parts.
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:26.892Z: Expanding CoGroupByKey operations into optimizable parts.
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:26.969Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.031Z: Expanding GroupByKey operations into streaming Read/Write steps
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.090Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.232Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.305Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Impulse
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.361Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor)
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.427Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/SplitWithSizing into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.485Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous) into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/ProcessElementAndRestrictionWithSizing
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.547Z: Fusing consumer Measure read time/ParMultiDo(TimeMonitor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous)
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.616Z: Fusing consumer Map records to strings/Map/ParMultiDo(Anonymous) into Measure read time/ParMultiDo(TimeMonitor)
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.677Z: Fusing consumer Counting element/ParMultiDo(Counting) into Map records to strings/Map/ParMultiDo(Anonymous)
Jan 10, 2023 12:55:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:27.884Z: Running job using Streaming Engine
Jan 10, 2023 12:55:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:55:29.321Z: Starting 5 ****s in us-central1-f...
Jan 10, 2023 12:56:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:56:11.333Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 10, 2023 12:57:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:57:10.218Z: Workers have started successfully.
Jan 10, 2023 12:57:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-10T00:57:11.536Z: All ****s have finished the startup processes and began to receive work requests.
Jan 10, 2023 1:19:53 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
Jan 10, 2023 1:19:53 AM org.apache.kafka.common.config.AbstractConfig logAll
INFO: AdminClientConfig values:
bootstrap.servers = [34.69.224.121:32401, 34.170.144.24:32402, 34.28.42.109:32403]
client.dns.lookup = default
client.id =
connections.max.idle.ms = 300000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 120000
retries = 5
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
Jan 10, 2023 1:19:53 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka version: 2.4.1
Jan 10, 2023 1:19:53 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 10, 2023 1:19:53 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673313593831
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:kafka:integrationTest FAILED
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED
java.lang.AssertionError: actual number of records 26109727 smaller than expected: 100000000.
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:225)
1 test completed, 1 failed
Finished generating test XML results (0.026 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.029 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
:sdks:java:io:kafka:integrationTest (Thread[Execution **** Thread 7,5,main]) completed. Took 44 mins 23.559 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[included builds,5,main]) started.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because:
Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230110003424
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230110003424
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0637efaf5718ad2aa66a565b03b2beb4cbd2ce5ce5736b94e31e298472ffcd41
Deleted: sha256:9e169d99775e6483ee5a448b6d663e634686d5a2c4a35e11b1364a524195ffb7
Deleted: sha256:9698c60e37ed0212d7f5511f5cc4852e43f0c6ae61152fc27813dd5ab5fa7189
Deleted: sha256:ed2b857f6ed24ce8336c8ad3bce9197335af14a60e5c316d3da27e24bb48f1ab
Deleted: sha256:6c21c068fd67212fb49c747ed5b1f07923a03757c99c970e8242d97c91830ea2
Deleted: sha256:60fcc6e4bc5c33a851e8af88215cf039a7b3b0b9d006f59fa94c877a2efcdee9
Deleted: sha256:37aae6d64ef626f7d5664f9713de214e3ba749093c23c4927de1612fad70da17
Deleted: sha256:e9461a39637406dfd795534ea0d416038234825c20d0aff3ef89c6aca2b09202
Deleted: sha256:f813d36e629b181628f88231a0d962796a6ae3c4f75c4a9765a99e2952b29f53
Deleted: sha256:c394a8bda89097dc9fc3ab000720cc1b2eda8c4e181af8420e89aaaeaf5cc98e
Deleted: sha256:ebd7d69a2485f8683b33453f12b0eb18d7c4a4e1e0ba27a78913642d5bcbc68e
Deleted: sha256:dbc3a32897df24445abc32d0972b3cdfd630d302e76cb17d9ff92f3198ba2bf8
Deleted: sha256:0959cf87e49cb5d312138f1c9608c7c56e93040e1bf170e028f8f324b263d0d0
Deleted: sha256:d82c42788dde3436a8f5d9a86f76ffde18a43a655a6280bbacb283e04eee3f76
Deleted: sha256:f0553ff3da5ebc8b7473fd1f4614fa3776a767afbceee23463cd608467b0ec27
Deleted: sha256:17f1588841d2fcd83956df4d11e434de159da6fd819f80782e279e876c2e5be1
Deleted: sha256:3f76c90806b6ccffe4d6813e722fa774f9834786cb79d1cdbbf200bc0f90c423
Deleted: sha256:0fd3ce44c7e39d0625eecc4e2ebfd01a5f7d8696634af89bf175c39451b9cba1
Deleted: sha256:0555def4e768a6ec9f8e280562032727033e7cad2d0475f147cf4170a915f113
Deleted: sha256:a6aa1e2b1da983c2cf19ee94751957d864ee69ff731684fb3311ca45aba06e8f
Deleted: sha256:6f8d707e14232bb8c63cad1d906fb632ebc5fbc9168af5b96632fa232ce47f0f
Deleted: sha256:c92423184e8629b46b5fba8188c141c4548186699d335e3003eda77b7b309f2e
Deleted: sha256:523c82618fd33acf9d52748e9ada01e46f6f48029435b0cde54c93caa0810173
Deleted: sha256:4fe89271e773892e13cbfda60beeba27771166f64822a11df26682cf2f14ad7b
Deleted: sha256:6cb3783893194ddef366f5c55ed5f78f77d62ab4544d2665a3edca91ac57b724
Deleted: sha256:a5b1e7cd6587c3a0f527328ca611f7a9ab87048e9a3013dff5193eecdebf2583
Deleted: sha256:f7303e9db97f690440efc098923c9067e924d8dd4a4bed63bec097e28ab87fbe
Deleted: sha256:2260e7f32238e6109dcd715962c12692f8bead1958a0e88132eb23ac1de620af
Deleted: sha256:49722ec28b39500e311d6fc2b791013f95c9c1355351c6c7420ee17902240567
Deleted: sha256:4e3e00a56cf1e5afe343722060579c802bb94a03728f9c8ef80d8e6227409fe7
Deleted: sha256:45e4ec9bd7e200ab3cb6527205f068c7e7dc5039d9a428b729bf2ef1ec81b6c6
Deleted: sha256:8c9c3d8bc38cb1a36827703a4faa6f812bd30c497caa0100971192d01d47da83
Deleted: sha256:4ebea3bdee8c01ec9afb7b2043caf1afbe4897eccedb3e5bec9ef65295234e84
Deleted: sha256:5e29a425552119736db9ba7bb53d4914b5a8e4861b7627c80d21a7b84cefe382
Deleted: sha256:987c5c3c04981fb6b65bba7e5762cc8d92189938e7fad3a8466854743757b0b3
Deleted: sha256:79f493b678128fc4b6385f558f470be4d76932ec968373b7945dc3d03bf01ed0
Deleted: sha256:2b5ffbf85ee90a7edbfed2a7d33178c4da5580a0166ec2fb5bce54c1dec72342
Deleted: sha256:a1502ed189bc42db2ad2802c398adacce743001141c84550ae46b667a42b4783
Deleted: sha256:502f1b6b34bdc9825830b62bff818b55fb5894c8a34a39e1c533ae106bad50df
Deleted: sha256:ba19455dd3202cda37b25b2ce9dd75d9c7c7d8d7a1cd58de815739c0576bbb98
Deleted: sha256:85c7bed81c9e4c41ce4991e93b4e901da31971e93250551d0d08258bf66f0aa6
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230110003424
Successfully started process 'command 'gcloud''
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230110003424]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0637efaf5718ad2aa66a565b03b2beb4cbd2ce5ce5736b94e31e298472ffcd41]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230110003424] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0637efaf5718ad2aa66a565b03b2beb4cbd2ce5ce5736b94e31e298472ffcd41])].
Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java
Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh''
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0637efaf5718ad2aa66a565b03b2beb4cbd2ce5ce5736b94e31e298472ffcd41
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0637efaf5718ad2aa66a565b03b2beb4cbd2ce5ce5736b94e31e298472ffcd41
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:0637efaf5718ad2aa66a565b03b2beb4cbd2ce5ce5736b94e31e298472ffcd41].
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[included builds,5,main]) completed. Took 4.651 secs.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:kafka:cleanUp
Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 45m 50s
157 actionable tasks: 99 executed, 54 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/vfshosvjsqnxa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #3535
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3535/display/redirect>
Changes:
------------------------------------------
[...truncated 926.91 KB...]
INFO: Kafka version: 2.4.1
Jan 09, 2023 12:51:52 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 09, 2023 12:51:52 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673268712529
Jan 09, 2023 12:51:52 PM org.apache.kafka.clients.Metadata update
INFO: [Consumer clientId=consumer-1, groupId=null] Cluster ID: Xaf0uhA_QB-_9QNNnxqxhA
Jan 09, 2023 12:51:52 PM org.apache.beam.sdk.io.kafka.KafkaUnboundedSource split
INFO: Partitions assigned to split 0 (total 1): beam-sdf-0
Jan 09, 2023 12:51:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Read(KafkaUnboundedSource)/StripIds as step s2
Jan 09, 2023 12:51:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Measure read time as step s3
Jan 09, 2023 12:51:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Map records to strings/Map as step s4
Jan 09, 2023 12:51:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Counting element as step s5
Jan 09, 2023 12:51:52 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.45.0-SNAPSHOT
Jan 09, 2023 12:51:53 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-01-09_04_51_52-13688736314262243398?project=apache-beam-testing
Jan 09, 2023 12:51:53 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-01-09_04_51_52-13688736314262243398
Jan 09, 2023 12:51:53 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-01-09_04_51_52-13688736314262243398
Jan 09, 2023 12:51:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-01-09T12:51:57.902Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: kafkaioit0testkafkaioreadsandwritescorrectlyinstreaming-je-j6wd. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:10.348Z: Worker configuration: e2-standard-2 in us-central1-f.
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.641Z: Expanding SplittableParDo operations into optimizable parts.
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.677Z: Expanding CollectionToSingleton operations into optimizable parts.
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.749Z: Expanding CoGroupByKey operations into optimizable parts.
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.785Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.815Z: Expanding GroupByKey operations into streaming Read/Write steps
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.839Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.890Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.909Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Impulse
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.929Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor)
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.957Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/SplitWithSizing into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:11.984Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous) into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/ProcessElementAndRestrictionWithSizing
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:12.017Z: Fusing consumer Measure read time/ParMultiDo(TimeMonitor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous)
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:12.040Z: Fusing consumer Map records to strings/Map/ParMultiDo(Anonymous) into Measure read time/ParMultiDo(TimeMonitor)
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:12.061Z: Fusing consumer Counting element/ParMultiDo(Counting) into Map records to strings/Map/ParMultiDo(Anonymous)
Jan 09, 2023 12:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:12.141Z: Running job using Streaming Engine
Jan 09, 2023 12:52:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:13.360Z: Starting 5 ****s in us-central1-f...
Jan 09, 2023 12:52:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:15.470Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 09, 2023 12:52:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:52:56.517Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 09, 2023 12:54:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:54:00.150Z: Workers have started successfully.
Jan 09, 2023 12:54:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T12:54:01.824Z: All ****s have finished the startup processes and began to receive work requests.
Jan 09, 2023 1:16:53 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
Jan 09, 2023 1:16:53 PM org.apache.kafka.common.config.AbstractConfig logAll
INFO: AdminClientConfig values:
bootstrap.servers = [34.170.166.169:32404, 34.71.209.216:32405, 34.66.232.203:32406]
client.dns.lookup = default
client.id =
connections.max.idle.ms = 300000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 120000
retries = 5
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
Jan 09, 2023 1:16:53 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka version: 2.4.1
Jan 09, 2023 1:16:53 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 09, 2023 1:16:53 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673270213627
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:kafka:integrationTest FAILED
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED
java.lang.AssertionError: actual number of records 18957181 smaller than expected: 100000000.
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:224)
1 test completed, 1 failed
Finished generating test XML results (0.066 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.072 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) started.
:sdks:java:io:kafka:integrationTest (Thread[Execution **** Thread 3,5,main]) completed. Took 43 mins 52.411 secs.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because:
Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230109123210
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230109123210
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a5ba616e99122859a732ea64319fc4829e025aa8d38a34b7bf73a6cca3de1ec6
Deleted: sha256:7963924292c7fcac5805fb6dc030a70cce18e27a2f818318b828a548b0889570
Deleted: sha256:3b8a941bdeab386653f3c757e96bf7463733aff1af83ddb6a94099a16bc9ae67
Deleted: sha256:b929d379cfbc118f32b237a692ce7364b211a43b499bd1d7b5397c1fe338f417
Deleted: sha256:61f30a4957896b21350f7c1560941483c1fd4fb470c49e69ba0c3db1ba5c8881
Deleted: sha256:725eb04c3baa1309b4901a8b001d0b279404e18e48980306b901795ccd0ccf78
Deleted: sha256:460b5e1970c54341aad0299f53dd40227857fbcfa313f5e1a9b66165b7696952
Deleted: sha256:e291b960613678b7cf51e3c02660d84e6bfe8a279e2aa04048e64602afd05dd0
Deleted: sha256:e23206d4cbe3fc1073914104d866e186b081c69b81f3b6587340463f395092e0
Deleted: sha256:5ce5ffd8fea86de261be8f1bac950c088ca51d8cb73dfd52a0f6e93900c54316
Deleted: sha256:3c82f7674aafaee0b29f2285fcf66b7760ea095c58988523231dda27b3191b68
Deleted: sha256:84f7971ce89a48a4d182fb7d2c86aa769543d4230cd8b9faa29156a2e05adb4e
Deleted: sha256:d439f3686fecf9df02f1a1e2ee27771536dad2a465845d5f08dc559292dc41ff
Deleted: sha256:da4d39ec6c86a84cfdbecc5be551839720dbc783357c2a42e1992ec54def107a
Deleted: sha256:b4cd37f576e8a5e88af5c7150c1b0399ebb80c564f9defb462172e5ef3019930
Deleted: sha256:9496330785e32c145aa6f04bbc9ff3b5fee124ed60c4e8462a1b4ac710d8e66c
Deleted: sha256:5f9759a7190186ffee1fd58a9e96005a99afcabb019b95f6555adbca3cdff883
Deleted: sha256:c3c3210a272590f14052e718417007566c4b10020caee9a3fac1791e12d9e8e4
Deleted: sha256:d91af4a26e142f7ea6a11808b08e89d8b326bbc6778f48b06cbd37e14ec4cc1a
Deleted: sha256:3cdd33907f39ff7f99002883dd69cee8223ea4099e55dccdb5955d531d924d87
Deleted: sha256:f135ffdcb9f86a791caa3c09c5c2af84fb6f209fa132046a69426fc689a70afc
Deleted: sha256:c8118eacf1e8ebd5038ede45b830cfdaca115cbed09afdada998a2a618923db7
Deleted: sha256:2c3da11647aa2f758ccc4392c245873e3f85f154882b2a636e18daa27ff9b099
Deleted: sha256:fd96e59ad0a5de1a0aedc50d130790f92013aa9cfaf33a6f48de7295408dcb92
Deleted: sha256:eee4fedb940b7a4699feed6531576670ba1ed318113cb6b175132ab5b35c699a
Deleted: sha256:0cfa07702e1ca88df3d3faea410a3bb3fdb72dd1a2d06e3fd73b2dae73b86827
Deleted: sha256:280b32dbd0a864729f2a1f35ea422faa376212dafe18ac0d4a8dea9b9ac0f60d
Deleted: sha256:7b762d70333295df8230fbc42278e42bf1f45fd5e3dad4bd08a856778a7b6bd6
Deleted: sha256:a70b3c0a70376bc3447e17bcddd37dd3da9b0009ab9ba01dd9174d86a9e42a25
Deleted: sha256:95f953b8365e9f2eac08b330f50633cac60a2f45c3f27cd070df20a2d0211014
Deleted: sha256:6645c066650a86457b91f3663a8f35d6e26c8a1fa57f4ce60b3e388d116ce141
Deleted: sha256:b8505374f23baa7c5fa8e33304af888822a50d1bcf09e2138c9de9aedac59553
Deleted: sha256:ade4f8e162671f65cd0be9de073d1928bffdd68f5e64d8ba8b2e647e27b23092
Deleted: sha256:d7a2893a5a4dda2baa1e9e113045747c6f49ddc7d185e9c085c914cff118b4b1
Deleted: sha256:1e4093f277058d35ddc44d8f8e50c8f72341c2c4095871fad25cfaf0779021a5
Deleted: sha256:bb2b063ac4d2bb728cb55ffa9a1741546de44923ba865ea3a6797776516cfb6a
Deleted: sha256:868e205ec4b675d4ec5bdcdbb2cb03ae93bf2e28ab06104b7991fd5fe60c7eca
Deleted: sha256:8f593cf7d3caea10fbcf6e3002f47b60dd96d0c7932e480427f143a85e5e1ff2
Deleted: sha256:9c6d2d91127cf87ac276a72b3dbf97f2d9d4f92de93cbf5160f1aa2742a04fa0
Deleted: sha256:8d5924e80ba75d814b0f62ab33db2ab47dfb9e39b166a2e0ac88cea7256318e0
Deleted: sha256:fc649d31448ab83966c3da16fcb2023e531fec5a650607df61d8b6c0c284f619
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230109123210
Successfully started process 'command 'gcloud''
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230109123210]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a5ba616e99122859a732ea64319fc4829e025aa8d38a34b7bf73a6cca3de1ec6]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230109123210] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a5ba616e99122859a732ea64319fc4829e025aa8d38a34b7bf73a6cca3de1ec6])].
Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java
Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh''
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a5ba616e99122859a732ea64319fc4829e025aa8d38a34b7bf73a6cca3de1ec6
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a5ba616e99122859a732ea64319fc4829e025aa8d38a34b7bf73a6cca3de1ec6
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a5ba616e99122859a732ea64319fc4829e025aa8d38a34b7bf73a6cca3de1ec6].
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) completed. Took 10.786 secs.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:kafka:cleanUp
Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 45m 9s
157 actionable tasks: 98 executed, 55 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/fdsstng3gm6xy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #3534
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3534/display/redirect?page=changes>
Changes:
[noreply] [#24927] Ensure the SDK harness handles JCL/log4j/log4j2 messages.
------------------------------------------
[...truncated 941.77 KB...]
Jan 09, 2023 12:59:41 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 09, 2023 12:59:41 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673225981772
Jan 09, 2023 12:59:42 AM org.apache.kafka.clients.Metadata update
INFO: [Consumer clientId=consumer-1, groupId=null] Cluster ID: IYFGKRXeRMKB0a3YSvoprA
Jan 09, 2023 12:59:42 AM org.apache.beam.sdk.io.kafka.KafkaUnboundedSource split
INFO: Partitions assigned to split 0 (total 1): beam-sdf-0
Jan 09, 2023 12:59:42 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Read(KafkaUnboundedSource)/StripIds as step s2
Jan 09, 2023 12:59:42 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Measure read time as step s3
Jan 09, 2023 12:59:42 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Map records to strings/Map as step s4
Jan 09, 2023 12:59:42 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Counting element as step s5
Jan 09, 2023 12:59:42 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.45.0-SNAPSHOT
Jan 09, 2023 12:59:43 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-01-08_16_59_42-9958730661573213331?project=apache-beam-testing
Jan 09, 2023 12:59:43 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-01-08_16_59_42-9958730661573213331
Jan 09, 2023 12:59:43 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-01-08_16_59_42-9958730661573213331
Jan 09, 2023 12:59:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-01-09T00:59:47.799Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: kafkaioit0testkafkaioreadsandwritescorrectlyinstreaming-je-9fr6. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jan 09, 2023 1:00:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:01.409Z: Worker configuration: e2-standard-2 in us-central1-f.
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:02.896Z: Expanding SplittableParDo operations into optimizable parts.
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:02.924Z: Expanding CollectionToSingleton operations into optimizable parts.
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:02.982Z: Expanding CoGroupByKey operations into optimizable parts.
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.020Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.049Z: Expanding GroupByKey operations into streaming Read/Write steps
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.071Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.146Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.167Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Impulse
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.198Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor)
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.227Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/SplitWithSizing into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.254Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous) into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/ProcessElementAndRestrictionWithSizing
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.286Z: Fusing consumer Measure read time/ParMultiDo(TimeMonitor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous)
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.309Z: Fusing consumer Map records to strings/Map/ParMultiDo(Anonymous) into Measure read time/ParMultiDo(TimeMonitor)
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.331Z: Fusing consumer Counting element/ParMultiDo(Counting) into Map records to strings/Map/ParMultiDo(Anonymous)
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:03.411Z: Running job using Streaming Engine
Jan 09, 2023 1:00:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:04.648Z: Starting 5 ****s in us-central1-f...
Jan 09, 2023 1:00:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:14.199Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 09, 2023 1:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:00:47.592Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 09, 2023 1:01:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:01:54.705Z: Workers have started successfully.
Jan 09, 2023 1:01:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-09T01:01:55.214Z: All ****s have finished the startup processes and began to receive work requests.
Jan 09, 2023 1:24:43 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
Jan 09, 2023 1:24:43 AM org.apache.kafka.common.config.AbstractConfig logAll
INFO: AdminClientConfig values:
bootstrap.servers = [34.69.157.49:32401, 35.224.54.19:32402, 34.66.205.246:32403]
client.dns.lookup = default
client.id =
connections.max.idle.ms = 300000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 120000
retries = 5
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
Jan 09, 2023 1:24:43 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka version: 2.4.1
Jan 09, 2023 1:24:43 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 09, 2023 1:24:43 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673227483192
Gradle Test Executor 5 finished executing tests.
> Task :sdks:java:io:kafka:integrationTest FAILED
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED
java.lang.AssertionError: actual number of records 18261722 smaller than expected: 100000000.
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:224)
1 test completed, 1 failed
Finished generating test XML results (0.04 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.043 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
:sdks:java:io:kafka:integrationTest (Thread[Execution **** Thread 3,5,main]) completed. Took 44 mins 19.185 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because:
Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230109003826
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230109003826
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e5c4155d5c89e6cf98a938dc511aee3644d9f39a0e15844d470d3cd10057529
Deleted: sha256:5c24204e552de8fbcbfa3445a828b8ab48b5c962f04584b9fec15b9f1ec16867
Deleted: sha256:f4f8fb485fc4591920c009d7cff574f28447ae094c976caede30c6863f41b8ec
Deleted: sha256:09d18b5a3e1769e0093c9f75ed4ef5039d7a90a9575eb9a62b823cffea5aba6a
Deleted: sha256:af8a12f5b6324c751b56689b06e8090588e50e307416fa5cbec98e2226a76704
Deleted: sha256:7a3b3e16fe6a552eff3988eddee407f7c75a73881c5a61c457ff62517379ab27
Deleted: sha256:028217574e594f163e391ff67c5f00a996d62b33d4204885766131a8325048eb
Deleted: sha256:c7d65bebba97525e2b6593c68461355bde7ebd47ccc2f92bc0df0fcdcb698e1c
Deleted: sha256:3654c5b5d7d14c864d518a1d396170b495173e2d4c7bfcd62dc20da20362d0d2
Deleted: sha256:b057448f85a8e5f923e4c18583ef39e19cad04ec68eed17d706c80f30ed74fff
Deleted: sha256:546c9ed45879a6e6dbc7273389abde9945f326c4488252e1b90e314abcc5d36e
Deleted: sha256:f93c181166f920b2c98b96f00385fab5ba1e47b9084162397a1be2fd48eab998
Deleted: sha256:ad8ec679ec5bbbf774796a3e71ecfb571de7d19a74343f756dbd8702159773f2
Deleted: sha256:fca31f20ca0eb597acf6a533e140a53200f7a83916c27161008bd370bd263c06
Deleted: sha256:845948eabc7c7368bb0f188c4b7942b5bffbe270e2e500cfdfd7f156a3ef1d2b
Deleted: sha256:760f6e61804af5d3c3a7e6695e7a914271af5d560cc0516be18a42e3c87139e9
Deleted: sha256:ac964096eac7c563d1c8afbb09072d79ae0f6e640d7c152efaa712c57ad9dccf
Deleted: sha256:fb236ef43c11d44e2e8fb23fd26b1d9690227e7bdca95562d39fd4ec63d5d08d
Deleted: sha256:766c7c5dacf601f9763344c05dd620f3e63dd9a359194def071cfe9f2d08bc92
Deleted: sha256:77216255ae6489889f4f82eadc10851ce0a0b2a44448e8ef4c00ded70600d1ac
Deleted: sha256:d7e30fd7830b635ea4c29d052873508b71b429434739c3a7f7fdcc5196e2576f
Deleted: sha256:67aeffc56b14d5c453f0fee5fd1b2360ecd6ef517b763ebf8603f84270decf27
Deleted: sha256:d975ee415be3a7aeed06b5527dbac9645a2b9b195249eed38c465da72f3b6ce0
Deleted: sha256:f7d01a3499daa902a69226b9166a094de9ae450d243d655176c7e1dd9dffe681
Deleted: sha256:7ad08af8925ffc75345d08816bb58d9ac341d71989cebae3cf6b4cf677615908
Deleted: sha256:ed6622727f13c87658ce40cab252797354ac00d43df1b3b5a8e61ea6e9bb58e2
Deleted: sha256:825362294e835e6b5b2189b462ae0b2ecf69f0288de5f39df51e63c24cee8140
Deleted: sha256:179b55cb4bc53cadf60a8600638524fd0201bf204e901eafc2acc000c26e3399
Deleted: sha256:4fbfbc85b8cc34dc985f37c4c9d0446b842cbf44cd0cdc28f9d61ad47639be89
Deleted: sha256:895df1cb9801a2496a059a3d0e04896ae61de1145d207a32712ee3edd7d5a9c9
Deleted: sha256:0dab62b6ac80773930e15c9855c7679db3e5aa11501f78db936489f444688aaf
Deleted: sha256:7bf82df27c2908b778a5dcbff9127ac54ecbd27ddd770e5b5ad5303f35c76722
Deleted: sha256:e034146d8ed91213b35e4b28cd849a0846f209194b3b47c3e3472b98e56cb41b
Deleted: sha256:0549e2e4cebddaec2b41c7dc6fb787a61d37262c1c7e09632c591dc3e969dbde
Deleted: sha256:2fbfe36ef8b4cd2993789e4f54d3ca398f2123e286fdbcd439e9199ea281f934
Deleted: sha256:9743dd52dda15582a6d19a78fe2a57ba4c5da13ef376e36660cf800627e16bb6
Deleted: sha256:55ec8bc34f7852bdd53ade247f3b7cad3011213e217c8206a93db2de815899e3
Deleted: sha256:83402c7eaba2cb5f54493d2a364d82776930c066c7a9ae7335d6b01b3b8910e8
Deleted: sha256:0654e9f67c3551d5ddd392daa54636f88b9ae61a7ccc2603988bf17b9b94eb08
Deleted: sha256:99259b909bea468bc82126a00b71b19c1e443567d893691b3a9be62b93a1ae9a
Deleted: sha256:c5afcbce23f1847da0ee17b48a4cd66bf3499e5c8eb8b0441186a4f36227bb20
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230109003826
Successfully started process 'command 'gcloud''
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230109003826]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e5c4155d5c89e6cf98a938dc511aee3644d9f39a0e15844d470d3cd10057529]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230109003826] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e5c4155d5c89e6cf98a938dc511aee3644d9f39a0e15844d470d3cd10057529])].
Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java
Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh''
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e5c4155d5c89e6cf98a938dc511aee3644d9f39a0e15844d470d3cd10057529
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e5c4155d5c89e6cf98a938dc511aee3644d9f39a0e15844d470d3cd10057529
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:9e5c4155d5c89e6cf98a938dc511aee3644d9f39a0e15844d470d3cd10057529].
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) completed. Took 5.742 secs.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 3,5,main]) started.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 7,5,main]) started.
> Task :sdks:java:io:kafka:cleanUp
Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 7,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 46m 50s
157 actionable tasks: 106 executed, 47 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/zfu5whj4iitpm
Stopped 4 **** daemon(s).
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #3533
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3533/display/redirect>
Changes:
------------------------------------------
[...truncated 920.50 KB...]
Jan 08, 2023 12:52:42 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka version: 2.4.1
Jan 08, 2023 12:52:42 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 08, 2023 12:52:42 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673182362434
Jan 08, 2023 12:52:42 PM org.apache.kafka.clients.Metadata update
INFO: [Consumer clientId=consumer-1, groupId=null] Cluster ID: E-v5jskuQKOQuMhxNskk6w
Jan 08, 2023 12:52:42 PM org.apache.beam.sdk.io.kafka.KafkaUnboundedSource split
INFO: Partitions assigned to split 0 (total 1): beam-sdf-0
Jan 08, 2023 12:52:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Read(KafkaUnboundedSource)/StripIds as step s2
Jan 08, 2023 12:52:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Measure read time as step s3
Jan 08, 2023 12:52:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Map records to strings/Map as step s4
Jan 08, 2023 12:52:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Counting element as step s5
Jan 08, 2023 12:52:42 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.45.0-SNAPSHOT
Jan 08, 2023 12:52:43 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-01-08_04_52_42-13251555724824884126?project=apache-beam-testing
Jan 08, 2023 12:52:43 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-01-08_04_52_42-13251555724824884126
Jan 08, 2023 12:52:43 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-01-08_04_52_42-13251555724824884126
Jan 08, 2023 12:52:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-01-08T12:52:47.864Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: kafkaioit0testkafkaioreadsandwritescorrectlyinstreaming-je-kmvz. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:01.165Z: Worker configuration: e2-standard-2 in us-central1-f.
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.447Z: Expanding SplittableParDo operations into optimizable parts.
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.469Z: Expanding CollectionToSingleton operations into optimizable parts.
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.526Z: Expanding CoGroupByKey operations into optimizable parts.
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.566Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.594Z: Expanding GroupByKey operations into streaming Read/Write steps
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.623Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.683Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.713Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Impulse
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.748Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor)
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.781Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/SplitWithSizing into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.817Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous) into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/ProcessElementAndRestrictionWithSizing
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.850Z: Fusing consumer Measure read time/ParMultiDo(TimeMonitor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous)
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.885Z: Fusing consumer Map records to strings/Map/ParMultiDo(Anonymous) into Measure read time/ParMultiDo(TimeMonitor)
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:02.911Z: Fusing consumer Counting element/ParMultiDo(Counting) into Map records to strings/Map/ParMultiDo(Anonymous)
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:03.005Z: Running job using Streaming Engine
Jan 08, 2023 12:53:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:03.737Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 08, 2023 12:53:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:04.223Z: Starting 5 ****s in us-central1-f...
Jan 08, 2023 12:53:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:46.491Z: Autoscaling: Raised the number of ****s to 4 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 08, 2023 12:53:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:46.513Z: Autoscaling: Resized **** pool to 4, though goal was 5. This could be a quota issue.
Jan 08, 2023 12:53:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:53:56.316Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 08, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:54:48.859Z: All ****s have finished the startup processes and began to receive work requests.
Jan 08, 2023 12:54:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T12:54:49.842Z: Workers have started successfully.
Jan 08, 2023 1:17:43 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
Jan 08, 2023 1:17:43 PM org.apache.kafka.common.config.AbstractConfig logAll
INFO: AdminClientConfig values:
bootstrap.servers = [34.136.63.244:32404, 34.27.177.196:32405, 34.132.43.201:32406]
client.dns.lookup = default
client.id =
connections.max.idle.ms = 300000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 120000
retries = 5
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
Jan 08, 2023 1:17:43 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka version: 2.4.1
Jan 08, 2023 1:17:43 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 08, 2023 1:17:43 PM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673183863660
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:kafka:integrationTest FAILED
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED
java.lang.AssertionError: actual number of records 19989601 smaller than expected: 100000000.
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:224)
1 test completed, 1 failed
Finished generating test XML results (0.027 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.029 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
:sdks:java:io:kafka:integrationTest (Thread[Execution ****,5,main]) completed. Took 43 mins 50.684 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 2,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because:
Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230108123303
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230108123303
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56268e73ba2c72e13f8d9d3de7fe24b03f2f84046f2a88528564e6012ebec899
Deleted: sha256:429448e5c3b1b24b095257007fdbc776884410d1a31d8d5d777e75a25dc07840
Deleted: sha256:234d006ecbe148d869399209b0af58962ff50a948c51fc4d29eda9799b89f909
Deleted: sha256:9ace7294b01afb33b10a7c4990f82b6f03c72acfdac7ae364f7618a393c18faf
Deleted: sha256:de24f00688cad17fbb72ecc96d89b8ffa08627fb82f6270bc070e437e58890d5
Deleted: sha256:c7e4fc2d2771cda4355ab3591ab2892e0ea8b71b775ba179a5b34aa68ed8db5d
Deleted: sha256:b9f78b578633312b90eecd7204deef404535b11fa4993709531d06ae77ecf486
Deleted: sha256:deb13858e0eb195e19749690a2af6cf10338f97a457dd2ef7f586f39d0c4af5d
Deleted: sha256:b0f95688f278da40a8306209262939a0cc56935a87edacf4dbf4de04b72058a2
Deleted: sha256:8bae5e64a5541c23e0e1c42303557c6222a6212f1579bc52d75caab6ac34972f
Deleted: sha256:3d86f02b44d67ed2c9c520468b7cf34c70dce9757b25403304f18e9bb96f8813
Deleted: sha256:374dd06a29f9914c36ee258a6f0471cb526e681e9bc8481ae5ff38e1163a96db
Deleted: sha256:a670ab6e94783ab626ca8062994bb4cc235595864ad0d6fadb3f2fa291c43a62
Deleted: sha256:d74a4a9e427a1f9b122a513931675c0d6627dc3893a83b9347a207c4e2efbfe0
Deleted: sha256:b52f0dc083f209bd150c49d744c4824674a7b25156fe067b1d57217ca70ced73
Deleted: sha256:f23538443a6711276a07c77f1f53320a15babd80fcf9643b6496a8ebb6767778
Deleted: sha256:95fd50f9ace552d22d4df03c1217f671ae66634b707364ad703acc1d0df8b2fd
Deleted: sha256:bd1232748e3866a1d0a6766da9e68e5276cf0b14d2b1d516690e8ba1df303556
Deleted: sha256:0948cde95505f49708cbc3714cd01dd89b756fcb2aaca798859db79f737f677f
Deleted: sha256:69d32bcd9a88c8e6cf45ade49ba521883c9d66525dd6456d823852d2947dbf3d
Deleted: sha256:e2dc9c20e0f4f3fff06a3346bb6b6ebb5774dd5bd8b5ccb8644bbc2e35bdc391
Deleted: sha256:1acb20efd4154e933fc158ffc59d2620450b2842f5b9533a2e98487e7bed7ac0
Deleted: sha256:b39647a6fbe0b303a679522aeb60c6c4d951a6e0f79e71e05f4f0536b334a1b8
Deleted: sha256:5fc16f7b74ffa6b1b495ec505c614b04258f832820dd6a0c445c447d1ceacb8e
Deleted: sha256:33a449a4b607e667b993acb5d03c96a423b077befc90e46e70ec5bda374f2b56
Deleted: sha256:988ea1d1454681eab399577e2e9e950fb8f44f3dcfc43c13c6cca8e85f0f30d6
Deleted: sha256:b6271ec3e1a4b4ce9278c7c864025d5beb3baa691e4c32405df3f9ee53f62350
Deleted: sha256:89b7f2c05b0957932f8e73b85cb26dd3a98654961f5130f934528be10a1f489f
Deleted: sha256:98f2aeb2fd20035743902918e36189beeef36a94351142f3c662f2c21217bbdc
Deleted: sha256:e0d9fdadbbb3090f1e3622b271d895086dbfe84370c6b3c3ac55ffce7dddc072
Deleted: sha256:d91d23121fd24ae56f55eb58f1f8cad7dab8a2551b45185a02d1049fa4f389c8
Deleted: sha256:7d52075d8fdd7dc70a1d049341e3084ff7877d74ae86528e32a986d1903dcb00
Deleted: sha256:be212f16028b4916f699965bb94a354ac778b1b006ab96b4fee6472917182680
Deleted: sha256:605802abd79a841185c73be6a76a0a08fba5adea68cf1ba34faf688063869540
Deleted: sha256:54fd11e9b8cf4fbdeeaa4c1b18a9fbea899a4d9ac41fd68f76c5d21c8760e715
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230108123303
Successfully started process 'command 'gcloud''
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230108123303]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56268e73ba2c72e13f8d9d3de7fe24b03f2f84046f2a88528564e6012ebec899]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230108123303] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56268e73ba2c72e13f8d9d3de7fe24b03f2f84046f2a88528564e6012ebec899])].
Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java
Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh''
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56268e73ba2c72e13f8d9d3de7fe24b03f2f84046f2a88528564e6012ebec899
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56268e73ba2c72e13f8d9d3de7fe24b03f2f84046f2a88528564e6012ebec899
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56268e73ba2c72e13f8d9d3de7fe24b03f2f84046f2a88528564e6012ebec899].
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) completed. Took 4.503 secs.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution ****,5,main]) started.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution ****,5,main]) completed. Took 0.0 secs.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 2,5,main]) started.
> Task :sdks:java:io:kafka:cleanUp
Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 2,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 45m 1s
157 actionable tasks: 98 executed, 55 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/hglddi5ylghay
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_Kafka_IO #3532
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/3532/display/redirect>
Changes:
------------------------------------------
[...truncated 917.96 KB...]
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
Jan 08, 2023 12:50:40 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka version: 2.4.1
Jan 08, 2023 12:50:40 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 08, 2023 12:50:40 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673139040328
Jan 08, 2023 12:50:40 AM org.apache.kafka.clients.Metadata update
INFO: [Consumer clientId=consumer-1, groupId=null] Cluster ID: S_XbRBe7S_SUNtXbZA-LoA
Jan 08, 2023 12:50:40 AM org.apache.beam.sdk.io.kafka.KafkaUnboundedSource split
INFO: Partitions assigned to split 0 (total 1): beam-sdf-0
Jan 08, 2023 12:50:40 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Read(KafkaUnboundedSource)/StripIds as step s2
Jan 08, 2023 12:50:40 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Measure read time as step s3
Jan 08, 2023 12:50:40 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Map records to strings/Map as step s4
Jan 08, 2023 12:50:40 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Counting element as step s5
Jan 08, 2023 12:50:41 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.45.0-SNAPSHOT
Jan 08, 2023 12:50:41 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-01-07_16_50_41-4677020296680545888?project=apache-beam-testing
Jan 08, 2023 12:50:41 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-01-07_16_50_41-4677020296680545888
Jan 08, 2023 12:50:41 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-01-07_16_50_41-4677020296680545888
Jan 08, 2023 12:50:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-01-08T00:50:49.335Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: kafkaioit0testkafkaioreadsandwritescorrectlyinstreaming-je-hpzm. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jan 08, 2023 12:51:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:02.893Z: Worker configuration: e2-standard-2 in us-central1-f.
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:03.008Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.290Z: Expanding SplittableParDo operations into optimizable parts.
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.333Z: Expanding CollectionToSingleton operations into optimizable parts.
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.402Z: Expanding CoGroupByKey operations into optimizable parts.
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.443Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.476Z: Expanding GroupByKey operations into streaming Read/Write steps
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.510Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.575Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.602Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/Impulse
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.638Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/ParDo(GenerateKafkaSourceDescriptor)/ParMultiDo(GenerateKafkaSourceDescriptor)
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.673Z: Fusing consumer Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/SplitWithSizing into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/PairWithRestriction
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.700Z: Fusing consumer Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous) into Read-from-unbounded-Kafka-KafkaIO-Read-ReadFromKafkaViaSDF-KafkaIO-ReadSourceDescriptors-ParDo-Unbou/ProcessElementAndRestrictionWithSizing
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.731Z: Fusing consumer Measure read time/ParMultiDo(TimeMonitor) into Read from unbounded Kafka/KafkaIO.Read.ReadFromKafkaViaSDF/KafkaIO.ReadSourceDescriptors/MapElements/Map/ParMultiDo(Anonymous)
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.755Z: Fusing consumer Map records to strings/Map/ParMultiDo(Anonymous) into Measure read time/ParMultiDo(TimeMonitor)
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.787Z: Fusing consumer Counting element/ParMultiDo(Counting) into Map records to strings/Map/ParMultiDo(Anonymous)
Jan 08, 2023 12:51:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:04.874Z: Running job using Streaming Engine
Jan 08, 2023 12:51:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:06.082Z: Starting 5 ****s in us-central1-f...
Jan 08, 2023 12:51:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:51:49.347Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jan 08, 2023 12:52:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:52:53.281Z: Workers have started successfully.
Jan 08, 2023 12:52:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-01-08T00:52:53.636Z: All ****s have finished the startup processes and began to receive work requests.
Jan 08, 2023 1:15:41 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
WARNING: No terminal state was returned within allotted timeout. State value RUNNING
Jan 08, 2023 1:15:41 AM org.apache.kafka.common.config.AbstractConfig logAll
INFO: AdminClientConfig values:
bootstrap.servers = [35.193.238.136:32401, 35.202.161.207:32402, 35.238.176.154:32403]
client.dns.lookup = default
client.id =
connections.max.idle.ms = 300000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 120000
retries = 5
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
security.providers = null
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
Jan 08, 2023 1:15:41 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka version: 2.4.1
Jan 08, 2023 1:15:41 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka commitId: c57222ae8cd7866b
Jan 08, 2023 1:15:41 AM org.apache.kafka.common.utils.AppInfoParser$AppInfo <init>
INFO: Kafka startTimeMs: 1673140541811
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:kafka:integrationTest FAILED
org.apache.beam.sdk.io.kafka.KafkaIOIT > testKafkaIOReadsAndWritesCorrectlyInStreaming FAILED
java.lang.AssertionError: actual number of records 21853486 smaller than expected: 100000000.
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.apache.beam.sdk.io.kafka.KafkaIOIT.testKafkaIOReadsAndWritesCorrectlyInStreaming(KafkaIOIT.java:224)
1 test completed, 1 failed
Finished generating test XML results (0.027 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.029 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest>
:sdks:java:io:kafka:integrationTest (Thread[Execution **** Thread 2,5,main]) completed. Took 41 mins 54.514 secs.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 5,5,main]) started.
Resolve mutations for :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 5,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Custom actions are attached to task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
Caching disabled for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' because:
Gradle would require more information to cache this task
Task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: docker rmi --force us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230108003255
Successfully started process 'command 'docker''
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230108003255
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:38e070f0ab28713a96153d2503c68ad1e3783df003929afe4ecbf2927406c7aa
Starting process 'command 'gcloud''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: gcloud --quiet container images untag us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230108003255
Successfully started process 'command 'gcloud''
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230108003255]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:38e070f0ab28713a96153d2503c68ad1e3783df003929afe4ecbf2927406c7aa]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230108003255] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:38e070f0ab28713a96153d2503c68ad1e3783df003929afe4ecbf2927406c7aa])].
Starting process 'command './scripts/cleanup_untagged_gcr_images.sh''. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/runners/google-cloud-dataflow-java> Command: ./scripts/cleanup_untagged_gcr_images.sh us.gcr.io/apache-beam-testing/java-postcommit-it/java
Successfully started process 'command './scripts/cleanup_untagged_gcr_images.sh''
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:38e070f0ab28713a96153d2503c68ad1e3783df003929afe4ecbf2927406c7aa
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:38e070f0ab28713a96153d2503c68ad1e3783df003929afe4ecbf2927406c7aa
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:38e070f0ab28713a96153d2503c68ad1e3783df003929afe4ecbf2927406c7aa].
:runners:google-cloud-dataflow-java:cleanUpDockerJavaImages (Thread[Execution **** Thread 6,5,main]) completed. Took 4.391 secs.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 4,5,main]) started.
Resolve mutations for :sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 4,5,main]) completed. Took 0.0 secs.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 3,5,main]) started.
> Task :sdks:java:io:kafka:cleanUp
Skipping task ':sdks:java:io:kafka:cleanUp' as it has no actions.
:sdks:java:io:kafka:cleanUp (Thread[Execution **** Thread 3,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:kafka:integrationTest'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PerformanceTests_Kafka_IO/ws/src/sdks/java/io/kafka/build/reports/tests/integrationTest/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 43m 6s
157 actionable tasks: 98 executed, 55 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/plvakduvmd3vq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org