You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/03/01 04:40:53 UTC
Build failed in Jenkins: beam_PreCommit_Portable_Python_Cron #6141
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6141/display/redirect>
Changes:
------------------------------------------
[...truncated 2.34 MB...]
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:data_channel:read_index:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AQ==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/read/ref_PCollection_PCollection_1:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "ref_AppliedPTransform_Read-Read-SDFBoundedSourceReader-ParDo-SDFBoundedSourceDoFn-_7/PairWithRestriction0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:element_count:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AQ==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_2"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "ref_AppliedPTransform_Read-Read-Map-lambda-at-iobase-py-908-_5"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/read/ref_PCollection_PCollection_1:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:element_count:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AQ==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_1"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:sum_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PTRANSFORM": "fn/write/ref_PCollection_PCollection_2/SplitAndSize0:0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:sampled_byte_size:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:distribution_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AYkEiQSJBA==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_2"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:sampled_byte_size:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:distribution_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AYoJigmKCQ==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_2/SplitAndSize0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:sampled_byte_size:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:distribution_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "AQ0NDQ==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_1"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }, {
INFO:apache_beam.utils.subprocess_server: "urn": "beam:metric:sampled_byte_size:v1",
INFO:apache_beam.utils.subprocess_server: "type": "beam:metrics:distribution_int64:v1",
INFO:apache_beam.utils.subprocess_server: "payload": "Ae4K7gruCg==",
INFO:apache_beam.utils.subprocess_server: "labels": {
INFO:apache_beam.utils.subprocess_server: "PCOLLECTION": "ref_PCollection_PCollection_2/PairWithRestriction0"
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server: }]
INFO:apache_beam.utils.subprocess_server: }
INFO:apache_beam.utils.subprocess_server:}
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:44 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO:apache_beam.utils.subprocess_server:INFO: Stopping Akka RPC service.
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:44 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO:apache_beam.utils.subprocess_server:INFO: Stopped Akka RPC service.
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:44 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO:apache_beam.utils.subprocess_server:INFO: Shutting down BLOB cache
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:44 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO:apache_beam.utils.subprocess_server:INFO: Shutting down BLOB cache
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:44 AM org.apache.flink.runtime.blob.BlobServer close
INFO:apache_beam.utils.subprocess_server:INFO: Stopped BLOB server at 0.0.0.0:36341
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:44 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO:apache_beam.utils.subprocess_server:INFO: Stopped Akka RPC service.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
Exception in thread read_state:
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
Exception in thread run_worker_1-1:
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
self.run()
self.run()
File "/usr/lib/python3.10/threading.py", line 946, in run
File "/usr/lib/python3.10/threading.py", line 946, in run
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43251 {grpc_message:"Socket closed", grpc_status:14, created_time:"2023-03-01T04:40:44.841033572+00:00"}"
>
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",> line 1034, in pull_responses
Exception in thread read_grpc_client_inputs:
self._target(*self._args, **self._kwargs)
Traceback (most recent call last):
File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/runners/worker/sdk_worker.py",> line 259, in run
for response in responses:
self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
for work_request in self._control_stub.Control(get_responses()):
File "/usr/lib/python3.10/threading.py", line 946, in run
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
return self._next()
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
return self._next()
raise self
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
target=lambda: self._read_inputs(elements_iterator),
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42015 {created_time:"2023-03-01T04:40:44.841035825+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40137 {created_time:"2023-03-01T04:40:44.841038683+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43251 {grpc_message:"Socket closed", grpc_status:14, created_time:"2023-03-01T04:40:44.841033572+00:00"}"
>
> Task :sdks:python:test-suites:portable:py310:portableWordCountFlinkRunnerStreaming
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:38289
INFO:root:Default Python SDK image for environment is apache/beam_python3.10_sdk:2.47.0.dev
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.47.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-temp9e_prxdu/artifactsx84txgww' '--job-port' '38919' '--artifact-port' '0' '--expansion-port' '0']
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:49 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO:apache_beam.utils.subprocess_server:WARNING: Unable to retrieve the requested metadata.
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:50 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO:apache_beam.utils.subprocess_server:INFO: ArtifactStagingService started on localhost:38919
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:50 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO:apache_beam.utils.subprocess_server:INFO: Java ExpansionService started on localhost:46177
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:50 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO:apache_beam.utils.subprocess_server:WARNING: Exception during job server creation
INFO:apache_beam.utils.subprocess_server:java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:38919
INFO:apache_beam.utils.subprocess_server: at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.netty.NettyServer.start(NettyServer.java:328)
INFO:apache_beam.utils.subprocess_server: at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl.start(ServerImpl.java:183)
INFO:apache_beam.utils.subprocess_server: at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl.start(ServerImpl.java:92)
INFO:apache_beam.utils.subprocess_server: at org.apache.beam.sdk.fn.server.ServerFactory$InetSocketAddressServerFactory.createServer(ServerFactory.java:162)
INFO:apache_beam.utils.subprocess_server: at org.apache.beam.sdk.fn.server.ServerFactory$InetSocketAddressServerFactory.create(ServerFactory.java:145)
INFO:apache_beam.utils.subprocess_server: at org.apache.beam.sdk.fn.server.GrpcFnServer.create(GrpcFnServer.java:110)
INFO:apache_beam.utils.subprocess_server: at org.apache.beam.runners.jobsubmission.JobServerDriver.createJobServer(JobServerDriver.java:238)
INFO:apache_beam.utils.subprocess_server: at org.apache.beam.runners.jobsubmission.JobServerDriver.run(JobServerDriver.java:176)
INFO:apache_beam.utils.subprocess_server: at org.apache.beam.runners.flink.FlinkJobServerDriver.main(FlinkJobServerDriver.java:77)
INFO:apache_beam.utils.subprocess_server:Caused by: org.apache.beam.vendor.grpc.v1p48p1.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use
INFO:apache_beam.utils.subprocess_server:
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:50 AM org.apache.beam.runners.jobsubmission.JobServerDriver stop
INFO:apache_beam.utils.subprocess_server:INFO: ArtifactStagingServer stopped on localhost:38919
INFO:apache_beam.utils.subprocess_server:Mar 01, 2023 4:40:50 AM org.apache.beam.runners.jobsubmission.JobServerDriver stop
INFO:apache_beam.utils.subprocess_server:INFO: Expansion stopped on localhost:46177
ERROR:apache_beam.utils.subprocess_server:Starting job service with ['java', '-jar', '<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.47.0-SNAPSHOT.jar',> '--flink-master', '[auto]', '--artifacts-dir', '/tmp/beam-temp9e_prxdu/artifactsx84txgww', '--job-port', '38919', '--artifact-port', '0', '--expansion-port', '0']
ERROR:apache_beam.utils.subprocess_server:Error bringing up service
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/utils/subprocess_server.py",> line 88, in start
raise RuntimeError(
RuntimeError: Service failed to start up with error 0
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
exec(code, run_globals)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/examples/wordcount.py",> line 111, in <module>
run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/examples/wordcount.py",> line 87, in run
with beam.Pipeline(options=pipeline_options) as p:
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/pipeline.py",> line 600, in __exit__
self.result = self.run()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/pipeline.py",> line 577, in run
return self.runner.run_pipeline(self, self._options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/runners/portability/flink_runner.py",> line 45, in run_pipeline
return super().run_pipeline(pipeline, options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/runners/portability/portable_runner.py",> line 446, in run_pipeline
job_service_handle = self.create_job_service(options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/runners/portability/portable_runner.py",> line 320, in create_job_service
return self.create_job_service_handle(server.start(), options)
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/runners/portability/job_server.py",> line 81, in start
self._endpoint = self._job_server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/runners/portability/job_server.py",> line 110, in start
return self._server.start()
File "<https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apache_beam/utils/subprocess_server.py",> line 88, in start
raise RuntimeError(
RuntimeError: Service failed to start up with error 0
> Task :sdks:python:test-suites:portable:py310:portableWordCountFlinkRunnerStreaming FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:portableWordCountFlinkRunnerStreaming'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 7s
143 actionable tasks: 15 executed, 128 up-to-date
Publishing build scan...
https://gradle.com/s/cgf26cyps3a7q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PreCommit_Portable_Python_Cron #6142
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Portable_Python_Cron/6142/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org