You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/09/05 14:52:51 UTC
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #6557
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/6557/display/redirect>
Changes:
------------------------------------------
[...truncated 2.52 MB...]
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/dd1a0a258fc5b3c52b7e78a89ece6b56dfd5efb140a748c936a91fc2812a0430/1-go-/tmp/worker-13-1662389557346430923"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/05 14:52:42 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/05 14:52:42 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/05 14:52:42 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 41bd6c5f38924a483f6b1035d3515f090e36ea15421acf0ce335b09dafd5df85. Logs:
2022/09/05 14:52:42 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-377"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:38481"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test30869"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test30869"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0377-jenkins-0905145239-4c35b4e6"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:46171"} artifact_endpoint:{url:"localhost:39477"} control_endpoint:{url:"localhost:41711"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/dd1a0a258fc5b3c52b7e78a89ece6b56dfd5efb140a748c936a91fc2812a0430/1-go-/tmp/worker-13-1662389557346430923" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/05 14:52:42 Initializing Go harness: /opt/apache/beam/boot --id=268-1 --provision_endpoint=localhost:39137
2022/09/05 14:52:42 Downloaded: /tmp/staged/1-worker-13-1662389557346430923 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/05 14:52:42 control response channel closed
22/09/05 14:52:43 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/05 14:52:43 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/05 14:52:44 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/05 14:52:44 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 269-1
22/09/05 14:52:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:40905 for control ...
22/09/05 14:52:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:42069 for logging ...
22/09/05 14:52:44 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 269-2
22/09/05 14:52:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:34461 for data ...
22/09/05 14:52:44 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/05 14:52:44 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/dd1a0a258fc5b3c52b7e78a89ece6b56dfd5efb140a748c936a91fc2812a0430/1-go-/tmp/worker-13-1662389557346430923"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/05 14:52:44 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/05 14:52:44 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/05 14:52:44 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 4cd53e920f4542e5992204fc867b056a71b33dedb97e3431394104253edbc7d5. Logs:
2022/09/05 14:52:43 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-377"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:38481"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test30869"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test30869"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0377-jenkins-0905145239-4c35b4e6"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:42069"} artifact_endpoint:{url:"localhost:38295"} control_endpoint:{url:"localhost:40905"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/dd1a0a258fc5b3c52b7e78a89ece6b56dfd5efb140a748c936a91fc2812a0430/1-go-/tmp/worker-13-1662389557346430923" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/05 14:52:43 Initializing Go harness: /opt/apache/beam/boot --id=269-1 --provision_endpoint=localhost:45151
2022/09/05 14:52:43 Downloaded: /tmp/staged/1-worker-13-1662389557346430923 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/05 14:52:44 control response channel closed
22/09/05 14:52:44 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/05 14:52:45 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/05 14:52:45 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/05 14:52:45 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 270-1
22/09/05 14:52:45 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:45957 for control ...
22/09/05 14:52:45 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:46605 for logging ...
22/09/05 14:52:45 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 270-2
22/09/05 14:52:45 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:33083 for data ...
22/09/05 14:52:45 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/05 14:52:45 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:46251 for state ...
22/09/05 14:52:45 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/dd1a0a258fc5b3c52b7e78a89ece6b56dfd5efb140a748c936a91fc2812a0430/1-go-/tmp/worker-13-1662389557346430923"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/05 14:52:45 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/05 14:52:45 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/05 14:52:45 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 7a6ef20d8cfc050003e9d51ed9a78ec82af15bf1d7d0aba5fb3398a9478ebcee. Logs:
2022/09/05 14:52:45 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-377"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:38481"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test30869"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test30869"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0377-jenkins-0905145239-4c35b4e6"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:46605"} artifact_endpoint:{url:"localhost:40207"} control_endpoint:{url:"localhost:45957"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/dd1a0a258fc5b3c52b7e78a89ece6b56dfd5efb140a748c936a91fc2812a0430/1-go-/tmp/worker-13-1662389557346430923" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/05 14:52:45 Initializing Go harness: /opt/apache/beam/boot --id=270-1 --provision_endpoint=localhost:33257
2022/09/05 14:52:45 Downloaded: /tmp/staged/1-worker-13-1662389557346430923 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/05 14:52:45 control response channel closed
22/09/05 14:52:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/05 14:52:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/05 14:52:46 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk0377-jenkins-0905145239-4c35b4e6_4770f1ff-ac66-454b-b516-43b3b9819b80: Pipeline translated successfully. Computing outputs
22/09/05 14:52:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/05 14:52:46 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/05 14:52:47 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 271-1
22/09/05 14:52:47 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/05 14:52:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:39191 for control ...
22/09/05 14:52:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:42695 for logging ...
22/09/05 14:52:47 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 271-2
22/09/05 14:52:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:34393 for data ...
22/09/05 14:52:47 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/05 14:52:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:42093 for state ...
22/09/05 14:52:47 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/dd1a0a258fc5b3c52b7e78a89ece6b56dfd5efb140a748c936a91fc2812a0430/1-go-/tmp/worker-13-1662389557346430923"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/05 14:52:47 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/05 14:52:47 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/05 14:52:47 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 3719d41d43e2a5fc5c88da99da3914e864a6ecf3d98fb246b7950496e1295cd3. Logs:
2022/09/05 14:52:47 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-377"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:38481"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test30869"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test30869"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0377-jenkins-0905145239-4c35b4e6"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:42695"} artifact_endpoint:{url:"localhost:33651"} control_endpoint:{url:"localhost:39191"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/dd1a0a258fc5b3c52b7e78a89ece6b56dfd5efb140a748c936a91fc2812a0430/1-go-/tmp/worker-13-1662389557346430923" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/05 14:52:47 Initializing Go harness: /opt/apache/beam/boot --id=271-1 --provision_endpoint=localhost:40485
2022/09/05 14:52:47 Downloaded: /tmp/staged/1-worker-13-1662389557346430923 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/05 14:52:47 control response channel closed
22/09/05 14:52:47 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk0377-jenkins-0905145239-4c35b4e6_4770f1ff-ac66-454b-b516-43b3b9819b80 finished.
22/09/05 14:52:47 WARN org.apache.beam.runners.jobsubmission.InMemoryJobService: Failed to remove job staging directory for token go-testemitpardoaftergbk-377_10178982-e8c4-4af5-a6d3-815550bd60fc.
java.io.FileNotFoundException: No files found for spec: /tmp/beam-artifact-staging/dd1a0a258fc5b3c52b7e78a89ece6b56dfd5efb140a748c936a91fc2812a0430/* in working directory <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/.>
at org.apache.beam.sdk.io.LocalFileSystem.matchOne(LocalFileSystem.java:307)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:105)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:98)
at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:124)
at org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:217)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$1.removeStagedArtifacts(ArtifactStagingService.java:180)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService.removeStagedArtifacts(ArtifactStagingService.java:115)
at org.apache.beam.runners.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:67)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:261)
at org.apache.beam.runners.jobsubmission.JobInvocation.setState(JobInvocation.java:249)
at org.apache.beam.runners.jobsubmission.JobInvocation.access$200(JobInvocation.java:51)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:115)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:101)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2022/09/05 14:52:47 Job state: DONE
22/09/05 14:52:47 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0testemitpardoaftergbk0377-jenkins-0905145239-4c35b4e6_4770f1ff-ac66-454b-b516-43b3b9819b80
22/09/05 14:52:47 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0testemitpardoaftergbk0377-jenkins-0905145239-4c35b4e6_4770f1ff-ac66-454b-b516-43b3b9819b80
--- PASS: TestEmitParDoAfterGBK (10.54s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/regression 112.688s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 1
$ exit 1
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 121
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 13m 23s
114 actionable tasks: 76 executed, 33 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/x42wky4w7hfey
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Go_VR_Spark #6562
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/6562/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #6561
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/6561/display/redirect?page=changes>
Changes:
[noreply] Allow users to pass classloader to dynamically load JDBC drivers.
[noreply] Fix withCheckStopReadingFn to not cause the pipeline to crash (#22962)
[noreply] Inference benchmark tests (#21738)
------------------------------------------
[...truncated 2.53 MB...]
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/9fb28019465e0ce5339060c5617a4319f696cfc18e13db766cdd9f2b35ef7516/1-go-/tmp/worker-13-1662476017647856611"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 14:53:42 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 14:53:42 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 14:53:42 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 7603aac2ae2e44a96f3fdfa53bf0ad45af4b0f7595c636125a9ac5ade734fb4d. Logs:
2022/09/06 14:53:42 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-287"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:49287"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test25000"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test25000"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0287-jenkins-0906145339-e668d96e"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:41911"} artifact_endpoint:{url:"localhost:33337"} control_endpoint:{url:"localhost:34083"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/9fb28019465e0ce5339060c5617a4319f696cfc18e13db766cdd9f2b35ef7516/1-go-/tmp/worker-13-1662476017647856611" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 14:53:42 Initializing Go harness: /opt/apache/beam/boot --id=269-1 --provision_endpoint=localhost:36327
2022/09/06 14:53:42 Downloaded: /tmp/staged/1-worker-13-1662476017647856611 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/06 14:53:42 control response channel closed
22/09/06 14:53:43 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 14:53:43 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/06 14:53:44 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/06 14:53:44 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 270-1
22/09/06 14:53:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:35033 for control ...
22/09/06 14:53:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:46169 for logging ...
22/09/06 14:53:44 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 270-2
22/09/06 14:53:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:38335 for data ...
22/09/06 14:53:44 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 14:53:44 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/9fb28019465e0ce5339060c5617a4319f696cfc18e13db766cdd9f2b35ef7516/1-go-/tmp/worker-13-1662476017647856611"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 14:53:44 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 14:53:44 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 14:53:44 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 90b90f1252df1e871f8176664dcf074414af74badf91c9d33f1f5a02e8459958. Logs:
2022/09/06 14:53:44 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-287"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:49287"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test25000"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test25000"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0287-jenkins-0906145339-e668d96e"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:46169"} artifact_endpoint:{url:"localhost:45059"} control_endpoint:{url:"localhost:35033"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/9fb28019465e0ce5339060c5617a4319f696cfc18e13db766cdd9f2b35ef7516/1-go-/tmp/worker-13-1662476017647856611" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 14:53:44 Initializing Go harness: /opt/apache/beam/boot --id=270-1 --provision_endpoint=localhost:35657
2022/09/06 14:53:44 Downloaded: /tmp/staged/1-worker-13-1662476017647856611 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/06 14:53:44 control response channel closed
22/09/06 14:53:45 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 14:53:45 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/06 14:53:46 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/06 14:53:46 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 271-1
22/09/06 14:53:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:35787 for control ...
22/09/06 14:53:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:38407 for logging ...
22/09/06 14:53:46 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 271-2
22/09/06 14:53:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:44471 for data ...
22/09/06 14:53:46 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 14:53:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:39127 for state ...
22/09/06 14:53:46 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/9fb28019465e0ce5339060c5617a4319f696cfc18e13db766cdd9f2b35ef7516/1-go-/tmp/worker-13-1662476017647856611"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 14:53:46 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 14:53:46 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 14:53:46 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container ddf43f9c6e774b16d17b732ac684888da8a347a2e5b66951094a3d09f8be4823. Logs:
2022/09/06 14:53:45 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-287"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:49287"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test25000"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test25000"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0287-jenkins-0906145339-e668d96e"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:38407"} artifact_endpoint:{url:"localhost:36023"} control_endpoint:{url:"localhost:35787"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/9fb28019465e0ce5339060c5617a4319f696cfc18e13db766cdd9f2b35ef7516/1-go-/tmp/worker-13-1662476017647856611" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 14:53:45 Initializing Go harness: /opt/apache/beam/boot --id=271-1 --provision_endpoint=localhost:38867
2022/09/06 14:53:45 Downloaded: /tmp/staged/1-worker-13-1662476017647856611 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
2022/09/06 14:53:46 control response channel closed
Worker exited successfully!
22/09/06 14:53:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 14:53:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 14:53:46 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk0287-jenkins-0906145339-e668d96e_e67ae1dc-d465-471b-a90a-f9e1918411b3: Pipeline translated successfully. Computing outputs
22/09/06 14:53:46 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 14:53:47 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/06 14:53:47 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/06 14:53:47 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 272-1
22/09/06 14:53:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:36053 for control ...
22/09/06 14:53:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:42985 for logging ...
22/09/06 14:53:47 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 272-2
22/09/06 14:53:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:37511 for data ...
22/09/06 14:53:47 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 14:53:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:39329 for state ...
22/09/06 14:53:47 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/9fb28019465e0ce5339060c5617a4319f696cfc18e13db766cdd9f2b35ef7516/1-go-/tmp/worker-13-1662476017647856611"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 14:53:47 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 14:53:47 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 14:53:47 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 3a020084ecc871f81c10bb557cfe388d9e4924a6e9ef060d6472abfe9fd43588. Logs:
2022/09/06 14:53:47 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-287"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:49287"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test25000"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test25000"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0287-jenkins-0906145339-e668d96e"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:42985"} artifact_endpoint:{url:"localhost:33339"} control_endpoint:{url:"localhost:36053"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/9fb28019465e0ce5339060c5617a4319f696cfc18e13db766cdd9f2b35ef7516/1-go-/tmp/worker-13-1662476017647856611" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 14:53:47 Initializing Go harness: /opt/apache/beam/boot --id=272-1 --provision_endpoint=localhost:42791
2022/09/06 14:53:47 Downloaded: /tmp/staged/1-worker-13-1662476017647856611 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/06 14:53:47 control response channel closed
22/09/06 14:53:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk0287-jenkins-0906145339-e668d96e_e67ae1dc-d465-471b-a90a-f9e1918411b3 finished.
22/09/06 14:53:48 WARN org.apache.beam.runners.jobsubmission.InMemoryJobService: Failed to remove job staging directory for token go-testemitpardoaftergbk-287_85fad8e2-9030-45d4-aa24-1c8a61b78664.
java.io.FileNotFoundException: No files found for spec: /tmp/beam-artifact-staging/9fb28019465e0ce5339060c5617a4319f696cfc18e13db766cdd9f2b35ef7516/* in working directory <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/.>
at org.apache.beam.sdk.io.LocalFileSystem.matchOne(LocalFileSystem.java:307)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:105)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:98)
at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:124)
at org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:217)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$1.removeStagedArtifacts(ArtifactStagingService.java:180)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService.removeStagedArtifacts(ArtifactStagingService.java:115)
at org.apache.beam.runners.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:67)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:261)
at org.apache.beam.runners.jobsubmission.JobInvocation.setState(JobInvocation.java:249)
at org.apache.beam.runners.jobsubmission.JobInvocation.access$200(JobInvocation.java:51)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:115)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:101)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2022/09/06 14:53:48 Job state: DONE
22/09/06 14:53:48 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0testemitpardoaftergbk0287-jenkins-0906145339-e668d96e_e67ae1dc-d465-471b-a90a-f9e1918411b3
22/09/06 14:53:48 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0testemitpardoaftergbk0287-jenkins-0906145339-e668d96e_e67ae1dc-d465-471b-a90a-f9e1918411b3
--- PASS: TestEmitParDoAfterGBK (10.75s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/regression 118.539s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 1
$ exit 1
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 121
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 14m 23s
114 actionable tasks: 76 executed, 33 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/r2ocx4ghqrb7u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #6560
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/6560/display/redirect>
Changes:
------------------------------------------
[...truncated 2.51 MB...]
22/09/06 08:52:31 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:36363 for data ...
22/09/06 08:52:31 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 08:52:31 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/9efbf595c89e41b21d8fdb7ea4876e5adfd51056eaa9f7ac473f247e5e2ec35a/1-go-/tmp/worker-13-1662454347216129007"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 08:52:31 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 08:52:31 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 08:52:31 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container ce2798431da87303a1acdbc82f94db7b8d4c931fd487ddbe44895ed35dddc118. Logs:
2022/09/06 08:52:31 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-364"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:45367"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test9429"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test9429"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0364-jenkins-0906085228-85c8d52f"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:41077"} artifact_endpoint:{url:"localhost:38057"} control_endpoint:{url:"localhost:36173"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/9efbf595c89e41b21d8fdb7ea4876e5adfd51056eaa9f7ac473f247e5e2ec35a/1-go-/tmp/worker-13-1662454347216129007" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 08:52:31 Initializing Go harness: /opt/apache/beam/boot --id=268-1 --provision_endpoint=localhost:39747
2022/09/06 08:52:31 Downloaded: /tmp/staged/1-worker-13-1662454347216129007 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
2022/09/06 08:52:31 control response channel closed
Worker exited successfully!
22/09/06 08:52:32 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 08:52:33 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/06 08:52:33 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/06 08:52:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 269-1
22/09/06 08:52:33 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:40533 for control ...
22/09/06 08:52:33 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:38605 for logging ...
22/09/06 08:52:33 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 269-2
22/09/06 08:52:33 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:42043 for data ...
22/09/06 08:52:33 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 08:52:33 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/9efbf595c89e41b21d8fdb7ea4876e5adfd51056eaa9f7ac473f247e5e2ec35a/1-go-/tmp/worker-13-1662454347216129007"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 08:52:33 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 08:52:33 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 08:52:33 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 8967dccea9d601ea86a9b7617e4ed07d5f1e08a0ee78eb0d661dcd1f151ef1ca. Logs:
2022/09/06 08:52:33 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-364"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:45367"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test9429"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test9429"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0364-jenkins-0906085228-85c8d52f"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:38605"} artifact_endpoint:{url:"localhost:37755"} control_endpoint:{url:"localhost:40533"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/9efbf595c89e41b21d8fdb7ea4876e5adfd51056eaa9f7ac473f247e5e2ec35a/1-go-/tmp/worker-13-1662454347216129007" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 08:52:33 Initializing Go harness: /opt/apache/beam/boot --id=269-1 --provision_endpoint=localhost:43907
2022/09/06 08:52:33 Downloaded: /tmp/staged/1-worker-13-1662454347216129007 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/06 08:52:33 control response channel closed
22/09/06 08:52:34 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 08:52:34 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/06 08:52:35 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/06 08:52:35 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 270-1
22/09/06 08:52:35 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:42239 for control ...
22/09/06 08:52:35 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:39763 for logging ...
22/09/06 08:52:35 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 270-2
22/09/06 08:52:35 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:34185 for data ...
22/09/06 08:52:35 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 08:52:35 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:36513 for state ...
22/09/06 08:52:35 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/9efbf595c89e41b21d8fdb7ea4876e5adfd51056eaa9f7ac473f247e5e2ec35a/1-go-/tmp/worker-13-1662454347216129007"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 08:52:35 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 08:52:35 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 08:52:35 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 9b0b7550ddbcf5f25dcba2b75fc116bcb7cd1a45f1d405a8353c5083b56cfd8f. Logs:
2022/09/06 08:52:34 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-364"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:45367"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test9429"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test9429"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0364-jenkins-0906085228-85c8d52f"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:39763"} artifact_endpoint:{url:"localhost:41955"} control_endpoint:{url:"localhost:42239"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/9efbf595c89e41b21d8fdb7ea4876e5adfd51056eaa9f7ac473f247e5e2ec35a/1-go-/tmp/worker-13-1662454347216129007" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 08:52:34 Initializing Go harness: /opt/apache/beam/boot --id=270-1 --provision_endpoint=localhost:35229
2022/09/06 08:52:35 Downloaded: /tmp/staged/1-worker-13-1662454347216129007 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/06 08:52:35 control response channel closed
22/09/06 08:52:35 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 08:52:35 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 08:52:35 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk0364-jenkins-0906085228-85c8d52f_058bcd1a-a18f-4d3d-811b-0a2713f87418: Pipeline translated successfully. Computing outputs
22/09/06 08:52:35 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 08:52:36 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/06 08:52:36 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/06 08:52:36 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 271-1
22/09/06 08:52:36 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:34173 for control ...
22/09/06 08:52:36 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:34777 for logging ...
22/09/06 08:52:36 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 271-2
22/09/06 08:52:36 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:39685 for data ...
22/09/06 08:52:36 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 08:52:36 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:34659 for state ...
22/09/06 08:52:36 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/9efbf595c89e41b21d8fdb7ea4876e5adfd51056eaa9f7ac473f247e5e2ec35a/1-go-/tmp/worker-13-1662454347216129007"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 08:52:36 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 08:52:36 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 08:52:36 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 5bf2d0596fc68de76d299d2ea9960c43cf8b25e764c1ef224170e8fb9fc2178a. Logs:
2022/09/06 08:52:36 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-364"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:45367"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test9429"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test9429"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0364-jenkins-0906085228-85c8d52f"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:34777"} artifact_endpoint:{url:"localhost:34713"} control_endpoint:{url:"localhost:34173"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/9efbf595c89e41b21d8fdb7ea4876e5adfd51056eaa9f7ac473f247e5e2ec35a/1-go-/tmp/worker-13-1662454347216129007" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 08:52:36 Initializing Go harness: /opt/apache/beam/boot --id=271-1 --provision_endpoint=localhost:37513
2022/09/06 08:52:36 Downloaded: /tmp/staged/1-worker-13-1662454347216129007 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/06 08:52:36 control response channel closed
22/09/06 08:52:37 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk0364-jenkins-0906085228-85c8d52f_058bcd1a-a18f-4d3d-811b-0a2713f87418 finished.
22/09/06 08:52:37 WARN org.apache.beam.runners.jobsubmission.InMemoryJobService: Failed to remove job staging directory for token go-testemitpardoaftergbk-364_13d08690-4c83-44ba-9f44-728df1bc8ad7.
java.io.FileNotFoundException: No files found for spec: /tmp/beam-artifact-staging/9efbf595c89e41b21d8fdb7ea4876e5adfd51056eaa9f7ac473f247e5e2ec35a/* in working directory <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/.>
at org.apache.beam.sdk.io.LocalFileSystem.matchOne(LocalFileSystem.java:307)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:105)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:98)
at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:124)
at org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:217)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$1.removeStagedArtifacts(ArtifactStagingService.java:180)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService.removeStagedArtifacts(ArtifactStagingService.java:115)
at org.apache.beam.runners.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:67)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:261)
at org.apache.beam.runners.jobsubmission.JobInvocation.setState(JobInvocation.java:249)
at org.apache.beam.runners.jobsubmission.JobInvocation.access$200(JobInvocation.java:51)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:115)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:101)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2022/09/06 08:52:37 Job state: DONE
22/09/06 08:52:37 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0testemitpardoaftergbk0364-jenkins-0906085228-85c8d52f_058bcd1a-a18f-4d3d-811b-0a2713f87418
22/09/06 08:52:37 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0testemitpardoaftergbk0364-jenkins-0906085228-85c8d52f_058bcd1a-a18f-4d3d-811b-0a2713f87418
--- PASS: TestEmitParDoAfterGBK (10.13s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/regression 113.200s
FAIL
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 121
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 13m 11s
114 actionable tasks: 76 executed, 33 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/sblgbckp7mmui
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #6559
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/6559/display/redirect?page=changes>
Changes:
[noreply] Revert "Remove subprocess.PIPE usage by using a temp file (#22654)"
------------------------------------------
[...truncated 2.51 MB...]
22/09/06 02:52:18 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:37303 for data ...
22/09/06 02:52:18 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 02:52:18 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/a58f0f22a3eb62594eaa75a26e8cbbe6abe4c98cb976fd628b495b49f356af38/1-go-/tmp/worker-13-1662432733696659296"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 02:52:18 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 02:52:18 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 02:52:18 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 089f0955bc7c1198ccfa3489d0efe8e071681c8213beaa8fe2a2049b2bd0ccdf. Logs:
2022/09/06 02:52:18 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-587"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:42407"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test17976"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test17976"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0587-jenkins-0906025215-9e7b9c88"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:38325"} artifact_endpoint:{url:"localhost:34659"} control_endpoint:{url:"localhost:45385"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/a58f0f22a3eb62594eaa75a26e8cbbe6abe4c98cb976fd628b495b49f356af38/1-go-/tmp/worker-13-1662432733696659296" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 02:52:18 Initializing Go harness: /opt/apache/beam/boot --id=268-1 --provision_endpoint=localhost:41937
2022/09/06 02:52:18 Downloaded: /tmp/staged/1-worker-13-1662432733696659296 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/06 02:52:18 control response channel closed
22/09/06 02:52:19 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 02:52:19 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/06 02:52:19 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 269-1
22/09/06 02:52:19 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/06 02:52:19 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:39193 for control ...
22/09/06 02:52:19 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:46737 for logging ...
22/09/06 02:52:19 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 269-2
22/09/06 02:52:19 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:46471 for data ...
22/09/06 02:52:19 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 02:52:20 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/a58f0f22a3eb62594eaa75a26e8cbbe6abe4c98cb976fd628b495b49f356af38/1-go-/tmp/worker-13-1662432733696659296"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 02:52:20 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 02:52:20 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 02:52:20 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 9b1a523a58cee99876160531ca3b2f0bd06c7b110f3e691a71079bb982834f6c. Logs:
2022/09/06 02:52:19 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-587"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:42407"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test17976"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test17976"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0587-jenkins-0906025215-9e7b9c88"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:46737"} artifact_endpoint:{url:"localhost:42395"} control_endpoint:{url:"localhost:39193"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/a58f0f22a3eb62594eaa75a26e8cbbe6abe4c98cb976fd628b495b49f356af38/1-go-/tmp/worker-13-1662432733696659296" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 02:52:19 Initializing Go harness: /opt/apache/beam/boot --id=269-1 --provision_endpoint=localhost:37841
2022/09/06 02:52:19 Downloaded: /tmp/staged/1-worker-13-1662432733696659296 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
2022/09/06 02:52:20 control response channel closed
Worker exited successfully!
22/09/06 02:52:20 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 02:52:21 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/06 02:52:21 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/06 02:52:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 270-1
22/09/06 02:52:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:36591 for control ...
22/09/06 02:52:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:45735 for logging ...
22/09/06 02:52:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 270-2
22/09/06 02:52:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:41647 for data ...
22/09/06 02:52:21 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 02:52:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:33841 for state ...
22/09/06 02:52:21 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/a58f0f22a3eb62594eaa75a26e8cbbe6abe4c98cb976fd628b495b49f356af38/1-go-/tmp/worker-13-1662432733696659296"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 02:52:21 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 02:52:21 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 02:52:21 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 72ec38a87b8825132e34ac70d6de656629b5b41efa7d51d3f6a2ee7200cc3fb4. Logs:
2022/09/06 02:52:21 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-587"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:42407"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test17976"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test17976"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0587-jenkins-0906025215-9e7b9c88"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:45735"} artifact_endpoint:{url:"localhost:42721"} control_endpoint:{url:"localhost:36591"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/a58f0f22a3eb62594eaa75a26e8cbbe6abe4c98cb976fd628b495b49f356af38/1-go-/tmp/worker-13-1662432733696659296" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 02:52:21 Initializing Go harness: /opt/apache/beam/boot --id=270-1 --provision_endpoint=localhost:36725
2022/09/06 02:52:21 Downloaded: /tmp/staged/1-worker-13-1662432733696659296 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/06 02:52:21 control response channel closed
22/09/06 02:52:22 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 02:52:22 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 02:52:22 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk0587-jenkins-0906025215-9e7b9c88_09ea6193-9180-4679-a49c-c0c4d6e227d8: Pipeline translated successfully. Computing outputs
22/09/06 02:52:22 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/06 02:52:22 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/06 02:52:23 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/06 02:52:23 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 271-1
22/09/06 02:52:23 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:41063 for control ...
22/09/06 02:52:23 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:33711 for logging ...
22/09/06 02:52:23 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 271-2
22/09/06 02:52:23 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:37813 for data ...
22/09/06 02:52:23 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/06 02:52:23 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:33155 for state ...
22/09/06 02:52:23 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/a58f0f22a3eb62594eaa75a26e8cbbe6abe4c98cb976fd628b495b49f356af38/1-go-/tmp/worker-13-1662432733696659296"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/06 02:52:23 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/06 02:52:23 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/06 02:52:23 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 08af0a262c51c323c335b8ff6d801d0853c10a996f1156fceb47b873a1cb18d7. Logs:
2022/09/06 02:52:22 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-587"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:42407"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test17976"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test17976"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0587-jenkins-0906025215-9e7b9c88"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:33711"} artifact_endpoint:{url:"localhost:36637"} control_endpoint:{url:"localhost:41063"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/a58f0f22a3eb62594eaa75a26e8cbbe6abe4c98cb976fd628b495b49f356af38/1-go-/tmp/worker-13-1662432733696659296" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/06 02:52:22 Initializing Go harness: /opt/apache/beam/boot --id=271-1 --provision_endpoint=localhost:35295
2022/09/06 02:52:23 Downloaded: /tmp/staged/1-worker-13-1662432733696659296 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/06 02:52:23 control response channel closed
22/09/06 02:52:23 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk0587-jenkins-0906025215-9e7b9c88_09ea6193-9180-4679-a49c-c0c4d6e227d8 finished.
22/09/06 02:52:23 WARN org.apache.beam.runners.jobsubmission.InMemoryJobService: Failed to remove job staging directory for token go-testemitpardoaftergbk-587_14e83645-4aa4-49ca-8ba4-ba936bd2ab70.
java.io.FileNotFoundException: No files found for spec: /tmp/beam-artifact-staging/a58f0f22a3eb62594eaa75a26e8cbbe6abe4c98cb976fd628b495b49f356af38/* in working directory <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/.>
at org.apache.beam.sdk.io.LocalFileSystem.matchOne(LocalFileSystem.java:307)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:105)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:98)
at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:124)
at org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:217)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$1.removeStagedArtifacts(ArtifactStagingService.java:180)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService.removeStagedArtifacts(ArtifactStagingService.java:115)
at org.apache.beam.runners.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:67)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:261)
at org.apache.beam.runners.jobsubmission.JobInvocation.setState(JobInvocation.java:249)
at org.apache.beam.runners.jobsubmission.JobInvocation.access$200(JobInvocation.java:51)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:115)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:101)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2022/09/06 02:52:23 Job state: DONE
22/09/06 02:52:23 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0testemitpardoaftergbk0587-jenkins-0906025215-9e7b9c88_09ea6193-9180-4679-a49c-c0c4d6e227d8
22/09/06 02:52:23 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0testemitpardoaftergbk0587-jenkins-0906025215-9e7b9c88_09ea6193-9180-4679-a49c-c0c4d6e227d8
--- PASS: TestEmitParDoAfterGBK (10.15s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/regression 111.684s
FAIL
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 121
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 12m 58s
114 actionable tasks: 76 executed, 33 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/ewx266dyubhhe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #6558
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/6558/display/redirect>
Changes:
------------------------------------------
[...truncated 2.52 MB...]
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/f951987054cb3b26fca95e75aac3c51b6c55fd89288b22c37d1fd28647a14afe/1-go-/tmp/worker-13-1662411133563470709"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/05 20:52:18 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/05 20:52:18 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/05 20:52:18 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 4796b0225fd81c62f9e9568dfcbf3dcba5cf9cb025e3179539532dc522fe7e40. Logs:
2022/09/05 20:52:18 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-837"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:42093"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test1422"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test1422"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0837-jenkins-0905205215-78a40901"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:38181"} artifact_endpoint:{url:"localhost:42765"} control_endpoint:{url:"localhost:33873"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/f951987054cb3b26fca95e75aac3c51b6c55fd89288b22c37d1fd28647a14afe/1-go-/tmp/worker-13-1662411133563470709" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/05 20:52:18 Initializing Go harness: /opt/apache/beam/boot --id=268-1 --provision_endpoint=localhost:36169
2022/09/05 20:52:18 Downloaded: /tmp/staged/1-worker-13-1662411133563470709 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/05 20:52:18 control response channel closed
22/09/05 20:52:18 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/05 20:52:19 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/05 20:52:19 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/05 20:52:19 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 269-1
22/09/05 20:52:19 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:39499 for control ...
22/09/05 20:52:19 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:45921 for logging ...
22/09/05 20:52:19 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 269-2
22/09/05 20:52:19 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:34613 for data ...
22/09/05 20:52:19 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/05 20:52:19 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/f951987054cb3b26fca95e75aac3c51b6c55fd89288b22c37d1fd28647a14afe/1-go-/tmp/worker-13-1662411133563470709"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/05 20:52:19 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/05 20:52:19 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/05 20:52:20 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container ae60f250a13fdddc14915fdda7008cfd8d7e21976cf10cd894d4ee53fa6c414f. Logs:
2022/09/05 20:52:19 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-837"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:42093"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test1422"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test1422"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0837-jenkins-0905205215-78a40901"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:45921"} artifact_endpoint:{url:"localhost:46199"} control_endpoint:{url:"localhost:39499"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/f951987054cb3b26fca95e75aac3c51b6c55fd89288b22c37d1fd28647a14afe/1-go-/tmp/worker-13-1662411133563470709" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/05 20:52:19 Initializing Go harness: /opt/apache/beam/boot --id=269-1 --provision_endpoint=localhost:37167
2022/09/05 20:52:19 Downloaded: /tmp/staged/1-worker-13-1662411133563470709 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
2022/09/05 20:52:19 control response channel closed
Worker exited successfully!
22/09/05 20:52:20 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/05 20:52:21 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/05 20:52:21 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/05 20:52:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 270-1
22/09/05 20:52:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:41941 for control ...
22/09/05 20:52:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:33587 for logging ...
22/09/05 20:52:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 270-2
22/09/05 20:52:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:37769 for data ...
22/09/05 20:52:21 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/05 20:52:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:40135 for state ...
22/09/05 20:52:21 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/f951987054cb3b26fca95e75aac3c51b6c55fd89288b22c37d1fd28647a14afe/1-go-/tmp/worker-13-1662411133563470709"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/05 20:52:21 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/05 20:52:21 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/05 20:52:21 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container b3fb59fb56f02683890a705168eb67114ffc85e6db13836036b9e4c0e677aa43. Logs:
2022/09/05 20:52:21 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-837"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:42093"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test1422"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test1422"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0837-jenkins-0905205215-78a40901"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:33587"} artifact_endpoint:{url:"localhost:37473"} control_endpoint:{url:"localhost:41941"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/f951987054cb3b26fca95e75aac3c51b6c55fd89288b22c37d1fd28647a14afe/1-go-/tmp/worker-13-1662411133563470709" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/05 20:52:21 Initializing Go harness: /opt/apache/beam/boot --id=270-1 --provision_endpoint=localhost:38751
2022/09/05 20:52:21 Downloaded: /tmp/staged/1-worker-13-1662411133563470709 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/05 20:52:21 control response channel closed
22/09/05 20:52:22 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/05 20:52:22 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/05 20:52:22 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk0837-jenkins-0905205215-78a40901_3eb4bbea-aa63-49e1-b0fe-2dfb63971f7d: Pipeline translated successfully. Computing outputs
22/09/05 20:52:22 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/09/05 20:52:22 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/09/05 20:52:23 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 271-1
22/09/05 20:52:23 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/09/05 20:52:23 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:44695 for control ...
22/09/05 20:52:23 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:36305 for logging ...
22/09/05 20:52:23 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 271-2
22/09/05 20:52:23 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:33859 for data ...
22/09/05 20:52:23 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/09/05 20:52:23 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:677: Connecting via grpc @ localhost:36651 for state ...
22/09/05 20:52:23 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v1"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:protocol:monitoring_info_short_ids:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\203\001/tmp/beam-artifact-staging/f951987054cb3b26fca95e75aac3c51b6c55fd89288b22c37d1fd28647a14afe/1-go-/tmp/worker-13-1662411133563470709"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/09/05 20:52:23 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/09/05 20:52:23 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/09/05 20:52:23 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 6f6d8ab9f80bab9a4ecb7115671304b335f6f01b48787401b0746e82031d7bfa. Logs:
2022/09/05 20:52:22 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk-837"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:42093"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"expansion_jar" value:{string_value:"[test:<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/java/testing/expansion-service/build/libs/beam-sdks-java-testing-expansion-service-testExpansionService-2.42.0-SNAPSHOT.jar]"}}> fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test1422"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test1422"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"3h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk0837-jenkins-0905205215-78a40901"}} fields:{key:"beam:option:options_id:v1" value:{number_value:39}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:36305"} artifact_endpoint:{url:"localhost:35857"} control_endpoint:{url:"localhost:44695"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x83\x01/tmp/beam-artifact-staging/f951987054cb3b26fca95e75aac3c51b6c55fd89288b22c37d1fd28647a14afe/1-go-/tmp/worker-13-1662411133563470709" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/09/05 20:52:22 Initializing Go harness: /opt/apache/beam/boot --id=271-1 --provision_endpoint=localhost:40335
2022/09/05 20:52:23 Downloaded: /tmp/staged/1-worker-13-1662411133563470709 (sha256: 32e87e6cd109bdea60539e1871231f60ab636c983a896ecdd7a6f12d232cc887, size: 26517776)
Error Setting Rlimit operation not permitted
Worker exited successfully!
2022/09/05 20:52:23 control response channel closed
22/09/05 20:52:23 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk0837-jenkins-0905205215-78a40901_3eb4bbea-aa63-49e1-b0fe-2dfb63971f7d finished.
22/09/05 20:52:23 WARN org.apache.beam.runners.jobsubmission.InMemoryJobService: Failed to remove job staging directory for token go-testemitpardoaftergbk-837_a47956d0-41e9-4915-a389-e0db84478399.
java.io.FileNotFoundException: No files found for spec: /tmp/beam-artifact-staging/f951987054cb3b26fca95e75aac3c51b6c55fd89288b22c37d1fd28647a14afe/* in working directory <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/.>
at org.apache.beam.sdk.io.LocalFileSystem.matchOne(LocalFileSystem.java:307)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:105)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:98)
at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:124)
at org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:217)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$1.removeStagedArtifacts(ArtifactStagingService.java:180)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService.removeStagedArtifacts(ArtifactStagingService.java:115)
at org.apache.beam.runners.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:67)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:261)
at org.apache.beam.runners.jobsubmission.JobInvocation.setState(JobInvocation.java:249)
at org.apache.beam.runners.jobsubmission.JobInvocation.access$200(JobInvocation.java:51)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:115)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:101)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
2022/09/05 20:52:23 Job state: DONE
22/09/05 20:52:23 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0testemitpardoaftergbk0837-jenkins-0905205215-78a40901_3eb4bbea-aa63-49e1-b0fe-2dfb63971f7d
22/09/05 20:52:23 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0testemitpardoaftergbk0837-jenkins-0905205215-78a40901_3eb4bbea-aa63-49e1-b0fe-2dfb63971f7d
--- PASS: TestEmitParDoAfterGBK (10.22s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/regression 111.500s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 1
$ exit 1
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 121
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 12m 58s
114 actionable tasks: 76 executed, 33 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/uzhlgdpna3tnw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org