You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/03/15 00:10:43 UTC
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #5857
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/5857/display/redirect?page=changes>
Changes:
[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test
[benjamin.gonzalez] [BEAM-12572] Add DistinctExample test
[benjamin.gonzalez] [BEAM-12572] Add java examples tests
[benjamin.gonzalez] [BEAM-12572] Change tests collected by runner
[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions, skip tests for specific runners
[benjamin.gonzalez] [BEAM-12572] Skip failing tests
[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warnings
[benjamin.gonzalez] [BEAM-12572] Skip tfidf tests on direct runner
[benjamin.gonzalez] [BEAM-12572] Fix PipelineOptions
[benjamin.gonzalez] [BEAM-12572] Fix checkstyle warning
[benjamin.gonzalez] [BEAM-12572] Enable test with Pipeline serialization error fixed, link
[benjamin.gonzalez] [BEAM-12572] Sickbay TfIdf test for DirectRunner
[benjamin.gonzalez] [BEAM-12572] Refactor naming for BigQueryClient
[mmack] [adhoc] Update owners for aws modules
[noreply] Merge pull request #17000 from [BEAM-13881] [Playground] Increase test
[noreply] Add deterministic dict coding via key sorting. (#17037)
[noreply] Merge pull request #17054 from [BEAM-14075] [SnowflakeIO] Change a
------------------------------------------
[...truncated 1.44 MB...]
22/03/15 00:10:34 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/03/15 00:10:34 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container f77529d150a03f30c3c007ad3de574d4eb72a772fecc8a3f1d013e82f5294ca8. Logs:
2022/03/15 00:10:34 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:50185"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"2h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}} fields:{key:"test_expansion_addr" value:{string_value:"localhost:52859"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk-jenkins-0315001033-e923c9b9"}} fields:{key:"beam:option:options_id:v1" value:{number_value:26}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:35133"} artifact_endpoint:{url:"localhost:34719"} control_endpoint:{url:"localhost:40931"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x82\x01/tmp/beam-artifact-staging/bde7bb05f8359fe9e34f55ade7a294bdb179e0c632e9256015df7d0492ae3512/1-go-/tmp/worker-7-1647303031544986621" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/03/15 00:10:34 Initializing Go harness: /opt/apache/beam/boot --id=150-1 --provision_endpoint=localhost:35595
2022/03/15 00:10:34 Downloaded: /tmp/staged/1-worker-7-1647303031544986621 (sha256: de173c6ab6e215dac75820f0e5a3ec68d4feaecb0e26ea7b3b8cf3a166e0bd5c, size: 22879009)
Worker exited successfully!
2022/03/15 00:10:34 control response channel closed
Remote logging shutting down.
22/03/15 00:10:35 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/03/15 00:10:35 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/03/15 00:10:36 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 151-1
22/03/15 00:10:36 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/03/15 00:10:36 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:45521 ...
22/03/15 00:10:36 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:42129 ...
22/03/15 00:10:36 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 151-2
22/03/15 00:10:36 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:34289 ...
22/03/15 00:10:36 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/03/15 00:10:36 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\202\001/tmp/beam-artifact-staging/bde7bb05f8359fe9e34f55ade7a294bdb179e0c632e9256015df7d0492ae3512/1-go-/tmp/worker-7-1647303031544986621"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/03/15 00:10:36 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/03/15 00:10:36 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/03/15 00:10:36 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 45a130949f52a0fd75ec29b3184074ea9a0032ad3298bebd352c354c54a0a28f. Logs:
2022/03/15 00:10:35 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:50185"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"2h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}} fields:{key:"test_expansion_addr" value:{string_value:"localhost:52859"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk-jenkins-0315001033-e923c9b9"}} fields:{key:"beam:option:options_id:v1" value:{number_value:26}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:42129"} artifact_endpoint:{url:"localhost:41121"} control_endpoint:{url:"localhost:45521"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x82\x01/tmp/beam-artifact-staging/bde7bb05f8359fe9e34f55ade7a294bdb179e0c632e9256015df7d0492ae3512/1-go-/tmp/worker-7-1647303031544986621" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/03/15 00:10:35 Initializing Go harness: /opt/apache/beam/boot --id=151-1 --provision_endpoint=localhost:46401
2022/03/15 00:10:36 Downloaded: /tmp/staged/1-worker-7-1647303031544986621 (sha256: de173c6ab6e215dac75820f0e5a3ec68d4feaecb0e26ea7b3b8cf3a166e0bd5c, size: 22879009)
Worker exited successfully!
2022/03/15 00:10:36 control response channel closed
Remote logging shutting down.
22/03/15 00:10:36 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/03/15 00:10:37 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/03/15 00:10:37 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/03/15 00:10:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 152-1
22/03/15 00:10:37 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:42925 ...
22/03/15 00:10:37 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:41247 ...
22/03/15 00:10:37 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 152-2
22/03/15 00:10:37 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:42575 ...
22/03/15 00:10:37 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/03/15 00:10:37 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\202\001/tmp/beam-artifact-staging/bde7bb05f8359fe9e34f55ade7a294bdb179e0c632e9256015df7d0492ae3512/1-go-/tmp/worker-7-1647303031544986621"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/03/15 00:10:37 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/03/15 00:10:37 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/03/15 00:10:37 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 6e61dc86b8bb41326e2f86c03fe05e9cd7a334a5fbedf829778a8d49dbf02161. Logs:
2022/03/15 00:10:37 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:50185"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"2h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}} fields:{key:"test_expansion_addr" value:{string_value:"localhost:52859"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk-jenkins-0315001033-e923c9b9"}} fields:{key:"beam:option:options_id:v1" value:{number_value:26}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:41247"} artifact_endpoint:{url:"localhost:36399"} control_endpoint:{url:"localhost:42925"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x82\x01/tmp/beam-artifact-staging/bde7bb05f8359fe9e34f55ade7a294bdb179e0c632e9256015df7d0492ae3512/1-go-/tmp/worker-7-1647303031544986621" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/03/15 00:10:37 Initializing Go harness: /opt/apache/beam/boot --id=152-1 --provision_endpoint=localhost:32869
2022/03/15 00:10:37 Downloaded: /tmp/staged/1-worker-7-1647303031544986621 (sha256: de173c6ab6e215dac75820f0e5a3ec68d4feaecb0e26ea7b3b8cf3a166e0bd5c, size: 22879009)
2022/03/15 00:10:37 control response channel closed
Remote logging shutting down.
Worker exited successfully!
22/03/15 00:10:38 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/03/15 00:10:38 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/03/15 00:10:39 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 153-1
22/03/15 00:10:39 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/03/15 00:10:39 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:39797 ...
22/03/15 00:10:39 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:44443 ...
22/03/15 00:10:39 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 153-2
22/03/15 00:10:39 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:37839 ...
22/03/15 00:10:39 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/03/15 00:10:39 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:43687 ...
22/03/15 00:10:39 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\202\001/tmp/beam-artifact-staging/bde7bb05f8359fe9e34f55ade7a294bdb179e0c632e9256015df7d0492ae3512/1-go-/tmp/worker-7-1647303031544986621"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/03/15 00:10:39 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/03/15 00:10:39 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/03/15 00:10:39 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container a233bf8f62d3dd8519858580814231816b6591c97f183be373850803f52ca3e1. Logs:
2022/03/15 00:10:38 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:50185"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"2h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}} fields:{key:"test_expansion_addr" value:{string_value:"localhost:52859"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk-jenkins-0315001033-e923c9b9"}} fields:{key:"beam:option:options_id:v1" value:{number_value:26}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:44443"} artifact_endpoint:{url:"localhost:36311"} control_endpoint:{url:"localhost:39797"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x82\x01/tmp/beam-artifact-staging/bde7bb05f8359fe9e34f55ade7a294bdb179e0c632e9256015df7d0492ae3512/1-go-/tmp/worker-7-1647303031544986621" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/03/15 00:10:38 Initializing Go harness: /opt/apache/beam/boot --id=153-1 --provision_endpoint=localhost:46803
2022/03/15 00:10:39 Downloaded: /tmp/staged/1-worker-7-1647303031544986621 (sha256: de173c6ab6e215dac75820f0e5a3ec68d4feaecb0e26ea7b3b8cf3a166e0bd5c, size: 22879009)
Worker exited successfully!
2022/03/15 00:10:39 control response channel closed
Remote logging shutting down.
22/03/15 00:10:40 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/03/15 00:10:40 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/03/15 00:10:40 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk-jenkins-0315001033-e923c9b9_9729992c-368a-430a-912b-8f0c7b8d2374: Pipeline translated successfully. Computing outputs
22/03/15 00:10:40 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.
22/03/15 00:10:40 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
22/03/15 00:10:41 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 154-1
22/03/15 00:10:41 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
22/03/15 00:10:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:35197 ...
22/03/15 00:10:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:44277 ...
22/03/15 00:10:41 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 154-2
22/03/15 00:10:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:42537 ...
22/03/15 00:10:41 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
22/03/15 00:10:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:603: Connecting via grpc @ localhost:33759 ...
22/03/15 00:10:41 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\202\001/tmp/beam-artifact-staging/bde7bb05f8359fe9e34f55ade7a294bdb179e0c632e9256015df7d0492ae3512/1-go-/tmp/worker-7-1647303031544986621"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
22/03/15 00:10:41 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
22/03/15 00:10:41 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
22/03/15 00:10:41 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container d8f18c03f056a79a52b1526cf90f9334d430b7d484f6f30c14eb398a29cf5fa5. Logs:
2022/03/15 00:10:40 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-testemitpardoaftergbk"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"dataflow_worker_jar" value:{string_value:""}} fields:{key:"endpoint" value:{string_value:"localhost:50185"}} fields:{key:"environment_config" value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type" value:{string_value:"DOCKER"}} fields:{key:"hookOrder" value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks" value:{string_value:"{\"default_remote_logging\":null}"}} fields:{key:"project" value:{string_value:"apache-beam-testing"}} fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner" value:{string_value:"spark"}} fields:{key:"staging_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test"}} fields:{key:"temp_location" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"}} fields:{key:"test.paniconexit0" value:{string_value:"true"}} fields:{key:"test.timeout" value:{string_value:"2h0m0s"}} fields:{key:"test.v" value:{string_value:"true"}} fields:{key:"test_expansion_addr" value:{string_value:"localhost:52859"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0testemitpardoaftergbk-jenkins-0315001033-e923c9b9"}} fields:{key:"beam:option:options_id:v1" value:{number_value:26}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:44277"} artifact_endpoint:{url:"localhost:35315"} control_endpoint:{url:"localhost:35197"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\x82\x01/tmp/beam-artifact-staging/bde7bb05f8359fe9e34f55ade7a294bdb179e0c632e9256015df7d0492ae3512/1-go-/tmp/worker-7-1647303031544986621" role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/03/15 00:10:40 Initializing Go harness: /opt/apache/beam/boot --id=154-1 --provision_endpoint=localhost:37595
2022/03/15 00:10:41 Downloaded: /tmp/staged/1-worker-7-1647303031544986621 (sha256: de173c6ab6e215dac75820f0e5a3ec68d4feaecb0e26ea7b3b8cf3a166e0bd5c, size: 22879009)
Worker exited successfully!
2022/03/15 00:10:41 control response channel closed
Remote logging shutting down.
22/03/15 00:10:41 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0testemitpardoaftergbk-jenkins-0315001033-e923c9b9_9729992c-368a-430a-912b-8f0c7b8d2374 finished.
22/03/15 00:10:41 WARN org.apache.beam.runners.jobsubmission.InMemoryJobService: Failed to remove job staging directory for token go-testemitpardoaftergbk_059e4f4c-b1c9-4685-829a-99f343025078.
java.io.FileNotFoundException: No files found for spec: /tmp/beam-artifact-staging/bde7bb05f8359fe9e34f55ade7a294bdb179e0c632e9256015df7d0492ae3512/* in working directory <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/.>
at org.apache.beam.sdk.io.LocalFileSystem.matchOne(LocalFileSystem.java:307)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:105)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:98)
at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:124)
at org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:217)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$1.removeStagedArtifacts(ArtifactStagingService.java:180)
at org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService.removeStagedArtifacts(ArtifactStagingService.java:115)
at org.apache.beam.runners.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:67)
at org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:261)
at org.apache.beam.runners.jobsubmission.JobInvocation.setState(JobInvocation.java:249)
at org.apache.beam.runners.jobsubmission.JobInvocation.access$200(JobInvocation.java:51)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:115)
at org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:101)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022/03/15 00:10:41 Job state: DONE
22/03/15 00:10:41 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0testemitpardoaftergbk-jenkins-0315001033-e923c9b9_9729992c-368a-430a-912b-8f0c7b8d2374
22/03/15 00:10:41 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0testemitpardoaftergbk-jenkins-0315001033-e923c9b9_9729992c-368a-430a-912b-8f0c7b8d2374
--- PASS: TestEmitParDoAfterGBK (10.23s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/regression 86.293s
FAIL
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 109
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 10m 14s
112 actionable tasks: 74 executed, 33 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/52hmifbv3t6be
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Go_VR_Spark #5858
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/5858/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org