You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/05/29 00:18:00 UTC
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4732
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4732/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11988] added a fix for missing sample.txt (#14889)
[noreply] [BEAM-621] Add MapKeys, MapValues transforms (#14273)
------------------------------------------
[...truncated 547.69 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/29 00:17:42 Prepared job with id: go-job-5-1622247462350129770_0ab13041-0beb-4be1-b4d5-7379779e75e3 and staging token: go-job-5-1622247462350129770_0ab13041-0beb-4be1-b4d5-7379779e75e3
2021/05/29 00:17:42 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622247462353935115
21/05/29 00:17:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622247462350129770_0ab13041-0beb-4be1-b4d5-7379779e75e3.
21/05/29 00:17:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622247462350129770_0ab13041-0beb-4be1-b4d5-7379779e75e3.go.
21/05/29 00:17:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622247462350129770_0ab13041-0beb-4be1-b4d5-7379779e75e3.null.
21/05/29 00:17:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622247462350129770_0ab13041-0beb-4be1-b4d5-7379779e75e3.
2021/05/29 00:17:48 Staged binary artifact with token:
21/05/29 00:17:48 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622247462350129770-jenkins-0529001748-b15eb165_1cc8640b-c21b-4d11-bd29-2e20f034f3f1
21/05/29 00:17:48 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622247462350129770-jenkins-0529001748-b15eb165_1cc8640b-c21b-4d11-bd29-2e20f034f3f1
2021/05/29 00:17:48 Submitted job: go0job0501622247462350129770-jenkins-0529001748-b15eb165_1cc8640b-c21b-4d11-bd29-2e20f034f3f1
21/05/29 00:17:48 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
2021/05/29 00:17:48 Job state: STOPPED
2021/05/29 00:17:48 Job state: STARTING
2021/05/29 00:17:48 Job state: RUNNING
21/05/29 00:17:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622247462350129770-jenkins-0529001748-b15eb165_1cc8640b-c21b-4d11-bd29-2e20f034f3f1 on Spark master local
21/05/29 00:17:48 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/29 00:17:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622247462350129770-jenkins-0529001748-b15eb165_1cc8640b-c21b-4d11-bd29-2e20f034f3f1: Pipeline translated successfully. Computing outputs
21/05/29 00:17:49 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/29 00:17:51 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/29 00:17:51 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/29 00:17:51 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:33633 ...
21/05/29 00:17:51 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37227 ...
21/05/29 00:17:51 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/29 00:17:51 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:40735 ...
21/05/29 00:17:51 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/29 00:17:51 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 4823301 ns
21/05/29 00:17:51 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 2646354 ns
21/05/29 00:17:51 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/1593fbe8e99ce1cb89a692e92d95acb14f6f105d25ca5bfa62774ba15a1bcbde/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/29 00:17:51 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/29 00:17:51 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/29 00:17:51 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container eaa36c661592ea9c019f5d285bcad1285ffde606de24b7cee4c827b814bc4f1d. Logs:
2021/05/29 00:17:50 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622247462350129770"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622247462350129770-jenkins-0529001748-b15eb165"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:37227"} artifact_endpoint:{url:"localhost:33175"} control_endpoint:{url:"localhost:33633"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/1593fbe8e99ce1cb89a692e92d95acb14f6f105d25ca5bfa62774ba15a1bcbde/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/29 00:17:50 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:43787
2021/05/29 00:17:50 Downloaded: /tmp/staged/worker (sha256: c2916509ce24fd164a6da497ba571012495647f3bed7500cdc24643eb4af3af8, size: 27884796)
Worker exited successfully!
2021/05/29 00:17:51 control response channel closed
21/05/29 00:17:53 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622247462350129770-jenkins-0529001748-b15eb165_1cc8640b-c21b-4d11-bd29-2e20f034f3f1 finished.
2021/05/29 00:17:53 Job state: DONE
21/05/29 00:17:53 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622247462350129770-jenkins-0529001748-b15eb165_1cc8640b-c21b-4d11-bd29-2e20f034f3f1
21/05/29 00:17:53 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622247462350129770-jenkins-0529001748-b15eb165_1cc8640b-c21b-4d11-bd29-2e20f034f3f1
2021/05/29 00:17:53 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (41.97s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 41.996s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.019s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 17m 29s
79 actionable tasks: 62 executed, 17 from cache
Publishing build scan...
https://gradle.com/s/hliyefdkupi2w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Go_VR_Spark #4751
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4751/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4750
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4750/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-12281] Drop support for Flink 1.10
[Ismaël Mejía] [BEAM-12281] Update Flink Jenkins jobs to use Flink 1.12
------------------------------------------
[...truncated 545.66 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/02 12:11:05 Prepared job with id: go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813 and staging token: go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813
2021/06/02 12:11:05 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622635865887115713
21/06/02 12:11:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813.
21/06/02 12:11:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813.go.
21/06/02 12:11:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813.null.
21/06/02 12:11:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813.
2021/06/02 12:11:08 Staged binary artifact with token:
21/06/02 12:11:08 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7
21/06/02 12:11:08 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7
2021/06/02 12:11:08 Submitted job: go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7
2021/06/02 12:11:08 Job state: STOPPED
2021/06/02 12:11:08 Job state: STARTING
2021/06/02 12:11:08 Job state: RUNNING
21/06/02 12:11:08 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/02 12:11:08 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7 on Spark master local
21/06/02 12:11:08 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/02 12:11:08 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7: Pipeline translated successfully. Computing outputs
21/06/02 12:11:09 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/02 12:11:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:35417 ...
21/06/02 12:11:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44973 ...
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/02 12:11:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:36153 ...
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/02 12:11:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2828080 ns
21/06/02 12:11:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1552704 ns
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/e0172f1adb46b13234df41f900e309ca543aa0fc456b98534e1a9d7a46240b88/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/02 12:11:10 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 8ecfabecf337a1a2b40b86aabed06600cea071b40368848d46e739ee2f14ab61. Logs:
2021/06/02 12:11:09 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622635865884473617"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622635865884473617-jenkins-0602121108-b9829dd5"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:44973"} artifact_endpoint:{url:"localhost:34739"} control_endpoint:{url:"localhost:35417"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/e0172f1adb46b13234df41f900e309ca543aa0fc456b98534e1a9d7a46240b88/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/02 12:11:09 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:36921
2021/06/02 12:11:10 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/06/02 12:11:10 control response channel closed
21/06/02 12:11:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7 finished.
2021/06/02 12:11:10 Job state: DONE
21/06/02 12:11:10 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7
21/06/02 12:11:10 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7
2021/06/02 12:11:10 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (45.42s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 45.438s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.020s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 45s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/veaqtn3rt5muo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4749
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4749/display/redirect?page=changes>
Changes:
[Brian Hulette] Add DataFrame API updates to CHANGES.md
------------------------------------------
[...truncated 545.97 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/02 06:12:58 Prepared job with id: go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617 and staging token: go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617
2021/06/02 06:12:58 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622614378322587806
21/06/02 06:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617.
21/06/02 06:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617.go.
21/06/02 06:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617.null.
21/06/02 06:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617.
2021/06/02 06:13:00 Staged binary artifact with token:
21/06/02 06:13:00 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9
21/06/02 06:13:00 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9
2021/06/02 06:13:00 Submitted job: go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9
2021/06/02 06:13:00 Job state: STOPPED
2021/06/02 06:13:00 Job state: STARTING
2021/06/02 06:13:00 Job state: RUNNING
21/06/02 06:13:00 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/02 06:13:00 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9 on Spark master local
21/06/02 06:13:00 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/02 06:13:00 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9: Pipeline translated successfully. Computing outputs
21/06/02 06:13:01 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/02 06:13:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:45403 ...
21/06/02 06:13:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:41489 ...
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/02 06:13:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:39363 ...
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/02 06:13:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2433466 ns
21/06/02 06:13:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1340047 ns
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/584d750791270944e481cc9948ee9d414e4d4bf9f5e44c170587553430ecc14b/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/02 06:13:02 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container bbf5ffd687f32aaef8fa2f9407b92b0f09a1a3d4e31c46c347386649c514c5d5. Logs:
2021/06/02 06:13:02 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622614378320056534"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622614378320056534-jenkins-0602061300-152bfb7a"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:41489"} artifact_endpoint:{url:"localhost:43555"} control_endpoint:{url:"localhost:45403"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/584d750791270944e481cc9948ee9d414e4d4bf9f5e44c170587553430ecc14b/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/02 06:13:02 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:42195
2021/06/02 06:13:02 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
2021/06/02 06:13:02 control response channel closed
Worker exited successfully!
21/06/02 06:13:03 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9 finished.
2021/06/02 06:13:03 Job state: DONE
21/06/02 06:13:03 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9
21/06/02 06:13:03 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9
2021/06/02 06:13:03 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (24.37s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 24.397s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.017s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 36s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/swok6bh6cfj7m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4748
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4748/display/redirect?page=changes>
Changes:
[anant.damle] [BEAM-12427] Ignore the AutoValue_* classes generated in "generated"
[zyichi] [BEAM-12437] Fix broken test from missing allow_unsafe_triggers
[noreply] [BEAM-8787] Contribution Guide Improvement (#14477)
------------------------------------------
[...truncated 545.69 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/02 00:12:36 Prepared job with id: go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14 and staging token: go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14
2021/06/02 00:12:36 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622592756040468082
21/06/02 00:12:38 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14.
21/06/02 00:12:38 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14.go.
21/06/02 00:12:38 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14.null.
21/06/02 00:12:39 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14.
2021/06/02 00:12:39 Staged binary artifact with token:
21/06/02 00:12:39 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832
21/06/02 00:12:39 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832
2021/06/02 00:12:39 Submitted job: go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832
2021/06/02 00:12:39 Job state: STOPPED
2021/06/02 00:12:39 Job state: STARTING
2021/06/02 00:12:39 Job state: RUNNING
21/06/02 00:12:39 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/02 00:12:39 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832 on Spark master local
21/06/02 00:12:39 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/02 00:12:39 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832: Pipeline translated successfully. Computing outputs
21/06/02 00:12:39 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/02 00:12:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:46255 ...
21/06/02 00:12:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44209 ...
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/02 00:12:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37357 ...
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/02 00:12:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 5084419 ns
21/06/02 00:12:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 3268731 ns
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/e537c06e959c51cdfff023592fc77ffdf0178dd3a9d478962e7243fd6eba55d4/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/02 00:12:41 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container a03996b6b489862fbbd0951f6fd13ea63ca268993b51f8591eedea33e4138eda. Logs:
2021/06/02 00:12:41 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622592756036881929"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622592756036881929-jenkins-0602001239-b9a685d4"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:44209"} artifact_endpoint:{url:"localhost:38927"} control_endpoint:{url:"localhost:46255"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/e537c06e959c51cdfff023592fc77ffdf0178dd3a9d478962e7243fd6eba55d4/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/02 00:12:41 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:40975
2021/06/02 00:12:41 Downloaded: /tmp/staged/worker (sha256: c2916509ce24fd164a6da497ba571012495647f3bed7500cdc24643eb4af3af8, size: 27884796)
2021/06/02 00:12:41 control response channel closed
Remote logging shutting down.Worker exited successfully!
21/06/02 00:12:43 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832 finished.
2021/06/02 00:12:43 Job state: DONE
21/06/02 00:12:43 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832
21/06/02 00:12:43 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832
2021/06/02 00:12:43 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (30.79s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 30.817s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.023s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 19s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/bz5w6j3re3x44
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4747
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4747/display/redirect?page=changes>
Changes:
[zyichi] Minor fix to prebuilding sdk workflow timeout setting
[Ismaël Mejía] [BEAM-12423] Upgrade pyarrow to support version 4.0.0 too
------------------------------------------
[...truncated 545.59 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/01 18:15:05 Prepared job with id: go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8 and staging token: go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8
2021/06/01 18:15:05 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622571305291135607
21/06/01 18:15:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8.
21/06/01 18:15:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8.go.
21/06/01 18:15:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8.null.
21/06/01 18:15:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8.
2021/06/01 18:15:08 Staged binary artifact with token:
21/06/01 18:15:08 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e
21/06/01 18:15:08 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e
2021/06/01 18:15:08 Submitted job: go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e
2021/06/01 18:15:08 Job state: STOPPED
2021/06/01 18:15:08 Job state: STARTING
2021/06/01 18:15:08 Job state: RUNNING
21/06/01 18:15:08 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/01 18:15:08 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e on Spark master local
21/06/01 18:15:08 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/01 18:15:08 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e: Pipeline translated successfully. Computing outputs
21/06/01 18:15:09 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/01 18:15:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37539 ...
21/06/01 18:15:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37473 ...
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/01 18:15:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37345 ...
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/01 18:15:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 3369206 ns
21/06/01 18:15:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1902441 ns
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/eaffad8902bcc2011b67bdfb4f2556d7fe2eddc5af547157766283b182fb692b/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/01 18:15:10 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container e837bbee9b0669bf36e667d628cb38df60ced3686c226a90a004c5b3775d7e4b. Logs:
2021/06/01 18:15:10 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622571305288527188"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:37473"} artifact_endpoint:{url:"localhost:39421"} control_endpoint:{url:"localhost:37539"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/eaffad8902bcc2011b67bdfb4f2556d7fe2eddc5af547157766283b182fb692b/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/01 18:15:10 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:38387
2021/06/01 18:15:10 Downloaded: /tmp/staged/worker (sha256: c2916509ce24fd164a6da497ba571012495647f3bed7500cdc24643eb4af3af8, size: 27884796)
Worker exited successfully!
2021/06/01 18:15:10 control response channel closed
21/06/01 18:15:11 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e finished.
2021/06/01 18:15:11 Job state: DONE
21/06/01 18:15:11 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e
21/06/01 18:15:11 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e
2021/06/01 18:15:11 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (34.41s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 34.432s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.018s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 14m 45s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/d6qpimrkcdspw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4746
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4746/display/redirect>
Changes:
------------------------------------------
[...truncated 545.77 KB...]
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/01 12:12:42 Prepared job with id: go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60 and staging token: go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60
2021/06/01 12:12:42 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622549562344721298
21/06/01 12:12:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60.
21/06/01 12:12:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60.go.
21/06/01 12:12:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60.null.
21/06/01 12:12:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60.
2021/06/01 12:12:44 Staged binary artifact with token:
21/06/01 12:12:44 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d
21/06/01 12:12:44 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d
2021/06/01 12:12:44 Submitted job: go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d
2021/06/01 12:12:44 Job state: STOPPED
2021/06/01 12:12:44 Job state: STARTING
2021/06/01 12:12:44 Job state: RUNNING
21/06/01 12:12:44 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/01 12:12:44 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d on Spark master local
21/06/01 12:12:44 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/01 12:12:44 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d: Pipeline translated successfully. Computing outputs
21/06/01 12:12:45 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/01 12:12:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:45455 ...
21/06/01 12:12:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:34893 ...
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/01 12:12:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37033 ...
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/01 12:12:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2641799 ns
21/06/01 12:12:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1475344 ns
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/e5b872fdb855e253be8270f8ceb63d6ff27a375d99ddb8ea467820a268d156a8/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/01 12:12:46 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 1b0c83e67f62948db6498889c9b2bfd06dfef7c80c5ca00562dba63fc6537254. Logs:
2021/06/01 12:12:46 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622549562342099029"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622549562342099029-jenkins-0601121244-88a2927a"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:34893"} artifact_endpoint:{url:"localhost:44485"} control_endpoint:{url:"localhost:45455"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/e5b872fdb855e253be8270f8ceb63d6ff27a375d99ddb8ea467820a268d156a8/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/01 12:12:46 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:40417
2021/06/01 12:12:46 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/06/01 12:12:46 control response channel closed
21/06/01 12:12:47 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d finished.
2021/06/01 12:12:47 Job state: DONE
21/06/01 12:12:47 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d
21/06/01 12:12:47 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d
2021/06/01 12:12:47 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (24.48s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 24.494s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.017s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 20s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
Publishing build scan failed due to network error 'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)...
https://gradle.com/s/h7qjtxg4o3l4q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4745
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4745/display/redirect>
Changes:
------------------------------------------
[...truncated 546.35 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/01 06:13:17 Prepared job with id: go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208 and staging token: go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208
2021/06/01 06:13:17 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622527997923926760
21/06/01 06:13:20 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208.
21/06/01 06:13:20 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208.go.
21/06/01 06:13:20 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208.null.
21/06/01 06:13:20 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208.
2021/06/01 06:13:20 Staged binary artifact with token:
21/06/01 06:13:20 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1
21/06/01 06:13:20 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1
2021/06/01 06:13:20 Submitted job: go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1
2021/06/01 06:13:20 Job state: STOPPED
2021/06/01 06:13:20 Job state: STARTING
2021/06/01 06:13:20 Job state: RUNNING
21/06/01 06:13:20 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/01 06:13:20 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1 on Spark master local
21/06/01 06:13:20 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/01 06:13:20 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1: Pipeline translated successfully. Computing outputs
21/06/01 06:13:20 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/01 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:33429 ...
21/06/01 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:33361 ...
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/01 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44779 ...
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/01 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2774368 ns
21/06/01 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1435005 ns
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/63906311f9221f387ca0b03c24aeb74d4c9e63eee4ddb305a5debafe612ca5a3/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/01 06:13:21 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 414b39292ab02f1b521b8c4c3d45293b6d78fc01f540e1ade8d048059e95a86b. Logs:
2021/06/01 06:13:21 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622527997921345339"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622527997921345339-jenkins-0601061320-d7855d32"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:33361"} artifact_endpoint:{url:"localhost:35153"} control_endpoint:{url:"localhost:33429"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/63906311f9221f387ca0b03c24aeb74d4c9e63eee4ddb305a5debafe612ca5a3/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/01 06:13:21 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:40595
2021/06/01 06:13:21 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/06/01 06:13:21 control response channel closed
21/06/01 06:13:22 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1 finished.
2021/06/01 06:13:22 Job state: DONE
21/06/01 06:13:22 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1
21/06/01 06:13:22 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1
2021/06/01 06:13:22 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (23.49s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 23.506s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.018s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 56s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/mkj4jbn75oxcc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4744
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4744/display/redirect>
Changes:
------------------------------------------
[...truncated 545.89 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/01 00:13:07 Prepared job with id: go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c and staging token: go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c
2021/06/01 00:13:07 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622506387941605896
21/06/01 00:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c.
21/06/01 00:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c.go.
21/06/01 00:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c.null.
21/06/01 00:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c.
2021/06/01 00:13:10 Staged binary artifact with token:
21/06/01 00:13:10 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc
21/06/01 00:13:10 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc
2021/06/01 00:13:10 Submitted job: go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc
2021/06/01 00:13:10 Job state: STOPPED
2021/06/01 00:13:10 Job state: STARTING
2021/06/01 00:13:10 Job state: RUNNING
21/06/01 00:13:10 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/01 00:13:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc on Spark master local
21/06/01 00:13:10 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/01 00:13:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc: Pipeline translated successfully. Computing outputs
21/06/01 00:13:10 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/01 00:13:11 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:43579 ...
21/06/01 00:13:11 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:45393 ...
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/01 00:13:11 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:35371 ...
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/01 00:13:11 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 3036448 ns
21/06/01 00:13:11 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1769681 ns
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/8c93a6c62be388cb97491ee6aa433985d8f1bbc3adfbe56c420feaca49831817/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/01 00:13:11 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container df085ae8fa951f02f3f03199c793fcdf6fd37d78c7c497321e9cfbc8f2e7d499. Logs:
2021/06/01 00:13:11 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622506387939373424"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622506387939373424-jenkins-0601001310-fbb4149a"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:45393"} artifact_endpoint:{url:"localhost:44509"} control_endpoint:{url:"localhost:43579"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/8c93a6c62be388cb97491ee6aa433985d8f1bbc3adfbe56c420feaca49831817/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/01 00:13:11 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:46695
2021/06/01 00:13:11 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/06/01 00:13:11 control response channel closed
21/06/01 00:13:12 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc finished.
2021/06/01 00:13:12 Job state: DONE
21/06/01 00:13:12 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc
21/06/01 00:13:12 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc
2021/06/01 00:13:12 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (23.54s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 23.564s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.016s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 47s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/izasu2jlisqai
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4743
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4743/display/redirect>
Changes:
------------------------------------------
[...truncated 545.94 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/31 18:12:44 Prepared job with id: go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44 and staging token: go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44
2021/05/31 18:12:44 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622484764975225006
21/05/31 18:12:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44.
21/05/31 18:12:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44.go.
21/05/31 18:12:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44.null.
21/05/31 18:12:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44.
2021/05/31 18:12:47 Staged binary artifact with token:
21/05/31 18:12:47 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255
21/05/31 18:12:47 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255
2021/05/31 18:12:47 Submitted job: go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255
2021/05/31 18:12:47 Job state: STOPPED
2021/05/31 18:12:47 Job state: STARTING
2021/05/31 18:12:47 Job state: RUNNING
21/05/31 18:12:47 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/31 18:12:47 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255 on Spark master local
21/05/31 18:12:47 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/31 18:12:47 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255: Pipeline translated successfully. Computing outputs
21/05/31 18:12:48 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/31 18:12:49 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:35419 ...
21/05/31 18:12:49 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:46655 ...
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/31 18:12:49 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:46337 ...
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/31 18:12:49 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2933349 ns
21/05/31 18:12:49 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1635793 ns
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/76a835c81f77ba8d4d538a30e678d2727424d1f37c160c1a33885a65c660a02b/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/31 18:12:49 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container d3889c99a3722b2e6095a3135eecced6c3251f479bc23e4010794763782667c5. Logs:
2021/05/31 18:12:48 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622484764972370019"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622484764972370019-jenkins-0531181247-6f9350b7"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:46655"} artifact_endpoint:{url:"localhost:37755"} control_endpoint:{url:"localhost:35419"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/76a835c81f77ba8d4d538a30e678d2727424d1f37c160c1a33885a65c660a02b/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/31 18:12:48 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:44417
2021/05/31 18:12:49 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/05/31 18:12:49 control response channel closed
21/05/31 18:12:49 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255 finished.
2021/05/31 18:12:49 Job state: DONE
21/05/31 18:12:49 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255
21/05/31 18:12:49 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255
2021/05/31 18:12:49 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (24.47s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 24.491s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.017s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 23s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/ti6spzi4uzars
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4742
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4742/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-12277] Update Flink 1.13 version to 1.13.1
[Ismaël Mejía] [BEAM-12424] Update Flink 1.12 to version 1.12.4
------------------------------------------
[...truncated 545.11 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/31 12:12:12 Prepared job with id: go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a and staging token: go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a
2021/05/31 12:12:12 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622463132233630280
21/05/31 12:12:14 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a.
21/05/31 12:12:14 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a.go.
21/05/31 12:12:14 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a.null.
21/05/31 12:12:14 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a.
2021/05/31 12:12:14 Staged binary artifact with token:
21/05/31 12:12:14 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1
21/05/31 12:12:14 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1
2021/05/31 12:12:14 Submitted job: go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1
2021/05/31 12:12:14 Job state: STOPPED
2021/05/31 12:12:14 Job state: STARTING
2021/05/31 12:12:14 Job state: RUNNING
21/05/31 12:12:14 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/31 12:12:14 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1 on Spark master local
21/05/31 12:12:14 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/31 12:12:14 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1: Pipeline translated successfully. Computing outputs
21/05/31 12:12:15 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/31 12:12:16 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:45521 ...
21/05/31 12:12:16 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37107 ...
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/31 12:12:16 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37695 ...
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/31 12:12:16 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2542551 ns
21/05/31 12:12:16 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1420436 ns
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/7f8e7e88a5e9e62c99e16b2a15d24de168a48d59695f56982e342efeddfce32b/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/31 12:12:16 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 2ef7d796de5a91fcedc9ad5f14e0111c742c2050f5ddc6a275e6d4d61d5069a8. Logs:
2021/05/31 12:12:16 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622463132231234252"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622463132231234252-jenkins-0531121214-10387377"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:37107"} artifact_endpoint:{url:"localhost:43953"} control_endpoint:{url:"localhost:45521"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/7f8e7e88a5e9e62c99e16b2a15d24de168a48d59695f56982e342efeddfce32b/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/31 12:12:16 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:44379
2021/05/31 12:12:16 Downloaded: /tmp/staged/worker (sha256: c2916509ce24fd164a6da497ba571012495647f3bed7500cdc24643eb4af3af8, size: 27884796)
Worker exited successfully!
2021/05/31 12:12:16 control response channel closed
21/05/31 12:12:17 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1 finished.
2021/05/31 12:12:17 Job state: DONE
21/05/31 12:12:17 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1
21/05/31 12:12:17 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1
2021/05/31 12:12:17 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (25.41s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 25.426s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.017s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 53s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/5kql55mznbpvm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4741
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4741/display/redirect>
Changes:
------------------------------------------
[...truncated 546.67 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/31 06:13:08 Prepared job with id: go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23 and staging token: go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23
2021/05/31 06:13:08 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622441588542188274
21/05/31 06:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23.
21/05/31 06:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23.go.
21/05/31 06:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23.null.
21/05/31 06:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23.
2021/05/31 06:13:10 Staged binary artifact with token:
21/05/31 06:13:10 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0
21/05/31 06:13:10 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0
2021/05/31 06:13:10 Submitted job: go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0
2021/05/31 06:13:10 Job state: STOPPED
2021/05/31 06:13:10 Job state: STARTING
2021/05/31 06:13:10 Job state: RUNNING
21/05/31 06:13:10 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/31 06:13:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0 on Spark master local
21/05/31 06:13:10 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/31 06:13:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0: Pipeline translated successfully. Computing outputs
21/05/31 06:13:11 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/31 06:13:12 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:42597 ...
21/05/31 06:13:12 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:43983 ...
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/31 06:13:12 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37435 ...
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/31 06:13:12 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2884294 ns
21/05/31 06:13:12 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1502687 ns
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/bfc4a8156e0981dc9ade400d1fa2c499f57b9636545a7a306392b8640c74dc6b/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/31 06:13:12 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 02566e585ffa101d4275a014b7e2447ee124450ed0983f50a203962a7cc336c2. Logs:
2021/05/31 06:13:12 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622441588539781408"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622441588539781408-jenkins-0531061310-24d36646"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:43983"} artifact_endpoint:{url:"localhost:41691"} control_endpoint:{url:"localhost:42597"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/bfc4a8156e0981dc9ade400d1fa2c499f57b9636545a7a306392b8640c74dc6b/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/31 06:13:12 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:42061
2021/05/31 06:13:12 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/05/31 06:13:12 control response channel closed
21/05/31 06:13:13 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0 finished.
2021/05/31 06:13:13 Job state: DONE
21/05/31 06:13:13 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0
21/05/31 06:13:13 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0
2021/05/31 06:13:13 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (23.57s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 23.585s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.016s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 45s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/rpdp6zxd7duag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4740
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4740/display/redirect>
Changes:
------------------------------------------
[...truncated 546.15 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/31 00:12:59 Prepared job with id: go-job-5-1622419979455082976_f2d3d44f-3e05-44a8-9ffd-8453ff63a1bd and staging token: go-job-5-1622419979455082976_f2d3d44f-3e05-44a8-9ffd-8453ff63a1bd
2021/05/31 00:12:59 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622419979457710193
21/05/31 00:13:01 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622419979455082976_f2d3d44f-3e05-44a8-9ffd-8453ff63a1bd.
21/05/31 00:13:01 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622419979455082976_f2d3d44f-3e05-44a8-9ffd-8453ff63a1bd.go.
21/05/31 00:13:01 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622419979455082976_f2d3d44f-3e05-44a8-9ffd-8453ff63a1bd.null.
21/05/31 00:13:01 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622419979455082976_f2d3d44f-3e05-44a8-9ffd-8453ff63a1bd.
2021/05/31 00:13:01 Staged binary artifact with token:
21/05/31 00:13:01 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622419979455082976-jenkins-0531001301-76477bbb_4eaee7dd-74a5-4289-bada-0535d2422aa7
21/05/31 00:13:01 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622419979455082976-jenkins-0531001301-76477bbb_4eaee7dd-74a5-4289-bada-0535d2422aa7
2021/05/31 00:13:01 Submitted job: go0job0501622419979455082976-jenkins-0531001301-76477bbb_4eaee7dd-74a5-4289-bada-0535d2422aa7
2021/05/31 00:13:01 Job state: STOPPED
2021/05/31 00:13:01 Job state: STARTING
2021/05/31 00:13:01 Job state: RUNNING
21/05/31 00:13:01 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/31 00:13:02 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622419979455082976-jenkins-0531001301-76477bbb_4eaee7dd-74a5-4289-bada-0535d2422aa7 on Spark master local
21/05/31 00:13:02 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/31 00:13:02 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622419979455082976-jenkins-0531001301-76477bbb_4eaee7dd-74a5-4289-bada-0535d2422aa7: Pipeline translated successfully. Computing outputs
21/05/31 00:13:02 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/31 00:13:03 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/31 00:13:03 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/31 00:13:03 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:40333 ...
21/05/31 00:13:03 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:36149 ...
21/05/31 00:13:03 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/31 00:13:03 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44273 ...
21/05/31 00:13:03 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/31 00:13:03 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2712384 ns
21/05/31 00:13:03 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1521661 ns
21/05/31 00:13:03 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/277eee75898a037c1773cfacebd0ab3f97df4df93c7dc1db3c74806dbc35bfc9/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/31 00:13:03 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/31 00:13:03 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/31 00:13:03 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container ffcf8e75a0472930a5a986fc0780f19d1f7817e628790fc366fda32219218b50. Logs:
2021/05/31 00:13:03 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622419979455082976"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622419979455082976-jenkins-0531001301-76477bbb"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:36149"} artifact_endpoint:{url:"localhost:33525"} control_endpoint:{url:"localhost:40333"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/277eee75898a037c1773cfacebd0ab3f97df4df93c7dc1db3c74806dbc35bfc9/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/31 00:13:03 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:36863
2021/05/31 00:13:03 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
2021/05/31 00:13:03 control response channel closed
Worker exited successfully!
21/05/31 00:13:04 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622419979455082976-jenkins-0531001301-76477bbb_4eaee7dd-74a5-4289-bada-0535d2422aa7 finished.
2021/05/31 00:13:04 Job state: DONE
21/05/31 00:13:04 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622419979455082976-jenkins-0531001301-76477bbb_4eaee7dd-74a5-4289-bada-0535d2422aa7
21/05/31 00:13:04 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622419979455082976-jenkins-0531001301-76477bbb_4eaee7dd-74a5-4289-bada-0535d2422aa7
2021/05/31 00:13:04 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (24.29s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 24.307s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.017s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 39s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/o6iku4jxuupb2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4739
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4739/display/redirect>
Changes:
------------------------------------------
[...truncated 546.10 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/30 18:13:41 Prepared job with id: go-job-5-1622398421598058738_4ea92fdc-74d3-4765-a92c-f42da3fe9749 and staging token: go-job-5-1622398421598058738_4ea92fdc-74d3-4765-a92c-f42da3fe9749
2021/05/30 18:13:41 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622398421600806877
21/05/30 18:13:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622398421598058738_4ea92fdc-74d3-4765-a92c-f42da3fe9749.
21/05/30 18:13:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622398421598058738_4ea92fdc-74d3-4765-a92c-f42da3fe9749.go.
21/05/30 18:13:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622398421598058738_4ea92fdc-74d3-4765-a92c-f42da3fe9749.null.
21/05/30 18:13:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622398421598058738_4ea92fdc-74d3-4765-a92c-f42da3fe9749.
2021/05/30 18:13:44 Staged binary artifact with token:
21/05/30 18:13:44 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622398421598058738-jenkins-0530181344-c9f797d2_36d4727d-6a13-4183-8f9c-6ad6a40cc8a3
21/05/30 18:13:44 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622398421598058738-jenkins-0530181344-c9f797d2_36d4727d-6a13-4183-8f9c-6ad6a40cc8a3
2021/05/30 18:13:44 Submitted job: go0job0501622398421598058738-jenkins-0530181344-c9f797d2_36d4727d-6a13-4183-8f9c-6ad6a40cc8a3
2021/05/30 18:13:44 Job state: STOPPED
2021/05/30 18:13:44 Job state: STARTING
2021/05/30 18:13:44 Job state: RUNNING
21/05/30 18:13:44 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/30 18:13:44 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622398421598058738-jenkins-0530181344-c9f797d2_36d4727d-6a13-4183-8f9c-6ad6a40cc8a3 on Spark master local
21/05/30 18:13:44 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/30 18:13:44 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622398421598058738-jenkins-0530181344-c9f797d2_36d4727d-6a13-4183-8f9c-6ad6a40cc8a3: Pipeline translated successfully. Computing outputs
21/05/30 18:13:44 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/30 18:13:45 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/30 18:13:45 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/30 18:13:45 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:39137 ...
21/05/30 18:13:45 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:43715 ...
21/05/30 18:13:45 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/30 18:13:45 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:46565 ...
21/05/30 18:13:45 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/30 18:13:45 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 3094222 ns
21/05/30 18:13:45 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1595540 ns
21/05/30 18:13:45 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/5feb5e47e94346187ea5671698aff984dff21d933cbfd4d81a5f4c2fbbeffc29/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/30 18:13:45 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/30 18:13:45 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/30 18:13:45 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 2d0a11b7f47a743f3c43c6982512968ad7fd50ff95df35aaae9a49db1610f0f6. Logs:
2021/05/30 18:13:45 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622398421598058738"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622398421598058738-jenkins-0530181344-c9f797d2"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:43715"} artifact_endpoint:{url:"localhost:46505"} control_endpoint:{url:"localhost:39137"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/5feb5e47e94346187ea5671698aff984dff21d933cbfd4d81a5f4c2fbbeffc29/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/30 18:13:45 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:41675
2021/05/30 18:13:45 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/05/30 18:13:45 control response channel closed
21/05/30 18:13:46 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622398421598058738-jenkins-0530181344-c9f797d2_36d4727d-6a13-4183-8f9c-6ad6a40cc8a3 finished.
2021/05/30 18:13:46 Job state: DONE
21/05/30 18:13:46 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622398421598058738-jenkins-0530181344-c9f797d2_36d4727d-6a13-4183-8f9c-6ad6a40cc8a3
21/05/30 18:13:46 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622398421598058738-jenkins-0530181344-c9f797d2_36d4727d-6a13-4183-8f9c-6ad6a40cc8a3
2021/05/30 18:13:46 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (25.38s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 25.402s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.018s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 13m 20s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/67hiqbn37wkqa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4738
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4738/display/redirect>
Changes:
------------------------------------------
[...truncated 545.60 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/30 12:18:38 Prepared job with id: go-job-5-1622377118021005828_7b1f8472-9cee-4daf-ad8a-754445e94fb7 and staging token: go-job-5-1622377118021005828_7b1f8472-9cee-4daf-ad8a-754445e94fb7
2021/05/30 12:18:38 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622377118029096917
21/05/30 12:18:43 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622377118021005828_7b1f8472-9cee-4daf-ad8a-754445e94fb7.
21/05/30 12:18:43 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622377118021005828_7b1f8472-9cee-4daf-ad8a-754445e94fb7.go.
21/05/30 12:18:43 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622377118021005828_7b1f8472-9cee-4daf-ad8a-754445e94fb7.null.
21/05/30 12:18:43 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622377118021005828_7b1f8472-9cee-4daf-ad8a-754445e94fb7.
21/05/30 12:18:43 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622377118021005828-jenkins-0530121843-2eb720dc_a1311ada-7fda-4d86-9875-c5aa9c816c12
21/05/30 12:18:43 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622377118021005828-jenkins-0530121843-2eb720dc_a1311ada-7fda-4d86-9875-c5aa9c816c12
21/05/30 12:18:43 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
2021/05/30 12:18:43 Staged binary artifact with token:
2021/05/30 12:18:43 Submitted job: go0job0501622377118021005828-jenkins-0530121843-2eb720dc_a1311ada-7fda-4d86-9875-c5aa9c816c12
2021/05/30 12:18:43 Job state: STOPPED
2021/05/30 12:18:43 Job state: STARTING
2021/05/30 12:18:43 Job state: RUNNING
21/05/30 12:18:44 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622377118021005828-jenkins-0530121843-2eb720dc_a1311ada-7fda-4d86-9875-c5aa9c816c12 on Spark master local
21/05/30 12:18:44 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/30 12:18:44 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622377118021005828-jenkins-0530121843-2eb720dc_a1311ada-7fda-4d86-9875-c5aa9c816c12: Pipeline translated successfully. Computing outputs
21/05/30 12:18:45 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/30 12:18:46 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/30 12:18:46 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/30 12:18:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:36521 ...
21/05/30 12:18:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44869 ...
21/05/30 12:18:46 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/30 12:18:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44005 ...
21/05/30 12:18:47 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/30 12:18:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 10570479 ns
21/05/30 12:18:47 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/681d13130eee1d237929b749af12670a818b583834523270f8f417f1052bb9de/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/30 12:18:47 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/30 12:18:47 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 7593719 ns
21/05/30 12:18:47 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/30 12:18:47 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container c16b378ca7fc2609daed50fd8f4aa2264288820c7588eb352558816e965fb069. Logs:
2021/05/30 12:18:46 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622377118021005828"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622377118021005828-jenkins-0530121843-2eb720dc"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:44869"} artifact_endpoint:{url:"localhost:44871"} control_endpoint:{url:"localhost:36521"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/681d13130eee1d237929b749af12670a818b583834523270f8f417f1052bb9de/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/30 12:18:46 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:33655
2021/05/30 12:18:46 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/05/30 12:18:47 control response channel closed
21/05/30 12:18:48 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622377118021005828-jenkins-0530121843-2eb720dc_a1311ada-7fda-4d86-9875-c5aa9c816c12 finished.
2021/05/30 12:18:48 Job state: DONE
21/05/30 12:18:48 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622377118021005828-jenkins-0530121843-2eb720dc_a1311ada-7fda-4d86-9875-c5aa9c816c12
21/05/30 12:18:48 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622377118021005828-jenkins-0530121843-2eb720dc_a1311ada-7fda-4d86-9875-c5aa9c816c12
2021/05/30 12:18:48 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (58.24s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 58.327s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.059s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 18m 27s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/mfsilndttcdtw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4737
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4737/display/redirect>
Changes:
------------------------------------------
[...truncated 546.12 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/30 06:13:15 Prepared job with id: go-job-5-1622355195968983383_d1c1d493-ed92-4ace-9ee9-09cf2d00c214 and staging token: go-job-5-1622355195968983383_d1c1d493-ed92-4ace-9ee9-09cf2d00c214
2021/05/30 06:13:15 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622355195971824488
21/05/30 06:13:18 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622355195968983383_d1c1d493-ed92-4ace-9ee9-09cf2d00c214.
21/05/30 06:13:18 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622355195968983383_d1c1d493-ed92-4ace-9ee9-09cf2d00c214.go.
21/05/30 06:13:18 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622355195968983383_d1c1d493-ed92-4ace-9ee9-09cf2d00c214.null.
21/05/30 06:13:18 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622355195968983383_d1c1d493-ed92-4ace-9ee9-09cf2d00c214.
2021/05/30 06:13:18 Staged binary artifact with token:
21/05/30 06:13:18 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622355195968983383-jenkins-0530061318-18c67c42_42f61f08-54d7-4b66-83de-87243bde3c98
21/05/30 06:13:18 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622355195968983383-jenkins-0530061318-18c67c42_42f61f08-54d7-4b66-83de-87243bde3c98
2021/05/30 06:13:18 Submitted job: go0job0501622355195968983383-jenkins-0530061318-18c67c42_42f61f08-54d7-4b66-83de-87243bde3c98
2021/05/30 06:13:18 Job state: STOPPED
2021/05/30 06:13:18 Job state: STARTING
2021/05/30 06:13:18 Job state: RUNNING
21/05/30 06:13:18 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/30 06:13:18 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622355195968983383-jenkins-0530061318-18c67c42_42f61f08-54d7-4b66-83de-87243bde3c98 on Spark master local
21/05/30 06:13:18 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/30 06:13:18 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622355195968983383-jenkins-0530061318-18c67c42_42f61f08-54d7-4b66-83de-87243bde3c98: Pipeline translated successfully. Computing outputs
21/05/30 06:13:19 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/30 06:13:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/30 06:13:21 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/30 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44645 ...
21/05/30 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37447 ...
21/05/30 06:13:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/30 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:38223 ...
21/05/30 06:13:21 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/30 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 3258757 ns
21/05/30 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1694343 ns
21/05/30 06:13:21 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/2d89b203547beb73d947a2b3290d5c251a09239dce771c5bcfc3940d4eef4a07/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/30 06:13:21 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/30 06:13:21 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/30 06:13:21 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container f57ab0038d27c600a5595556044bddd1fbd9fda75914b7451fc41f1be2fd8f5e. Logs:
2021/05/30 06:13:21 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622355195968983383"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622355195968983383-jenkins-0530061318-18c67c42"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:37447"} artifact_endpoint:{url:"localhost:34509"} control_endpoint:{url:"localhost:44645"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/2d89b203547beb73d947a2b3290d5c251a09239dce771c5bcfc3940d4eef4a07/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/30 06:13:21 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:41087
2021/05/30 06:13:21 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/05/30 06:13:21 control response channel closed
21/05/30 06:13:22 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622355195968983383-jenkins-0530061318-18c67c42_42f61f08-54d7-4b66-83de-87243bde3c98 finished.
2021/05/30 06:13:22 Job state: DONE
21/05/30 06:13:22 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622355195968983383-jenkins-0530061318-18c67c42_42f61f08-54d7-4b66-83de-87243bde3c98
21/05/30 06:13:22 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622355195968983383-jenkins-0530061318-18c67c42_42f61f08-54d7-4b66-83de-87243bde3c98
2021/05/30 06:13:22 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (30.26s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 30.282s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.018s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 42s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/ih4amcevi5xiw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4736
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4736/display/redirect>
Changes:
------------------------------------------
[...truncated 546.02 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/30 00:13:18 Prepared job with id: go-job-5-1622333598500075722_2b387338-b48b-4995-a817-4fa87e114f70 and staging token: go-job-5-1622333598500075722_2b387338-b48b-4995-a817-4fa87e114f70
2021/05/30 00:13:18 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622333598502582764
21/05/30 00:13:21 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622333598500075722_2b387338-b48b-4995-a817-4fa87e114f70.
21/05/30 00:13:21 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622333598500075722_2b387338-b48b-4995-a817-4fa87e114f70.go.
21/05/30 00:13:21 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622333598500075722_2b387338-b48b-4995-a817-4fa87e114f70.null.
21/05/30 00:13:21 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622333598500075722_2b387338-b48b-4995-a817-4fa87e114f70.
2021/05/30 00:13:21 Staged binary artifact with token:
21/05/30 00:13:21 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622333598500075722-jenkins-0530001321-bf8d8332_2fa3625e-f5f1-4293-bb8d-0c1277844430
21/05/30 00:13:21 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622333598500075722-jenkins-0530001321-bf8d8332_2fa3625e-f5f1-4293-bb8d-0c1277844430
2021/05/30 00:13:21 Submitted job: go0job0501622333598500075722-jenkins-0530001321-bf8d8332_2fa3625e-f5f1-4293-bb8d-0c1277844430
2021/05/30 00:13:21 Job state: STOPPED
2021/05/30 00:13:21 Job state: STARTING
2021/05/30 00:13:21 Job state: RUNNING
21/05/30 00:13:21 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/30 00:13:21 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622333598500075722-jenkins-0530001321-bf8d8332_2fa3625e-f5f1-4293-bb8d-0c1277844430 on Spark master local
21/05/30 00:13:21 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/30 00:13:21 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622333598500075722-jenkins-0530001321-bf8d8332_2fa3625e-f5f1-4293-bb8d-0c1277844430: Pipeline translated successfully. Computing outputs
21/05/30 00:13:21 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/30 00:13:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/30 00:13:22 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/30 00:13:22 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:46515 ...
21/05/30 00:13:22 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:38367 ...
21/05/30 00:13:22 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/30 00:13:22 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:45473 ...
21/05/30 00:13:22 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/30 00:13:22 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2971495 ns
21/05/30 00:13:22 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1645436 ns
21/05/30 00:13:22 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/6ba176465a32f401c71285dccaa6c6dd39b8ee3cc7080f107dbffe2d6e77567a/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/30 00:13:22 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/30 00:13:22 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/30 00:13:22 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container afb48784e97f657a52ad32364c5b4aa6205093a3203f865951057f14579985f8. Logs:
2021/05/30 00:13:22 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622333598500075722"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622333598500075722-jenkins-0530001321-bf8d8332"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:38367"} artifact_endpoint:{url:"localhost:38393"} control_endpoint:{url:"localhost:46515"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/6ba176465a32f401c71285dccaa6c6dd39b8ee3cc7080f107dbffe2d6e77567a/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/30 00:13:22 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:37733
2021/05/30 00:13:22 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/05/30 00:13:22 control response channel closed
21/05/30 00:13:23 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622333598500075722-jenkins-0530001321-bf8d8332_2fa3625e-f5f1-4293-bb8d-0c1277844430 finished.
2021/05/30 00:13:23 Job state: DONE
21/05/30 00:13:23 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622333598500075722-jenkins-0530001321-bf8d8332_2fa3625e-f5f1-4293-bb8d-0c1277844430
21/05/30 00:13:23 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622333598500075722-jenkins-0530001321-bf8d8332_2fa3625e-f5f1-4293-bb8d-0c1277844430
2021/05/30 00:13:23 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (24.87s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 24.896s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.018s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 13m 2s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/vhhbpfpihk5ee
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4735
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4735/display/redirect>
Changes:
------------------------------------------
[...truncated 546.34 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/29 18:13:40 Prepared job with id: go-job-5-1622312020336805684_4faf89ad-1865-42e3-b8ef-b2267a34e7dd and staging token: go-job-5-1622312020336805684_4faf89ad-1865-42e3-b8ef-b2267a34e7dd
2021/05/29 18:13:40 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622312020339574884
21/05/29 18:13:42 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622312020336805684_4faf89ad-1865-42e3-b8ef-b2267a34e7dd.
21/05/29 18:13:42 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622312020336805684_4faf89ad-1865-42e3-b8ef-b2267a34e7dd.go.
21/05/29 18:13:42 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622312020336805684_4faf89ad-1865-42e3-b8ef-b2267a34e7dd.null.
21/05/29 18:13:42 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622312020336805684_4faf89ad-1865-42e3-b8ef-b2267a34e7dd.
2021/05/29 18:13:42 Staged binary artifact with token:
21/05/29 18:13:42 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622312020336805684-jenkins-0529181342-bc8292f8_02b297e7-bfd7-4373-984a-f47fbdbff8ed
21/05/29 18:13:42 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622312020336805684-jenkins-0529181342-bc8292f8_02b297e7-bfd7-4373-984a-f47fbdbff8ed
2021/05/29 18:13:43 Submitted job: go0job0501622312020336805684-jenkins-0529181342-bc8292f8_02b297e7-bfd7-4373-984a-f47fbdbff8ed
2021/05/29 18:13:43 Job state: STOPPED
2021/05/29 18:13:43 Job state: STARTING
2021/05/29 18:13:43 Job state: RUNNING
21/05/29 18:13:43 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/29 18:13:43 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622312020336805684-jenkins-0529181342-bc8292f8_02b297e7-bfd7-4373-984a-f47fbdbff8ed on Spark master local
21/05/29 18:13:43 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/29 18:13:43 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622312020336805684-jenkins-0529181342-bc8292f8_02b297e7-bfd7-4373-984a-f47fbdbff8ed: Pipeline translated successfully. Computing outputs
21/05/29 18:13:43 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/29 18:13:44 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/29 18:13:44 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/29 18:13:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:38779 ...
21/05/29 18:13:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:35917 ...
21/05/29 18:13:44 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/29 18:13:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44107 ...
21/05/29 18:13:44 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/29 18:13:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2966289 ns
21/05/29 18:13:44 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1634259 ns
21/05/29 18:13:44 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/e4698c1ccb4f6966ff1f812b3d650c3bcd35acaf438e9cf31b668c6817bdfa39/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/29 18:13:44 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/29 18:13:44 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/29 18:13:44 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 08b7423ed2d2e4661fa3fa9a2f1970ddd02980f30f118d587ce7e397d84ffec4. Logs:
2021/05/29 18:13:44 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622312020336805684"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622312020336805684-jenkins-0529181342-bc8292f8"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:35917"} artifact_endpoint:{url:"localhost:38127"} control_endpoint:{url:"localhost:38779"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/e4698c1ccb4f6966ff1f812b3d650c3bcd35acaf438e9cf31b668c6817bdfa39/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/29 18:13:44 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:45931
2021/05/29 18:13:44 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/05/29 18:13:44 control response channel closed
21/05/29 18:13:45 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622312020336805684-jenkins-0529181342-bc8292f8_02b297e7-bfd7-4373-984a-f47fbdbff8ed finished.
2021/05/29 18:13:45 Job state: DONE
21/05/29 18:13:45 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622312020336805684-jenkins-0529181342-bc8292f8_02b297e7-bfd7-4373-984a-f47fbdbff8ed
21/05/29 18:13:45 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622312020336805684-jenkins-0529181342-bc8292f8_02b297e7-bfd7-4373-984a-f47fbdbff8ed
2021/05/29 18:13:45 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (25.45s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 25.473s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.018s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 13m 19s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/vi5mb6asmllaq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4734
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4734/display/redirect>
Changes:
------------------------------------------
[...truncated 545.87 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/29 12:10:58 Prepared job with id: go-job-5-1622290258002805754_95af613c-a72c-462f-9ac1-1ad5b4d14348 and staging token: go-job-5-1622290258002805754_95af613c-a72c-462f-9ac1-1ad5b4d14348
2021/05/29 12:10:58 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622290258006291245
21/05/29 12:11:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622290258002805754_95af613c-a72c-462f-9ac1-1ad5b4d14348.
21/05/29 12:11:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622290258002805754_95af613c-a72c-462f-9ac1-1ad5b4d14348.go.
21/05/29 12:11:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622290258002805754_95af613c-a72c-462f-9ac1-1ad5b4d14348.null.
21/05/29 12:11:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622290258002805754_95af613c-a72c-462f-9ac1-1ad5b4d14348.
2021/05/29 12:11:00 Staged binary artifact with token:
21/05/29 12:11:00 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622290258002805754-jenkins-0529121100-1cff0ae2_85aabff5-0ce6-4a12-ab5d-11d12550eb11
21/05/29 12:11:00 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622290258002805754-jenkins-0529121100-1cff0ae2_85aabff5-0ce6-4a12-ab5d-11d12550eb11
2021/05/29 12:11:00 Submitted job: go0job0501622290258002805754-jenkins-0529121100-1cff0ae2_85aabff5-0ce6-4a12-ab5d-11d12550eb11
2021/05/29 12:11:00 Job state: STOPPED
2021/05/29 12:11:00 Job state: STARTING
2021/05/29 12:11:00 Job state: RUNNING
21/05/29 12:11:00 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/29 12:11:00 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622290258002805754-jenkins-0529121100-1cff0ae2_85aabff5-0ce6-4a12-ab5d-11d12550eb11 on Spark master local
21/05/29 12:11:00 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/29 12:11:00 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622290258002805754-jenkins-0529121100-1cff0ae2_85aabff5-0ce6-4a12-ab5d-11d12550eb11: Pipeline translated successfully. Computing outputs
21/05/29 12:11:01 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/29 12:11:02 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/29 12:11:02 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/29 12:11:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:38499 ...
21/05/29 12:11:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44359 ...
21/05/29 12:11:02 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/29 12:11:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:35419 ...
21/05/29 12:11:02 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/29 12:11:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 3291161 ns
21/05/29 12:11:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1894607 ns
21/05/29 12:11:02 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/69f8d509ef0235415bac27f52fbe3866b76c883fe650a38dc75109732b5391aa/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/29 12:11:02 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/29 12:11:02 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/29 12:11:02 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 70226da8d782d00608f23c34b12e4588c164abd81ecd5a5f105121fb9c62ccd4. Logs:
2021/05/29 12:11:01 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622290258002805754"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622290258002805754-jenkins-0529121100-1cff0ae2"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:44359"} artifact_endpoint:{url:"localhost:46799"} control_endpoint:{url:"localhost:38499"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/69f8d509ef0235415bac27f52fbe3866b76c883fe650a38dc75109732b5391aa/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/29 12:11:01 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:43855
2021/05/29 12:11:02 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/05/29 12:11:02 control response channel closed
21/05/29 12:11:03 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622290258002805754-jenkins-0529121100-1cff0ae2_85aabff5-0ce6-4a12-ab5d-11d12550eb11 finished.
2021/05/29 12:11:03 Job state: DONE
21/05/29 12:11:03 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622290258002805754-jenkins-0529121100-1cff0ae2_85aabff5-0ce6-4a12-ab5d-11d12550eb11
21/05/29 12:11:03 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622290258002805754-jenkins-0529121100-1cff0ae2_85aabff5-0ce6-4a12-ab5d-11d12550eb11
2021/05/29 12:11:03 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (29.16s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 29.183s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.019s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 34s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/g7ikxeg5jabbq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4733
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4733/display/redirect?page=changes>
Changes:
[noreply] [BEAM-11608] Development environment set up automation (#14584)
------------------------------------------
[...truncated 546.47 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/29 06:13:51 Prepared job with id: go-job-5-1622268831856323278_4dc2da95-e73f-4e19-b69c-d566e66b2dee and staging token: go-job-5-1622268831856323278_4dc2da95-e73f-4e19-b69c-d566e66b2dee
2021/05/29 06:13:51 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622268831858653583
21/05/29 06:13:54 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622268831856323278_4dc2da95-e73f-4e19-b69c-d566e66b2dee.
21/05/29 06:13:54 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622268831856323278_4dc2da95-e73f-4e19-b69c-d566e66b2dee.go.
21/05/29 06:13:54 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622268831856323278_4dc2da95-e73f-4e19-b69c-d566e66b2dee.null.
21/05/29 06:13:54 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622268831856323278_4dc2da95-e73f-4e19-b69c-d566e66b2dee.
2021/05/29 06:13:54 Staged binary artifact with token:
21/05/29 06:13:54 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622268831856323278-jenkins-0529061354-601e2e5_0b4c7649-0dad-471a-bd62-c90f9d239083
21/05/29 06:13:54 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622268831856323278-jenkins-0529061354-601e2e5_0b4c7649-0dad-471a-bd62-c90f9d239083
2021/05/29 06:13:54 Submitted job: go0job0501622268831856323278-jenkins-0529061354-601e2e5_0b4c7649-0dad-471a-bd62-c90f9d239083
2021/05/29 06:13:54 Job state: STOPPED
2021/05/29 06:13:54 Job state: STARTING
2021/05/29 06:13:54 Job state: RUNNING
21/05/29 06:13:54 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/29 06:13:54 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622268831856323278-jenkins-0529061354-601e2e5_0b4c7649-0dad-471a-bd62-c90f9d239083 on Spark master local
21/05/29 06:13:54 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/29 06:13:54 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622268831856323278-jenkins-0529061354-601e2e5_0b4c7649-0dad-471a-bd62-c90f9d239083: Pipeline translated successfully. Computing outputs
21/05/29 06:13:54 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/29 06:13:55 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/29 06:13:55 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/29 06:13:55 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44555 ...
21/05/29 06:13:55 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:42063 ...
21/05/29 06:13:55 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/29 06:13:55 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:40507 ...
21/05/29 06:13:55 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/29 06:13:55 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2719116 ns
21/05/29 06:13:55 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1501200 ns
21/05/29 06:13:55 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/f9819db2fd14a32a59cb70a1f08d6efc402dafad294b62e990f2761622b53d87/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/29 06:13:55 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/29 06:13:55 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/29 06:13:55 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container b8b137c76d97cce61aa2300b66bf9eeda1d76a6d55da395b48b1b96998ec86be. Logs:
2021/05/29 06:13:55 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622268831856323278"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622268831856323278-jenkins-0529061354-601e2e5"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:42063"} artifact_endpoint:{url:"localhost:40261"} control_endpoint:{url:"localhost:44555"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/f9819db2fd14a32a59cb70a1f08d6efc402dafad294b62e990f2761622b53d87/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/29 06:13:55 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:44621
2021/05/29 06:13:55 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
2021/05/29 06:13:55 control response channel closed
Worker exited successfully!
21/05/29 06:13:56 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622268831856323278-jenkins-0529061354-601e2e5_0b4c7649-0dad-471a-bd62-c90f9d239083 finished.
2021/05/29 06:13:56 Job state: DONE
21/05/29 06:13:56 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622268831856323278-jenkins-0529061354-601e2e5_0b4c7649-0dad-471a-bd62-c90f9d239083
21/05/29 06:13:56 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622268831856323278-jenkins-0529061354-601e2e5_0b4c7649-0dad-471a-bd62-c90f9d239083
2021/05/29 06:13:56 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (25.09s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 25.111s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.016s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 13m 29s
79 actionable tasks: 55 executed, 24 from cache
Publishing build scan...
https://gradle.com/s/nleup2fltcxlw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org