You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/05/31 06:13:17 UTC
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4741
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4741/display/redirect>
Changes:
------------------------------------------
[...truncated 546.67 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/31 06:13:08 Prepared job with id: go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23 and staging token: go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23
2021/05/31 06:13:08 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622441588542188274
21/05/31 06:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23.
21/05/31 06:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23.go.
21/05/31 06:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23.null.
21/05/31 06:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622441588539781408_82fa32db-7b47-4b0c-9c49-6d982c135e23.
2021/05/31 06:13:10 Staged binary artifact with token:
21/05/31 06:13:10 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0
21/05/31 06:13:10 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0
2021/05/31 06:13:10 Submitted job: go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0
2021/05/31 06:13:10 Job state: STOPPED
2021/05/31 06:13:10 Job state: STARTING
2021/05/31 06:13:10 Job state: RUNNING
21/05/31 06:13:10 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/31 06:13:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0 on Spark master local
21/05/31 06:13:10 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/31 06:13:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0: Pipeline translated successfully. Computing outputs
21/05/31 06:13:11 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/31 06:13:12 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:42597 ...
21/05/31 06:13:12 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:43983 ...
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/31 06:13:12 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37435 ...
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/31 06:13:12 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2884294 ns
21/05/31 06:13:12 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1502687 ns
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/bfc4a8156e0981dc9ade400d1fa2c499f57b9636545a7a306392b8640c74dc6b/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/31 06:13:12 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/31 06:13:12 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 02566e585ffa101d4275a014b7e2447ee124450ed0983f50a203962a7cc336c2. Logs:
2021/05/31 06:13:12 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622441588539781408"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622441588539781408-jenkins-0531061310-24d36646"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:43983"} artifact_endpoint:{url:"localhost:41691"} control_endpoint:{url:"localhost:42597"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/bfc4a8156e0981dc9ade400d1fa2c499f57b9636545a7a306392b8640c74dc6b/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/31 06:13:12 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:42061
2021/05/31 06:13:12 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/05/31 06:13:12 control response channel closed
21/05/31 06:13:13 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0 finished.
2021/05/31 06:13:13 Job state: DONE
21/05/31 06:13:13 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0
21/05/31 06:13:13 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622441588539781408-jenkins-0531061310-24d36646_d16983ed-5aaf-4c7c-a89f-260be62e7db0
2021/05/31 06:13:13 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (23.57s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 23.585s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.016s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 45s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/rpdp6zxd7duag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Go_VR_Spark #4751
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4751/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4750
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4750/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-12281] Drop support for Flink 1.10
[Ismaël Mejía] [BEAM-12281] Update Flink Jenkins jobs to use Flink 1.12
------------------------------------------
[...truncated 545.66 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/02 12:11:05 Prepared job with id: go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813 and staging token: go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813
2021/06/02 12:11:05 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622635865887115713
21/06/02 12:11:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813.
21/06/02 12:11:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813.go.
21/06/02 12:11:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813.null.
21/06/02 12:11:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622635865884473617_bf7a6458-0d33-4586-9af3-ee2efac98813.
2021/06/02 12:11:08 Staged binary artifact with token:
21/06/02 12:11:08 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7
21/06/02 12:11:08 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7
2021/06/02 12:11:08 Submitted job: go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7
2021/06/02 12:11:08 Job state: STOPPED
2021/06/02 12:11:08 Job state: STARTING
2021/06/02 12:11:08 Job state: RUNNING
21/06/02 12:11:08 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/02 12:11:08 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7 on Spark master local
21/06/02 12:11:08 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/02 12:11:08 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7: Pipeline translated successfully. Computing outputs
21/06/02 12:11:09 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/02 12:11:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:35417 ...
21/06/02 12:11:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44973 ...
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/02 12:11:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:36153 ...
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/02 12:11:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2828080 ns
21/06/02 12:11:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1552704 ns
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/e0172f1adb46b13234df41f900e309ca543aa0fc456b98534e1a9d7a46240b88/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/02 12:11:10 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/02 12:11:10 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 8ecfabecf337a1a2b40b86aabed06600cea071b40368848d46e739ee2f14ab61. Logs:
2021/06/02 12:11:09 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622635865884473617"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622635865884473617-jenkins-0602121108-b9829dd5"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:44973"} artifact_endpoint:{url:"localhost:34739"} control_endpoint:{url:"localhost:35417"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/e0172f1adb46b13234df41f900e309ca543aa0fc456b98534e1a9d7a46240b88/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/02 12:11:09 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:36921
2021/06/02 12:11:10 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/06/02 12:11:10 control response channel closed
21/06/02 12:11:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7 finished.
2021/06/02 12:11:10 Job state: DONE
21/06/02 12:11:10 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7
21/06/02 12:11:10 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622635865884473617-jenkins-0602121108-b9829dd5_b872aef9-912c-4c1f-8f10-17b4e58475b7
2021/06/02 12:11:10 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (45.42s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 45.438s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.020s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 10m 45s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/veaqtn3rt5muo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4749
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4749/display/redirect?page=changes>
Changes:
[Brian Hulette] Add DataFrame API updates to CHANGES.md
------------------------------------------
[...truncated 545.97 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/02 06:12:58 Prepared job with id: go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617 and staging token: go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617
2021/06/02 06:12:58 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622614378322587806
21/06/02 06:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617.
21/06/02 06:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617.go.
21/06/02 06:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617.null.
21/06/02 06:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622614378320056534_b1eb2985-ca77-430f-9d5d-e5ec34979617.
2021/06/02 06:13:00 Staged binary artifact with token:
21/06/02 06:13:00 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9
21/06/02 06:13:00 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9
2021/06/02 06:13:00 Submitted job: go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9
2021/06/02 06:13:00 Job state: STOPPED
2021/06/02 06:13:00 Job state: STARTING
2021/06/02 06:13:00 Job state: RUNNING
21/06/02 06:13:00 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/02 06:13:00 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9 on Spark master local
21/06/02 06:13:00 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/02 06:13:00 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9: Pipeline translated successfully. Computing outputs
21/06/02 06:13:01 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/02 06:13:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:45403 ...
21/06/02 06:13:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:41489 ...
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/02 06:13:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:39363 ...
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/02 06:13:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2433466 ns
21/06/02 06:13:02 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1340047 ns
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/584d750791270944e481cc9948ee9d414e4d4bf9f5e44c170587553430ecc14b/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/02 06:13:02 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/02 06:13:02 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container bbf5ffd687f32aaef8fa2f9407b92b0f09a1a3d4e31c46c347386649c514c5d5. Logs:
2021/06/02 06:13:02 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622614378320056534"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622614378320056534-jenkins-0602061300-152bfb7a"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:41489"} artifact_endpoint:{url:"localhost:43555"} control_endpoint:{url:"localhost:45403"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/584d750791270944e481cc9948ee9d414e4d4bf9f5e44c170587553430ecc14b/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/02 06:13:02 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:42195
2021/06/02 06:13:02 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
2021/06/02 06:13:02 control response channel closed
Worker exited successfully!
21/06/02 06:13:03 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9 finished.
2021/06/02 06:13:03 Job state: DONE
21/06/02 06:13:03 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9
21/06/02 06:13:03 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622614378320056534-jenkins-0602061300-152bfb7a_e23bc67f-3b38-483c-949f-dca4c369cab9
2021/06/02 06:13:03 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (24.37s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 24.397s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.017s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 36s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/swok6bh6cfj7m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4748
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4748/display/redirect?page=changes>
Changes:
[anant.damle] [BEAM-12427] Ignore the AutoValue_* classes generated in "generated"
[zyichi] [BEAM-12437] Fix broken test from missing allow_unsafe_triggers
[noreply] [BEAM-8787] Contribution Guide Improvement (#14477)
------------------------------------------
[...truncated 545.69 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/02 00:12:36 Prepared job with id: go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14 and staging token: go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14
2021/06/02 00:12:36 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622592756040468082
21/06/02 00:12:38 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14.
21/06/02 00:12:38 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14.go.
21/06/02 00:12:38 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14.null.
21/06/02 00:12:39 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622592756036881929_9b4a4f1e-bb87-4ad8-a3de-98074dabbe14.
2021/06/02 00:12:39 Staged binary artifact with token:
21/06/02 00:12:39 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832
21/06/02 00:12:39 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832
2021/06/02 00:12:39 Submitted job: go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832
2021/06/02 00:12:39 Job state: STOPPED
2021/06/02 00:12:39 Job state: STARTING
2021/06/02 00:12:39 Job state: RUNNING
21/06/02 00:12:39 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/02 00:12:39 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832 on Spark master local
21/06/02 00:12:39 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/02 00:12:39 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832: Pipeline translated successfully. Computing outputs
21/06/02 00:12:39 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/02 00:12:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:46255 ...
21/06/02 00:12:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44209 ...
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/02 00:12:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37357 ...
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/02 00:12:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 5084419 ns
21/06/02 00:12:41 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 3268731 ns
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/e537c06e959c51cdfff023592fc77ffdf0178dd3a9d478962e7243fd6eba55d4/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/02 00:12:41 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/02 00:12:41 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container a03996b6b489862fbbd0951f6fd13ea63ca268993b51f8591eedea33e4138eda. Logs:
2021/06/02 00:12:41 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622592756036881929"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622592756036881929-jenkins-0602001239-b9a685d4"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:44209"} artifact_endpoint:{url:"localhost:38927"} control_endpoint:{url:"localhost:46255"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/e537c06e959c51cdfff023592fc77ffdf0178dd3a9d478962e7243fd6eba55d4/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/02 00:12:41 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:40975
2021/06/02 00:12:41 Downloaded: /tmp/staged/worker (sha256: c2916509ce24fd164a6da497ba571012495647f3bed7500cdc24643eb4af3af8, size: 27884796)
2021/06/02 00:12:41 control response channel closed
Remote logging shutting down.Worker exited successfully!
21/06/02 00:12:43 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832 finished.
2021/06/02 00:12:43 Job state: DONE
21/06/02 00:12:43 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832
21/06/02 00:12:43 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622592756036881929-jenkins-0602001239-b9a685d4_839fabdf-2016-4e3a-b1cc-f5de8cd50832
2021/06/02 00:12:43 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (30.79s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 30.817s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.023s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 19s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/bz5w6j3re3x44
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4747
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4747/display/redirect?page=changes>
Changes:
[zyichi] Minor fix to prebuilding sdk workflow timeout setting
[Ismaël Mejía] [BEAM-12423] Upgrade pyarrow to support version 4.0.0 too
------------------------------------------
[...truncated 545.59 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/01 18:15:05 Prepared job with id: go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8 and staging token: go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8
2021/06/01 18:15:05 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622571305291135607
21/06/01 18:15:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8.
21/06/01 18:15:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8.go.
21/06/01 18:15:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8.null.
21/06/01 18:15:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622571305288527188_61ef50fe-c7a1-433a-9ff9-df1854cf3ea8.
2021/06/01 18:15:08 Staged binary artifact with token:
21/06/01 18:15:08 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e
21/06/01 18:15:08 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e
2021/06/01 18:15:08 Submitted job: go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e
2021/06/01 18:15:08 Job state: STOPPED
2021/06/01 18:15:08 Job state: STARTING
2021/06/01 18:15:08 Job state: RUNNING
21/06/01 18:15:08 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/01 18:15:08 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e on Spark master local
21/06/01 18:15:08 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/01 18:15:08 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e: Pipeline translated successfully. Computing outputs
21/06/01 18:15:09 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/01 18:15:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37539 ...
21/06/01 18:15:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37473 ...
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/01 18:15:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37345 ...
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/01 18:15:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 3369206 ns
21/06/01 18:15:10 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1902441 ns
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/eaffad8902bcc2011b67bdfb4f2556d7fe2eddc5af547157766283b182fb692b/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/01 18:15:10 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/01 18:15:10 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container e837bbee9b0669bf36e667d628cb38df60ced3686c226a90a004c5b3775d7e4b. Logs:
2021/06/01 18:15:10 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622571305288527188"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:37473"} artifact_endpoint:{url:"localhost:39421"} control_endpoint:{url:"localhost:37539"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/eaffad8902bcc2011b67bdfb4f2556d7fe2eddc5af547157766283b182fb692b/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/01 18:15:10 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:38387
2021/06/01 18:15:10 Downloaded: /tmp/staged/worker (sha256: c2916509ce24fd164a6da497ba571012495647f3bed7500cdc24643eb4af3af8, size: 27884796)
Worker exited successfully!
2021/06/01 18:15:10 control response channel closed
21/06/01 18:15:11 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e finished.
2021/06/01 18:15:11 Job state: DONE
21/06/01 18:15:11 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e
21/06/01 18:15:11 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622571305288527188-jenkins-0601181508-7ed5b8dd_12aefc22-f2d7-40e2-a1ec-5210c952959e
2021/06/01 18:15:11 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (34.41s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 34.432s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.018s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 14m 45s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/d6qpimrkcdspw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4746
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4746/display/redirect>
Changes:
------------------------------------------
[...truncated 545.77 KB...]
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/01 12:12:42 Prepared job with id: go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60 and staging token: go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60
2021/06/01 12:12:42 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622549562344721298
21/06/01 12:12:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60.
21/06/01 12:12:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60.go.
21/06/01 12:12:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60.null.
21/06/01 12:12:44 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622549562342099029_c09ccb1c-e2aa-45c1-be64-27b76923dc60.
2021/06/01 12:12:44 Staged binary artifact with token:
21/06/01 12:12:44 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d
21/06/01 12:12:44 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d
2021/06/01 12:12:44 Submitted job: go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d
2021/06/01 12:12:44 Job state: STOPPED
2021/06/01 12:12:44 Job state: STARTING
2021/06/01 12:12:44 Job state: RUNNING
21/06/01 12:12:44 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/01 12:12:44 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d on Spark master local
21/06/01 12:12:44 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/01 12:12:44 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d: Pipeline translated successfully. Computing outputs
21/06/01 12:12:45 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/01 12:12:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:45455 ...
21/06/01 12:12:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:34893 ...
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/01 12:12:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37033 ...
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/01 12:12:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2641799 ns
21/06/01 12:12:46 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1475344 ns
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/e5b872fdb855e253be8270f8ceb63d6ff27a375d99ddb8ea467820a268d156a8/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/01 12:12:46 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/01 12:12:46 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 1b0c83e67f62948db6498889c9b2bfd06dfef7c80c5ca00562dba63fc6537254. Logs:
2021/06/01 12:12:46 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622549562342099029"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622549562342099029-jenkins-0601121244-88a2927a"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:34893"} artifact_endpoint:{url:"localhost:44485"} control_endpoint:{url:"localhost:45455"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/e5b872fdb855e253be8270f8ceb63d6ff27a375d99ddb8ea467820a268d156a8/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/01 12:12:46 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:40417
2021/06/01 12:12:46 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/06/01 12:12:46 control response channel closed
21/06/01 12:12:47 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d finished.
2021/06/01 12:12:47 Job state: DONE
21/06/01 12:12:47 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d
21/06/01 12:12:47 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622549562342099029-jenkins-0601121244-88a2927a_2f9c993e-2b06-4766-82ab-2ccbb215a16d
2021/06/01 12:12:47 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (24.48s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 24.494s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.017s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 20s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
Publishing build scan failed due to network error 'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)...
https://gradle.com/s/h7qjtxg4o3l4q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4745
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4745/display/redirect>
Changes:
------------------------------------------
[...truncated 546.35 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/01 06:13:17 Prepared job with id: go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208 and staging token: go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208
2021/06/01 06:13:17 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622527997923926760
21/06/01 06:13:20 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208.
21/06/01 06:13:20 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208.go.
21/06/01 06:13:20 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208.null.
21/06/01 06:13:20 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622527997921345339_e89469a2-f2d3-49db-a97c-a8addc242208.
2021/06/01 06:13:20 Staged binary artifact with token:
21/06/01 06:13:20 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1
21/06/01 06:13:20 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1
2021/06/01 06:13:20 Submitted job: go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1
2021/06/01 06:13:20 Job state: STOPPED
2021/06/01 06:13:20 Job state: STARTING
2021/06/01 06:13:20 Job state: RUNNING
21/06/01 06:13:20 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/01 06:13:20 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1 on Spark master local
21/06/01 06:13:20 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/01 06:13:20 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1: Pipeline translated successfully. Computing outputs
21/06/01 06:13:20 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/01 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:33429 ...
21/06/01 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:33361 ...
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/01 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:44779 ...
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/01 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2774368 ns
21/06/01 06:13:21 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1435005 ns
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/63906311f9221f387ca0b03c24aeb74d4c9e63eee4ddb305a5debafe612ca5a3/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/01 06:13:21 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/01 06:13:21 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 414b39292ab02f1b521b8c4c3d45293b6d78fc01f540e1ade8d048059e95a86b. Logs:
2021/06/01 06:13:21 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622527997921345339"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622527997921345339-jenkins-0601061320-d7855d32"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:33361"} artifact_endpoint:{url:"localhost:35153"} control_endpoint:{url:"localhost:33429"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/63906311f9221f387ca0b03c24aeb74d4c9e63eee4ddb305a5debafe612ca5a3/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/01 06:13:21 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:40595
2021/06/01 06:13:21 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/06/01 06:13:21 control response channel closed
21/06/01 06:13:22 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1 finished.
2021/06/01 06:13:22 Job state: DONE
21/06/01 06:13:22 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1
21/06/01 06:13:22 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622527997921345339-jenkins-0601061320-d7855d32_c518d929-a27a-4a1b-8336-843f5a15d5a1
2021/06/01 06:13:22 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (23.49s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 23.506s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.018s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 56s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/mkj4jbn75oxcc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4744
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4744/display/redirect>
Changes:
------------------------------------------
[...truncated 545.89 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/06/01 00:13:07 Prepared job with id: go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c and staging token: go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c
2021/06/01 00:13:07 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622506387941605896
21/06/01 00:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c.
21/06/01 00:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c.go.
21/06/01 00:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c.null.
21/06/01 00:13:10 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622506387939373424_87548c4a-f103-48f4-8793-28c7d1fbf48c.
2021/06/01 00:13:10 Staged binary artifact with token:
21/06/01 00:13:10 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc
21/06/01 00:13:10 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc
2021/06/01 00:13:10 Submitted job: go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc
2021/06/01 00:13:10 Job state: STOPPED
2021/06/01 00:13:10 Job state: STARTING
2021/06/01 00:13:10 Job state: RUNNING
21/06/01 00:13:10 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/06/01 00:13:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc on Spark master local
21/06/01 00:13:10 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/06/01 00:13:10 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc: Pipeline translated successfully. Computing outputs
21/06/01 00:13:10 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/06/01 00:13:11 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:43579 ...
21/06/01 00:13:11 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:45393 ...
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/06/01 00:13:11 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:35371 ...
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/06/01 00:13:11 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 3036448 ns
21/06/01 00:13:11 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1769681 ns
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/8c93a6c62be388cb97491ee6aa433985d8f1bbc3adfbe56c420feaca49831817/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/06/01 00:13:11 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/06/01 00:13:11 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container df085ae8fa951f02f3f03199c793fcdf6fd37d78c7c497321e9cfbc8f2e7d499. Logs:
2021/06/01 00:13:11 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622506387939373424"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622506387939373424-jenkins-0601001310-fbb4149a"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:45393"} artifact_endpoint:{url:"localhost:44509"} control_endpoint:{url:"localhost:43579"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/8c93a6c62be388cb97491ee6aa433985d8f1bbc3adfbe56c420feaca49831817/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/06/01 00:13:11 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:46695
2021/06/01 00:13:11 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/06/01 00:13:11 control response channel closed
21/06/01 00:13:12 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc finished.
2021/06/01 00:13:12 Job state: DONE
21/06/01 00:13:12 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc
21/06/01 00:13:12 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622506387939373424-jenkins-0601001310-fbb4149a_2908311d-351f-4e27-9403-caa9f2391acc
2021/06/01 00:13:12 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (23.54s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 23.564s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.016s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 47s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/izasu2jlisqai
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4743
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4743/display/redirect>
Changes:
------------------------------------------
[...truncated 545.94 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/31 18:12:44 Prepared job with id: go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44 and staging token: go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44
2021/05/31 18:12:44 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622484764975225006
21/05/31 18:12:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44.
21/05/31 18:12:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44.go.
21/05/31 18:12:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44.null.
21/05/31 18:12:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622484764972370019_b371a5ee-e566-41f0-a241-bfa7205bce44.
2021/05/31 18:12:47 Staged binary artifact with token:
21/05/31 18:12:47 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255
21/05/31 18:12:47 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255
2021/05/31 18:12:47 Submitted job: go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255
2021/05/31 18:12:47 Job state: STOPPED
2021/05/31 18:12:47 Job state: STARTING
2021/05/31 18:12:47 Job state: RUNNING
21/05/31 18:12:47 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/31 18:12:47 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255 on Spark master local
21/05/31 18:12:47 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/31 18:12:47 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255: Pipeline translated successfully. Computing outputs
21/05/31 18:12:48 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/31 18:12:49 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:35419 ...
21/05/31 18:12:49 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:46655 ...
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/31 18:12:49 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:46337 ...
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/31 18:12:49 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2933349 ns
21/05/31 18:12:49 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1635793 ns
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/76a835c81f77ba8d4d538a30e678d2727424d1f37c160c1a33885a65c660a02b/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/31 18:12:49 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/31 18:12:49 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container d3889c99a3722b2e6095a3135eecced6c3251f479bc23e4010794763782667c5. Logs:
2021/05/31 18:12:48 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622484764972370019"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622484764972370019-jenkins-0531181247-6f9350b7"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:46655"} artifact_endpoint:{url:"localhost:37755"} control_endpoint:{url:"localhost:35419"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/76a835c81f77ba8d4d538a30e678d2727424d1f37c160c1a33885a65c660a02b/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/31 18:12:48 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:44417
2021/05/31 18:12:49 Downloaded: /tmp/staged/worker (sha256: e8864cc86a6c584c6627052c274d26fcf22d42048a497895ae25198de3b228c8, size: 27884796)
Worker exited successfully!
2021/05/31 18:12:49 control response channel closed
21/05/31 18:12:49 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255 finished.
2021/05/31 18:12:49 Job state: DONE
21/05/31 18:12:49 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255
21/05/31 18:12:49 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622484764972370019-jenkins-0531181247-6f9350b7_1e9fe96f-d082-4afd-adf7-5150dfe83255
2021/05/31 18:12:49 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (24.47s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 24.491s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.017s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 23s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/ti6spzi4uzars
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4742
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4742/display/redirect?page=changes>
Changes:
[Ismaël Mejía] [BEAM-12277] Update Flink 1.13 version to 1.13.1
[Ismaël Mejía] [BEAM-12424] Update Flink 1.12 to version 1.12.4
------------------------------------------
[...truncated 545.11 KB...]
component_coder_ids: "c9"
>
>
coders: <
key: "c2"
value: <
spec: <
urn: "beam:coder:length_prefix:v1"
>
component_coder_ids: "c1"
>
>
coders: <
key: "c3"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c2"
>
>
coders: <
key: "c4"
value: <
spec: <
urn: "beam:coder:global_window:v1"
>
>
>
coders: <
key: "c5"
value: <
spec: <
urn: "beam:coder:bytes:v1"
>
>
>
coders: <
key: "c6"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c2"
>
>
coders: <
key: "c7"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c0"
component_coder_ids: "c6"
>
>
coders: <
key: "c8"
value: <
spec: <
urn: "beam:coder:kv:v1"
>
component_coder_ids: "c2"
component_coder_ids: "c0"
>
>
coders: <
key: "c9"
value: <
spec: <
urn: "beam:coder:iterable:v1"
>
component_coder_ids: "c0"
>
>
environments: <
key: "go"
value: <
urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/05/31 12:12:12 Prepared job with id: go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a and staging token: go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a
2021/05/31 12:12:12 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1622463132233630280
21/05/31 12:12:14 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a.
21/05/31 12:12:14 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a.go.
21/05/31 12:12:14 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a.null.
21/05/31 12:12:14 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1622463132231234252_87ea7f69-b8a8-4965-9cfc-ecf7e66b018a.
2021/05/31 12:12:14 Staged binary artifact with token:
21/05/31 12:12:14 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1
21/05/31 12:12:14 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1
2021/05/31 12:12:14 Submitted job: go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1
2021/05/31 12:12:14 Job state: STOPPED
2021/05/31 12:12:14 Job state: STARTING
2021/05/31 12:12:14 Job state: RUNNING
21/05/31 12:12:14 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.
21/05/31 12:12:14 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1 on Spark master local
21/05/31 12:12:14 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.
21/05/31 12:12:14 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1: Pipeline translated successfully. Computing outputs
21/05/31 12:12:15 WARN org.apache.beam.runners.fnexecution.environment.DockerCommand: Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: Beam Fn Logging client connected.
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 38-1
21/05/31 12:12:16 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:45521 ...
21/05/31 12:12:16 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37107 ...
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 38-2
21/05/31 12:12:16 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:504: Connecting via grpc @ localhost:37695 ...
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.
21/05/31 12:12:16 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232: DataSource: 1 elements in 2542551 ns
21/05/31 12:12:16 INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84: DataSink: 0 elements in 1420436 ns
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\ng/tmp/beam-artifact-staging/7f8e7e88a5e9e62c99e16b2a15d24de168a48d59695f56982e342efeddfce32b/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService: 1 Beam Fn Logging clients still connected during shutdown.
21/05/31 12:12:16 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.
21/05/31 12:12:16 INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment: Closing Docker container 2ef7d796de5a91fcedc9ad5f14e0111c742c2050f5ddc6a275e6d4d61d5069a8. Logs:
2021/05/31 12:12:16 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-5-1622463132231234252"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:job_name:v1" value:{string_value:"go0job0501622463132231234252-jenkins-0531121214-10387377"}} fields:{key:"beam:option:options_id:v1" value:{number_value:13}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:spark_master:v1" value:{string_value:"local"}}} logging_endpoint:{url:"localhost:37107"} artifact_endpoint:{url:"localhost:43953"} control_endpoint:{url:"localhost:45521"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/7f8e7e88a5e9e62c99e16b2a15d24de168a48d59695f56982e342efeddfce32b/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/05/31 12:12:16 Initializing Go harness: /opt/apache/beam/boot --id=38-1 --provision_endpoint=localhost:44379
2021/05/31 12:12:16 Downloaded: /tmp/staged/worker (sha256: c2916509ce24fd164a6da497ba571012495647f3bed7500cdc24643eb4af3af8, size: 27884796)
Worker exited successfully!
2021/05/31 12:12:16 control response channel closed
21/05/31 12:12:17 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1 finished.
2021/05/31 12:12:17 Job state: DONE
21/05/31 12:12:17 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1
21/05/31 12:12:17 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501622463132231234252-jenkins-0531121214-10387377_1fe87048-f367-475e-a24e-87e05dcdd1d1
2021/05/31 12:12:17 Failed to deduce Step from MonitoringInfo: urn:"beam:metric:element_count:v1" type:"beam:metrics:sum_int64:v1" payload:"\x01" labels:{key:"PCOLLECTION" value:"n1"}
--- PASS: TestWordCount (25.41s)
PASS
ok github.com/apache/beam/sdks/go/test/integration/wordcount 25.426s
=== RUN TestXLang_Prefix
--- SKIP: TestXLang_Prefix (0.00s)
integration.go:134: Test TestXLang_Prefix is currently filtered for runner spark
=== RUN TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
integration.go:134: Test TestXLang_CoGroupBy is currently filtered for runner spark
=== RUN TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
integration.go:134: Test TestXLang_Combine is currently filtered for runner spark
=== RUN TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
integration.go:134: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
integration.go:134: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
integration.go:134: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
integration.go:134: Test TestXLang_Multi is currently filtered for runner spark
=== RUN TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
integration.go:134: Test TestXLang_Partition is currently filtered for runner spark
PASS
ok github.com/apache/beam/sdks/go/test/integration/xlang 0.017s
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
if [[ -n "$EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
exit $TEST_EXIT_CODE
exit_background_processes
> Task :sdks:go:test:sparkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 53s
79 actionable tasks: 52 executed, 27 from cache
Publishing build scan...
https://gradle.com/s/5kql55mznbpvm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org