You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/04/20 06:09:08 UTC

Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4585

See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4585/display/redirect?page=changes>

Changes:

[noreply] [BEAM-12191] Fix a bug that upload_graph doesn't reduce template file

[noreply] [BEAM-10029] Spanner IO read and write performance tests (#13857)


------------------------------------------
[...truncated 336.33 KB...]
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c1"
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c6"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_worker_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006worker"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/04/20 06:09:01 Prepared job with id: go-job-5-1618898941362377355_d2367251-bbfc-4bd4-8883-f429093182ef and staging token: go-job-5-1618898941362377355_d2367251-bbfc-4bd4-8883-f429093182ef
2021/04/20 06:09:01 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1618898941366966527
21/04/20 06:09:04 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1618898941362377355_d2367251-bbfc-4bd4-8883-f429093182ef.
21/04/20 06:09:04 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1618898941362377355_d2367251-bbfc-4bd4-8883-f429093182ef.go.
21/04/20 06:09:04 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1618898941362377355_d2367251-bbfc-4bd4-8883-f429093182ef.null.
21/04/20 06:09:04 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1618898941362377355_d2367251-bbfc-4bd4-8883-f429093182ef.
2021/04/20 06:09:04 Staged binary artifact with token: 
21/04/20 06:09:04 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501618898941362377355-jenkins-0420060904-db16c077_f3eab483-38ef-495d-92c2-0bcc0cf7b5cb
21/04/20 06:09:04 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501618898941362377355-jenkins-0420060904-db16c077_f3eab483-38ef-495d-92c2-0bcc0cf7b5cb
2021/04/20 06:09:04 Submitted job: go0job0501618898941362377355-jenkins-0420060904-db16c077_f3eab483-38ef-495d-92c2-0bcc0cf7b5cb
2021/04/20 06:09:04 Job state: STOPPED
2021/04/20 06:09:04 Job state: STARTING
2021/04/20 06:09:04 Job state: RUNNING
21/04/20 06:09:04 ERROR org.apache.beam.runners.jobsubmission.JobInvocation: Error during job invocation go0job0501618898941362377355-jenkins-0420060904-db16c077_f3eab483-38ef-495d-92c2-0bcc0cf7b5cb.
java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/20 06:09:04  (): java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/20 06:09:04  (): java.lang.NullPointerException
2021/04/20 06:09:04 Job state: FAILED
21/04/20 06:09:04 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501618898941362377355-jenkins-0420060904-db16c077_f3eab483-38ef-495d-92c2-0bcc0cf7b5cb
21/04/20 06:09:04 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501618898941362377355-jenkins-0420060904-db16c077_f3eab483-38ef-495d-92c2-0bcc0cf7b5cb
--- FAIL: TestWordCount (14.03s)
    wordcount_test.go:87: WordCount("foo") failed: job go0job0101618898930177143053-jenkins-0420060852-4042d15d_eafee25a-30fd-45dd-88bf-64859939bfb2 failed
    wordcount_test.go:87: WordCount("foo foo foo|foo foo|foo") failed: job go0job0201618898933010106329-jenkins-0420060855-a38e7ba1_468aeeda-04cc-488d-aaf8-9256b6d3db63 failed
    wordcount_test.go:87: WordCount("bar bar foo bar foo foo") failed: job go0job0301618898935827637709-jenkins-0420060858-1d49b437_7ee2f11c-81a9-4315-8e2b-90de49aefcf6 failed
    wordcount_test.go:87: WordCount("foo bar foo bar foo bar") failed: job go0job0401618898938580343759-jenkins-0420060901-c8115591_7605ebdb-4086-4ee8-af18-ae8965a8c2ed failed
    wordcount_test.go:87: WordCount("|bar foo bar|  	 | 
        
        
         |foo bar|       foo") failed: job go0job0501618898941362377355-jenkins-0420060904-db16c077_f3eab483-38ef-495d-92c2-0bcc0cf7b5cb failed
FAIL
FAIL	github.com/apache/beam/sdks/go/test/integration/wordcount	14.055s
2021/04/20 06:09:05 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict

=== RUN   TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
    integration.go:105: Test TestXLang_CoGroupBy is currently sickbayed on all runners
=== RUN   TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
    integration.go:139: Test TestXLang_Combine is currently filtered for runner spark
=== RUN   TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
    integration.go:139: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN   TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
    integration.go:139: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN   TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
    integration.go:139: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN   TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
    integration.go:105: Test TestXLang_Multi is currently sickbayed on all runners
=== RUN   TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
    integration.go:105: Test TestXLang_Partition is currently sickbayed on all runners
PASS
ok  	github.com/apache/beam/sdks/go/test/integration/xlang	0.020s

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 36s
82 actionable tasks: 54 executed, 28 from cache
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/kqp2dv3kgmozc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Go_VR_Spark #4594

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4594/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4593

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4593/display/redirect?page=changes>

Changes:

[noreply] [BEAM-12191] Add a test for python template generation with upload_graph

[noreply] [BEAM-7372] fix wrong usage of with_traceback (#14566)

[noreply] [BEAM-7372] cleanup codes for py2 from apache_beam/transforms (#14544)

[noreply] [BEAM-2085] Fixups for Python resource hints. (#14605)


------------------------------------------
[...truncated 336.50 KB...]
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c1"
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c6"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_worker_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006worker"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/04/22 06:09:10 Prepared job with id: go-job-5-1619071750066453055_5d6d9751-e9f4-43f9-8ae9-97d80d9e1d76 and staging token: go-job-5-1619071750066453055_5d6d9751-e9f4-43f9-8ae9-97d80d9e1d76
2021/04/22 06:09:10 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1619071750070189847
21/04/22 06:09:12 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1619071750066453055_5d6d9751-e9f4-43f9-8ae9-97d80d9e1d76.
21/04/22 06:09:12 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1619071750066453055_5d6d9751-e9f4-43f9-8ae9-97d80d9e1d76.go.
21/04/22 06:09:12 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1619071750066453055_5d6d9751-e9f4-43f9-8ae9-97d80d9e1d76.null.
21/04/22 06:09:12 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1619071750066453055_5d6d9751-e9f4-43f9-8ae9-97d80d9e1d76.
2021/04/22 06:09:12 Staged binary artifact with token: 
21/04/22 06:09:12 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501619071750066453055-jenkins-0422060912-ca0359a6_c1feff73-1c62-4199-8023-d9d5ad51fead
21/04/22 06:09:12 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501619071750066453055-jenkins-0422060912-ca0359a6_c1feff73-1c62-4199-8023-d9d5ad51fead
2021/04/22 06:09:12 Submitted job: go0job0501619071750066453055-jenkins-0422060912-ca0359a6_c1feff73-1c62-4199-8023-d9d5ad51fead
2021/04/22 06:09:12 Job state: STOPPED
2021/04/22 06:09:12 Job state: STARTING
2021/04/22 06:09:12 Job state: RUNNING
21/04/22 06:09:12 ERROR org.apache.beam.runners.jobsubmission.JobInvocation: Error during job invocation go0job0501619071750066453055-jenkins-0422060912-ca0359a6_c1feff73-1c62-4199-8023-d9d5ad51fead.
java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/22 06:09:12  (): java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/22 06:09:12  (): java.lang.NullPointerException
2021/04/22 06:09:12 Job state: FAILED
21/04/22 06:09:12 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501619071750066453055-jenkins-0422060912-ca0359a6_c1feff73-1c62-4199-8023-d9d5ad51fead
21/04/22 06:09:12 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501619071750066453055-jenkins-0422060912-ca0359a6_c1feff73-1c62-4199-8023-d9d5ad51fead
--- FAIL: TestWordCount (13.33s)
    wordcount_test.go:87: WordCount("foo") failed: job go0job0101619071739369646394-jenkins-0422060902-7933f9dc_a4d0c371-7e1f-488d-9069-73e5030221a5 failed
    wordcount_test.go:87: WordCount("foo foo foo|foo foo|foo") failed: job go0job0201619071742153561391-jenkins-0422060904-fb2f9ef9_c010b066-6968-42c5-b0de-7096312e5383 failed
    wordcount_test.go:87: WordCount("bar bar foo bar foo foo") failed: job go0job0301619071744789697295-jenkins-0422060907-5a5ee033_f5915ac5-f0cd-4742-b2e7-37ccdd28400e failed
    wordcount_test.go:87: WordCount("foo bar foo bar foo bar") failed: job go0job0401619071747413965416-jenkins-0422060910-a36f721d_28adeea5-6010-45b2-ba52-ce0461fc6439 failed
    wordcount_test.go:87: WordCount("|bar foo bar|  	 | 
        
        
         |foo bar|       foo") failed: job go0job0501619071750066453055-jenkins-0422060912-ca0359a6_c1feff73-1c62-4199-8023-d9d5ad51fead failed
FAIL
FAIL	github.com/apache/beam/sdks/go/test/integration/wordcount	13.354s
2021/04/22 06:09:14 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict

=== RUN   TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
    integration.go:105: Test TestXLang_CoGroupBy is currently sickbayed on all runners
=== RUN   TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
    integration.go:139: Test TestXLang_Combine is currently filtered for runner spark
=== RUN   TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
    integration.go:139: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN   TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
    integration.go:139: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN   TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
    integration.go:139: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN   TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
    integration.go:105: Test TestXLang_Multi is currently sickbayed on all runners
=== RUN   TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
    integration.go:105: Test TestXLang_Partition is currently sickbayed on all runners
PASS
ok  	github.com/apache/beam/sdks/go/test/integration/xlang	0.019s

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 51s
82 actionable tasks: 55 executed, 27 from cache
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/onow4hvrv2ja4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4592

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4592/display/redirect?page=changes>

Changes:

[sychen] Add a BQ option for configuring buffering duration when auto-sharding is

[suztomo] [BEAM-11010] Upgrading google-cloud-pubsublite to 0.13.2

[suztomo] [BEAM-11010] Copying SubscriberOptions from pubsublite repo

[suztomo] [BEAM-11010] Declaring flogger-system-backend to avoid conflicts

[Kyle Weaver] [BEAM-12194] Enable SqlTransform::registerUdaf in ZetaSQL.

[Kyle Weaver] [BEAM-12194] Code style changes from review.

[Boyuan Zhang] [BEAM-12114] Dataflow should apply KAFKA_READ_OVERRIDE when it's not

[noreply] Make sdk/worker_harness_container_image fully backwards compatible


------------------------------------------
[...truncated 339.00 KB...]
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c1"
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c6"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_worker_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006worker"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/04/22 00:21:05 Prepared job with id: go-job-5-1619050865556539704_d357553e-29c0-456e-9921-053265136be2 and staging token: go-job-5-1619050865556539704_d357553e-29c0-456e-9921-053265136be2
2021/04/22 00:21:05 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1619050865561663302
21/04/22 00:21:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1619050865556539704_d357553e-29c0-456e-9921-053265136be2.
21/04/22 00:21:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1619050865556539704_d357553e-29c0-456e-9921-053265136be2.go.
21/04/22 00:21:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1619050865556539704_d357553e-29c0-456e-9921-053265136be2.null.
21/04/22 00:21:08 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1619050865556539704_d357553e-29c0-456e-9921-053265136be2.
2021/04/22 00:21:08 Staged binary artifact with token: 
21/04/22 00:21:08 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501619050865556539704-jenkins-0422002108-ca09292e_49bf53df-aacc-40d4-bfcc-57d4f8f85184
21/04/22 00:21:08 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501619050865556539704-jenkins-0422002108-ca09292e_49bf53df-aacc-40d4-bfcc-57d4f8f85184
2021/04/22 00:21:08 Submitted job: go0job0501619050865556539704-jenkins-0422002108-ca09292e_49bf53df-aacc-40d4-bfcc-57d4f8f85184
2021/04/22 00:21:08 Job state: STOPPED
2021/04/22 00:21:08 Job state: STARTING
2021/04/22 00:21:08 Job state: RUNNING
21/04/22 00:21:08 ERROR org.apache.beam.runners.jobsubmission.JobInvocation: Error during job invocation go0job0501619050865556539704-jenkins-0422002108-ca09292e_49bf53df-aacc-40d4-bfcc-57d4f8f85184.
java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/22 00:21:08  (): java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/22 00:21:08  (): java.lang.NullPointerException
2021/04/22 00:21:08 Job state: FAILED
21/04/22 00:21:08 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501619050865556539704-jenkins-0422002108-ca09292e_49bf53df-aacc-40d4-bfcc-57d4f8f85184
21/04/22 00:21:08 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501619050865556539704-jenkins-0422002108-ca09292e_49bf53df-aacc-40d4-bfcc-57d4f8f85184
--- FAIL: TestWordCount (20.14s)
    wordcount_test.go:87: WordCount("foo") failed: job go0job0101619050848865460580-jenkins-0422002053-edb1463d_06cfb464-b55a-4597-85b2-6d7d7d765060 failed
    wordcount_test.go:87: WordCount("foo foo foo|foo foo|foo") failed: job go0job0201619050853114234122-jenkins-0422002058-c06b428d_f30331d5-46b0-45b5-9187-14d30ef8cc73 failed
    wordcount_test.go:87: WordCount("bar bar foo bar foo foo") failed: job go0job0301619050858218505311-jenkins-0422002102-892b4aad_86018db2-f4ca-4058-a575-824954a319a2 failed
    wordcount_test.go:87: WordCount("foo bar foo bar foo bar") failed: job go0job0401619050862353627609-jenkins-0422002105-aa3d38b5_fef08f55-332c-4a42-8aae-9d8b82025f6b failed
    wordcount_test.go:87: WordCount("|bar foo bar|  	 | 
        
        
         |foo bar|       foo") failed: job go0job0501619050865556539704-jenkins-0422002108-ca09292e_49bf53df-aacc-40d4-bfcc-57d4f8f85184 failed
FAIL
FAIL	github.com/apache/beam/sdks/go/test/integration/wordcount	20.164s
2021/04/22 00:21:11 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict

=== RUN   TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
    integration.go:105: Test TestXLang_CoGroupBy is currently sickbayed on all runners
=== RUN   TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
    integration.go:139: Test TestXLang_Combine is currently filtered for runner spark
=== RUN   TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
    integration.go:139: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN   TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
    integration.go:139: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN   TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
    integration.go:139: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN   TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
    integration.go:105: Test TestXLang_Multi is currently sickbayed on all runners
=== RUN   TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
    integration.go:105: Test TestXLang_Partition is currently sickbayed on all runners
PASS
ok  	github.com/apache/beam/sdks/go/test/integration/xlang	0.025s

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 20m 37s
82 actionable tasks: 67 executed, 15 from cache
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/cmei4grfxb5ik

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4591

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4591/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-12009] Copy CalcRelSplitter.

[Kyle Weaver] [BEAM-12009] Implement Calc splitting rule.

[Kyle Weaver] [BEAM-12009] Use different method signature to avoid spurious null check

[Kyle Weaver] [BEAM-12009] Move CalcRelSplitter to rel subpackage.

[Kyle Weaver] [BEAM-12009] Reduce code duplication between rules by re-implementing

[Kyle Weaver] [BEAM-12009] Only match in BeamCalcSplittingRule if ≥ 1 of its component

[anup.d] BEAM-12166:Beam Sql - Combine Accumulator return Map fails with class

[suztomo] [BEAM-8357] Upgrading auto-value to 1.8 from 1.7.4

[Kenneth Knowles] Build source release zip from RC tag

[aromanenko.dev] [BEAM-12197] TPC-DS: Fix SQL-queries syntax


------------------------------------------
[...truncated 340.57 KB...]
        urn: "beam:coder:string_utf8:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c1"
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c6"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_worker_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006worker"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/04/21 18:21:44 Prepared job with id: go-job-5-1619029304978293845_651c28a5-5d7d-4467-b920-cdd5ca6aa24b and staging token: go-job-5-1619029304978293845_651c28a5-5d7d-4467-b920-cdd5ca6aa24b
2021/04/21 18:21:44 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1619029304983274664
21/04/21 18:21:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1619029304978293845_651c28a5-5d7d-4467-b920-cdd5ca6aa24b.
21/04/21 18:21:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1619029304978293845_651c28a5-5d7d-4467-b920-cdd5ca6aa24b.go.
21/04/21 18:21:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1619029304978293845_651c28a5-5d7d-4467-b920-cdd5ca6aa24b.null.
21/04/21 18:21:47 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1619029304978293845_651c28a5-5d7d-4467-b920-cdd5ca6aa24b.
2021/04/21 18:21:47 Staged binary artifact with token: 
21/04/21 18:21:47 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501619029304978293845-jenkins-0421182147-a531d35e_c8a4db21-06f0-4870-9891-17b0c3fc7cb8
21/04/21 18:21:47 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501619029304978293845-jenkins-0421182147-a531d35e_c8a4db21-06f0-4870-9891-17b0c3fc7cb8
2021/04/21 18:21:47 Submitted job: go0job0501619029304978293845-jenkins-0421182147-a531d35e_c8a4db21-06f0-4870-9891-17b0c3fc7cb8
2021/04/21 18:21:47 Job state: STOPPED
2021/04/21 18:21:47 Job state: STARTING
2021/04/21 18:21:47 Job state: RUNNING
21/04/21 18:21:47 ERROR org.apache.beam.runners.jobsubmission.JobInvocation: Error during job invocation go0job0501619029304978293845-jenkins-0421182147-a531d35e_c8a4db21-06f0-4870-9891-17b0c3fc7cb8.
java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/21 18:21:47  (): java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/21 18:21:47  (): java.lang.NullPointerException
2021/04/21 18:21:47 Job state: FAILED
21/04/21 18:21:47 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501619029304978293845-jenkins-0421182147-a531d35e_c8a4db21-06f0-4870-9891-17b0c3fc7cb8
21/04/21 18:21:47 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501619029304978293845-jenkins-0421182147-a531d35e_c8a4db21-06f0-4870-9891-17b0c3fc7cb8
--- FAIL: TestWordCount (19.19s)
    wordcount_test.go:87: WordCount("foo") failed: job go0job0101619029288590596574-jenkins-0421182132-a868a1ac_6f8a2654-58c3-4055-83a5-7704346c6001 failed
    wordcount_test.go:87: WordCount("foo foo foo|foo foo|foo") failed: job go0job0201619029292515868026-jenkins-0421182136-daae821_91f039e9-cbb4-4d54-b16a-22d6dcaff135 failed
    wordcount_test.go:87: WordCount("bar bar foo bar foo foo") failed: job go0job0301619029296710914520-jenkins-0421182140-b4b9f93b_4cee6693-8dbb-4c5b-9174-639fa93513ad failed
    wordcount_test.go:87: WordCount("foo bar foo bar foo bar") failed: job go0job0401619029300089380511-jenkins-0421182144-85321a06_0f2b2e38-be0e-4e63-9e72-6faa43c8b6c4 failed
    wordcount_test.go:87: WordCount("|bar foo bar|  	 | 
        
        
         |foo bar|       foo") failed: job go0job0501619029304978293845-jenkins-0421182147-a531d35e_c8a4db21-06f0-4870-9891-17b0c3fc7cb8 failed
FAIL
FAIL	github.com/apache/beam/sdks/go/test/integration/wordcount	19.218s
2021/04/21 18:21:49 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict

=== RUN   TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
    integration.go:105: Test TestXLang_CoGroupBy is currently sickbayed on all runners
=== RUN   TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
    integration.go:139: Test TestXLang_Combine is currently filtered for runner spark
=== RUN   TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
    integration.go:139: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN   TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
    integration.go:139: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN   TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
    integration.go:139: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN   TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
    integration.go:105: Test TestXLang_Multi is currently sickbayed on all runners
=== RUN   TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
    integration.go:105: Test TestXLang_Partition is currently sickbayed on all runners
PASS
ok  	github.com/apache/beam/sdks/go/test/integration/xlang	0.024s

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 21m 25s
82 actionable tasks: 74 executed, 8 from cache

Publishing build scan...
https://gradle.com/s/nz6mwhtwww2ye

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4590

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4590/display/redirect>

Changes:


------------------------------------------
[...truncated 336.08 KB...]
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c1"
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c6"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_worker_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006worker"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/04/21 12:09:46 Prepared job with id: go-job-5-1619006986158841090_309b99c8-db79-4d10-b786-85566aaebb74 and staging token: go-job-5-1619006986158841090_309b99c8-db79-4d10-b786-85566aaebb74
2021/04/21 12:09:46 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1619006986162607214
21/04/21 12:09:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1619006986158841090_309b99c8-db79-4d10-b786-85566aaebb74.
21/04/21 12:09:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1619006986158841090_309b99c8-db79-4d10-b786-85566aaebb74.go.
21/04/21 12:09:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1619006986158841090_309b99c8-db79-4d10-b786-85566aaebb74.null.
21/04/21 12:09:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1619006986158841090_309b99c8-db79-4d10-b786-85566aaebb74.
2021/04/21 12:09:48 Staged binary artifact with token: 
21/04/21 12:09:48 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501619006986158841090-jenkins-0421120948-228fb7c7_3597137a-293c-460a-8793-d33a266cd843
21/04/21 12:09:48 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501619006986158841090-jenkins-0421120948-228fb7c7_3597137a-293c-460a-8793-d33a266cd843
2021/04/21 12:09:48 Submitted job: go0job0501619006986158841090-jenkins-0421120948-228fb7c7_3597137a-293c-460a-8793-d33a266cd843
2021/04/21 12:09:48 Job state: STOPPED
2021/04/21 12:09:48 Job state: STARTING
2021/04/21 12:09:48 Job state: RUNNING
21/04/21 12:09:48 ERROR org.apache.beam.runners.jobsubmission.JobInvocation: Error during job invocation go0job0501619006986158841090-jenkins-0421120948-228fb7c7_3597137a-293c-460a-8793-d33a266cd843.
java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/21 12:09:48  (): java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/21 12:09:48  (): java.lang.NullPointerException
2021/04/21 12:09:48 Job state: FAILED
21/04/21 12:09:48 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501619006986158841090-jenkins-0421120948-228fb7c7_3597137a-293c-460a-8793-d33a266cd843
21/04/21 12:09:48 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501619006986158841090-jenkins-0421120948-228fb7c7_3597137a-293c-460a-8793-d33a266cd843
--- FAIL: TestWordCount (13.66s)
    wordcount_test.go:87: WordCount("foo") failed: job go0job0101619006975143363573-jenkins-0421120937-2c70c976_6bb75562-f5d4-49c8-b364-28c503b75655 failed
    wordcount_test.go:87: WordCount("foo foo foo|foo foo|foo") failed: job go0job0201619006977929111159-jenkins-0421120940-ba515448_249651d1-5de1-49ff-9831-d4df4bd92bbb failed
    wordcount_test.go:87: WordCount("bar bar foo bar foo foo") failed: job go0job0301619006980746000506-jenkins-0421120943-8bf93776_25f3f9d6-b17b-4b9e-8a9b-8dfb3fbfce09 failed
    wordcount_test.go:87: WordCount("foo bar foo bar foo bar") failed: job go0job0401619006983383273747-jenkins-0421120946-b2c39d30_93f5dc5d-0c8c-479e-9de3-643ee4a55847 failed
    wordcount_test.go:87: WordCount("|bar foo bar|  	 | 
        
        
         |foo bar|       foo") failed: job go0job0501619006986158841090-jenkins-0421120948-228fb7c7_3597137a-293c-460a-8793-d33a266cd843 failed
FAIL
FAIL	github.com/apache/beam/sdks/go/test/integration/wordcount	13.678s
2021/04/21 12:09:50 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict

=== RUN   TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
    integration.go:105: Test TestXLang_CoGroupBy is currently sickbayed on all runners
=== RUN   TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
    integration.go:139: Test TestXLang_Combine is currently filtered for runner spark
=== RUN   TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
    integration.go:139: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN   TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
    integration.go:139: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN   TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
    integration.go:139: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN   TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
    integration.go:105: Test TestXLang_Multi is currently sickbayed on all runners
=== RUN   TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
    integration.go:105: Test TestXLang_Partition is currently sickbayed on all runners
PASS
ok  	github.com/apache/beam/sdks/go/test/integration/xlang	0.019s

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 29s
82 actionable tasks: 54 executed, 28 from cache
Gradle was unable to watch the file system for changes. The inotify watches limit is too low.

Publishing build scan...
https://gradle.com/s/ajqecvl4ggfz6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4589

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4589/display/redirect?page=changes>

Changes:

[noreply] Update stringSlice to impl pkg.go.dev/flag#Getter.Get

[noreply] [BEAM-12174] Samza Portable Runner Support (#14554)


------------------------------------------
[...truncated 336.22 KB...]
        urn: "beam:coder:string_utf8:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c1"
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c6"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_worker_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006worker"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/04/21 06:15:01 Prepared job with id: go-job-5-1618985701034205514_6927bbd1-90b9-40cf-97ae-bed88da46102 and staging token: go-job-5-1618985701034205514_6927bbd1-90b9-40cf-97ae-bed88da46102
2021/04/21 06:15:01 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1618985701039095373
21/04/21 06:15:03 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1618985701034205514_6927bbd1-90b9-40cf-97ae-bed88da46102.
21/04/21 06:15:03 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1618985701034205514_6927bbd1-90b9-40cf-97ae-bed88da46102.go.
21/04/21 06:15:03 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1618985701034205514_6927bbd1-90b9-40cf-97ae-bed88da46102.null.
21/04/21 06:15:03 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1618985701034205514_6927bbd1-90b9-40cf-97ae-bed88da46102.
2021/04/21 06:15:03 Staged binary artifact with token: 
21/04/21 06:15:03 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501618985701034205514-jenkins-0421061503-38855578_65e9781e-d299-43b0-af80-84ab95882772
21/04/21 06:15:03 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501618985701034205514-jenkins-0421061503-38855578_65e9781e-d299-43b0-af80-84ab95882772
2021/04/21 06:15:03 Submitted job: go0job0501618985701034205514-jenkins-0421061503-38855578_65e9781e-d299-43b0-af80-84ab95882772
2021/04/21 06:15:03 Job state: STOPPED
2021/04/21 06:15:03 Job state: STARTING
2021/04/21 06:15:03 Job state: RUNNING
21/04/21 06:15:03 ERROR org.apache.beam.runners.jobsubmission.JobInvocation: Error during job invocation go0job0501618985701034205514-jenkins-0421061503-38855578_65e9781e-d299-43b0-af80-84ab95882772.
java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/21 06:15:03  (): java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/21 06:15:03  (): java.lang.NullPointerException
2021/04/21 06:15:03 Job state: FAILED
21/04/21 06:15:03 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501618985701034205514-jenkins-0421061503-38855578_65e9781e-d299-43b0-af80-84ab95882772
21/04/21 06:15:03 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501618985701034205514-jenkins-0421061503-38855578_65e9781e-d299-43b0-af80-84ab95882772
--- FAIL: TestWordCount (15.78s)
    wordcount_test.go:87: WordCount("foo") failed: job go0job0101618985688203844991-jenkins-0421061451-c647dbe5_39d73dba-d957-41d0-9773-ffe36aec6785 failed
    wordcount_test.go:87: WordCount("foo foo foo|foo foo|foo") failed: job go0job0201618985691627715248-jenkins-0421061454-6de41c04_236debf6-84df-404e-acb6-99cc580e5865 failed
    wordcount_test.go:87: WordCount("bar bar foo bar foo foo") failed: job go0job0301618985694743072465-jenkins-0421061457-613069ca_80b33a23-adb6-46c1-998f-89dfebd534cb failed
    wordcount_test.go:87: WordCount("foo bar foo bar foo bar") failed: job go0job0401618985697969960148-jenkins-0421061500-b5c9c280_1cfebae7-7e1c-4fbc-95e0-e347a1262aed failed
    wordcount_test.go:87: WordCount("|bar foo bar|  	 | 
        
        
         |foo bar|       foo") failed: job go0job0501618985701034205514-jenkins-0421061503-38855578_65e9781e-d299-43b0-af80-84ab95882772 failed
FAIL
FAIL	github.com/apache/beam/sdks/go/test/integration/wordcount	15.807s
2021/04/21 06:15:06 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict

=== RUN   TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
    integration.go:105: Test TestXLang_CoGroupBy is currently sickbayed on all runners
=== RUN   TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
    integration.go:139: Test TestXLang_Combine is currently filtered for runner spark
=== RUN   TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
    integration.go:139: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN   TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
    integration.go:139: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN   TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
    integration.go:139: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN   TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
    integration.go:105: Test TestXLang_Multi is currently sickbayed on all runners
=== RUN   TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
    integration.go:105: Test TestXLang_Partition is currently sickbayed on all runners
PASS
ok  	github.com/apache/beam/sdks/go/test/integration/xlang	0.025s

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 40s
82 actionable tasks: 54 executed, 28 from cache

Publishing build scan...
https://gradle.com/s/5gmc2qh5omcqi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4588

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4588/display/redirect?page=changes>

Changes:

[kileysok] Update Java beam container image

[suztomo] Libraries-BOM 20.0.0 with gRPC and protobuf

[suztomo] Updating assertions for google-http-client 1.39.2

[suztomo] Declare gax-httpjson as a direct dependency of google-cloud-platform

[noreply] Add --sdk_container_image Python WorkerOption (#14557)

[noreply] [BEAM-2085] Add capability to declare resource hints in Python pipeline


------------------------------------------
[...truncated 346.52 KB...]
      spec: <
        urn: "beam:coder:string_utf8:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c1"
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c6"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_worker_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006worker"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/04/21 00:19:27 Prepared job with id: go-job-5-1618964367286579395_10ea3c8b-3a6a-40aa-9b97-91e66a28ba7c and staging token: go-job-5-1618964367286579395_10ea3c8b-3a6a-40aa-9b97-91e66a28ba7c
2021/04/21 00:19:27 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1618964367300563894
21/04/21 00:19:35 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1618964367286579395_10ea3c8b-3a6a-40aa-9b97-91e66a28ba7c.
21/04/21 00:19:35 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1618964367286579395_10ea3c8b-3a6a-40aa-9b97-91e66a28ba7c.go.
21/04/21 00:19:35 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1618964367286579395_10ea3c8b-3a6a-40aa-9b97-91e66a28ba7c.null.
21/04/21 00:19:35 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1618964367286579395_10ea3c8b-3a6a-40aa-9b97-91e66a28ba7c.
2021/04/21 00:19:35 Staged binary artifact with token: 
21/04/21 00:19:35 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501618964367286579395-jenkins-0421001935-939d1e6f_a3b52b2b-129b-4cee-8a94-53f7e573c543
21/04/21 00:19:35 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501618964367286579395-jenkins-0421001935-939d1e6f_a3b52b2b-129b-4cee-8a94-53f7e573c543
2021/04/21 00:19:35 Submitted job: go0job0501618964367286579395-jenkins-0421001935-939d1e6f_a3b52b2b-129b-4cee-8a94-53f7e573c543
2021/04/21 00:19:35 Job state: STOPPED
2021/04/21 00:19:35 Job state: STARTING
2021/04/21 00:19:35 Job state: RUNNING
21/04/21 00:19:35 ERROR org.apache.beam.runners.jobsubmission.JobInvocation: Error during job invocation go0job0501618964367286579395-jenkins-0421001935-939d1e6f_a3b52b2b-129b-4cee-8a94-53f7e573c543.
java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/21 00:19:35  (): java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/21 00:19:35  (): java.lang.NullPointerException
2021/04/21 00:19:35 Job state: FAILED
21/04/21 00:19:35 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501618964367286579395-jenkins-0421001935-939d1e6f_a3b52b2b-129b-4cee-8a94-53f7e573c543
21/04/21 00:19:35 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501618964367286579395-jenkins-0421001935-939d1e6f_a3b52b2b-129b-4cee-8a94-53f7e573c543
--- FAIL: TestWordCount (50.38s)
    wordcount_test.go:87: WordCount("foo") failed: job go0job0101618964325155680837-jenkins-0421001853-19b29d2d_6037e1e7-75c2-4fb1-a526-ce743ac6d339 failed
    wordcount_test.go:87: WordCount("bar bar foo bar foo foo") failed: job go0job0301618964344216340200-jenkins-0421001917-45f56ee4_22b06706-479c-40ba-8590-57f014306cc4 failed
    wordcount_test.go:87: WordCount("foo bar foo bar foo bar") failed: job go0job0401618964357915902221-jenkins-0421001927-e6256ca4_5d788bf9-1269-40eb-85fa-16edfd2fb6fc failed
    wordcount_test.go:87: WordCount("|bar foo bar|  	 | 
        
        
         |foo bar|       foo") failed: job go0job0501618964367286579395-jenkins-0421001935-939d1e6f_a3b52b2b-129b-4cee-8a94-53f7e573c543 failed
FAIL
FAIL	github.com/apache/beam/sdks/go/test/integration/wordcount	50.434s
2021/04/21 00:19:39 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict

=== RUN   TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
    integration.go:105: Test TestXLang_CoGroupBy is currently sickbayed on all runners
=== RUN   TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
    integration.go:139: Test TestXLang_Combine is currently filtered for runner spark
=== RUN   TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
    integration.go:139: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN   TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
    integration.go:139: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN   TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.01s)
    integration.go:139: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN   TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
    integration.go:105: Test TestXLang_Multi is currently sickbayed on all runners
=== RUN   TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
    integration.go:105: Test TestXLang_Partition is currently sickbayed on all runners
PASS
ok  	github.com/apache/beam/sdks/go/test/integration/xlang	0.080s

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 19m 15s
82 actionable tasks: 57 executed, 25 from cache

Publishing build scan...
https://gradle.com/s/nr5gtgoooj6ow

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4587

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4587/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Populate runtime parameters in SDK worker startup.

[Robert Bradshaw] [BEAM-6597] Use runner capabilities to activate short ids.

[Robert Bradshaw] Fix wording.

[Robert Bradshaw] Comment about runtime value usage.

[noreply] Add tensorboard-data-server license URL for Python container image.


------------------------------------------
[...truncated 339.60 KB...]
        urn: "beam:coder:string_utf8:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c1"
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c6"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_worker_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006worker"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/04/20 18:12:58 Prepared job with id: go-job-5-1618942378340439865_b6c6636f-b561-4f6a-a2d2-d5094b6d3646 and staging token: go-job-5-1618942378340439865_b6c6636f-b561-4f6a-a2d2-d5094b6d3646
2021/04/20 18:12:58 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1618942378343858141
21/04/20 18:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1618942378340439865_b6c6636f-b561-4f6a-a2d2-d5094b6d3646.
21/04/20 18:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1618942378340439865_b6c6636f-b561-4f6a-a2d2-d5094b6d3646.go.
21/04/20 18:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1618942378340439865_b6c6636f-b561-4f6a-a2d2-d5094b6d3646.null.
21/04/20 18:13:00 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1618942378340439865_b6c6636f-b561-4f6a-a2d2-d5094b6d3646.
2021/04/20 18:13:00 Staged binary artifact with token: 
21/04/20 18:13:00 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501618942378340439865-jenkins-0420181300-34386292_b3ba7fd2-60c6-458f-81d0-699915e9005a
21/04/20 18:13:00 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501618942378340439865-jenkins-0420181300-34386292_b3ba7fd2-60c6-458f-81d0-699915e9005a
2021/04/20 18:13:00 Submitted job: go0job0501618942378340439865-jenkins-0420181300-34386292_b3ba7fd2-60c6-458f-81d0-699915e9005a
2021/04/20 18:13:00 Job state: STOPPED
2021/04/20 18:13:00 Job state: STARTING
2021/04/20 18:13:00 Job state: RUNNING
21/04/20 18:13:00 ERROR org.apache.beam.runners.jobsubmission.JobInvocation: Error during job invocation go0job0501618942378340439865-jenkins-0420181300-34386292_b3ba7fd2-60c6-458f-81d0-699915e9005a.
java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/20 18:13:00  (): java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/20 18:13:00  (): java.lang.NullPointerException
2021/04/20 18:13:00 Job state: FAILED
21/04/20 18:13:00 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501618942378340439865-jenkins-0420181300-34386292_b3ba7fd2-60c6-458f-81d0-699915e9005a
21/04/20 18:13:00 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501618942378340439865-jenkins-0420181300-34386292_b3ba7fd2-60c6-458f-81d0-699915e9005a
--- FAIL: TestWordCount (13.92s)
    wordcount_test.go:87: WordCount("foo") failed: job go0job0101618942367076348154-jenkins-0420181249-2375026e_54448d56-cf02-4b21-b568-942356b0a995 failed
    wordcount_test.go:87: WordCount("foo foo foo|foo foo|foo") failed: job go0job0201618942369811291925-jenkins-0420181252-f4575891_2da81c9d-afc3-4c59-a233-d70ed0a03b1d failed
    wordcount_test.go:87: WordCount("bar bar foo bar foo foo") failed: job go0job0301618942372745658869-jenkins-0420181255-7e41d385_9f702daf-eca5-44b4-9542-31e1d7c2d937 failed
    wordcount_test.go:87: WordCount("foo bar foo bar foo bar") failed: job go0job0401618942375408176726-jenkins-0420181258-d2519972_3131fe75-96f9-47ae-95dc-e62ff844d7c5 failed
    wordcount_test.go:87: WordCount("|bar foo bar|  	 | 
        
        
         |foo bar|       foo") failed: job go0job0501618942378340439865-jenkins-0420181300-34386292_b3ba7fd2-60c6-458f-81d0-699915e9005a failed
FAIL
FAIL	github.com/apache/beam/sdks/go/test/integration/wordcount	13.939s
2021/04/20 18:13:02 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict

=== RUN   TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
    integration.go:105: Test TestXLang_CoGroupBy is currently sickbayed on all runners
=== RUN   TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
    integration.go:139: Test TestXLang_Combine is currently filtered for runner spark
=== RUN   TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
    integration.go:139: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN   TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
    integration.go:139: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN   TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
    integration.go:139: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN   TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
    integration.go:105: Test TestXLang_Multi is currently sickbayed on all runners
=== RUN   TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
    integration.go:105: Test TestXLang_Partition is currently sickbayed on all runners
PASS
ok  	github.com/apache/beam/sdks/go/test/integration/xlang	0.019s

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 40s
82 actionable tasks: 81 executed, 1 from cache

Publishing build scan...
https://gradle.com/s/zazqwmu6x6l5y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #4586

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/4586/display/redirect>

Changes:


------------------------------------------
[...truncated 336.23 KB...]
        urn: "beam:coder:string_utf8:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c10"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c9"
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c1"
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c7"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c0"
      component_coder_ids: "c6"
    >
  >
  coders: <
    key: "c8"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c2"
      component_coder_ids: "c0"
    >
  >
  coders: <
    key: "c9"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c0"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n\026apache/beam_go_sdk:dev"
      capabilities: "beam:protocol:progress_reporting:v0"
      capabilities: "beam:protocol:multi_core_bundle_processing:v1"
      capabilities: "beam:version:sdk_base:go"
      capabilities: "beam:coder:bytes:v1"
      capabilities: "beam:coder:bool:v1"
      capabilities: "beam:coder:varint:v1"
      capabilities: "beam:coder:double:v1"
      capabilities: "beam:coder:string_utf8:v1"
      capabilities: "beam:coder:length_prefix:v1"
      capabilities: "beam:coder:kv:v1"
      capabilities: "beam:coder:iterable:v1"
      capabilities: "beam:coder:state_backed_iterable:v1"
      capabilities: "beam:coder:windowed_value:v1"
      capabilities: "beam:coder:global_window:v1"
      capabilities: "beam:coder:interval_window:v1"
      dependencies: <
        type_urn: "beam:artifact:type:go_worker_binary:v1"
        role_urn: "beam:artifact:role:staging_to:v1"
        role_payload: "\n\006worker"
      >
    >
  >
>
root_transform_ids: "s1"
root_transform_ids: "s2"
root_transform_ids: "e9"
root_transform_ids: "s6"
2021/04/20 12:08:55 Prepared job with id: go-job-5-1618920535353288511_e5dab5ab-a9f9-492f-ab68-49a726aa7eeb and staging token: go-job-5-1618920535353288511_e5dab5ab-a9f9-492f-ab68-49a726aa7eeb
2021/04/20 12:08:55 Cross-compiling <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/integration/wordcount/wordcount_test.go> as /tmp/worker-5-1618920535357162050
21/04/20 12:08:58 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for go-job-5-1618920535353288511_e5dab5ab-a9f9-492f-ab68-49a726aa7eeb.
21/04/20 12:08:58 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for go-job-5-1618920535353288511_e5dab5ab-a9f9-492f-ab68-49a726aa7eeb.go.
21/04/20 12:08:58 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for go-job-5-1618920535353288511_e5dab5ab-a9f9-492f-ab68-49a726aa7eeb.null.
21/04/20 12:08:58 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for go-job-5-1618920535353288511_e5dab5ab-a9f9-492f-ab68-49a726aa7eeb.
2021/04/20 12:08:58 Staged binary artifact with token: 
21/04/20 12:08:58 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0501618920535353288511-jenkins-0420120858-3729a02e_1e0090ed-b3fe-4846-8eb0-95fbd6aedb34
21/04/20 12:08:58 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation go0job0501618920535353288511-jenkins-0420120858-3729a02e_1e0090ed-b3fe-4846-8eb0-95fbd6aedb34
2021/04/20 12:08:58 Submitted job: go0job0501618920535353288511-jenkins-0420120858-3729a02e_1e0090ed-b3fe-4846-8eb0-95fbd6aedb34
2021/04/20 12:08:58 Job state: STOPPED
2021/04/20 12:08:58 Job state: STARTING
2021/04/20 12:08:58 Job state: RUNNING
21/04/20 12:08:58 ERROR org.apache.beam.runners.jobsubmission.JobInvocation: Error during job invocation go0job0501618920535353288511-jenkins-0420120858-3729a02e_1e0090ed-b3fe-4846-8eb0-95fbd6aedb34.
java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/20 12:08:58  (): java.lang.NullPointerException
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:120)
	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2021/04/20 12:08:58  (): java.lang.NullPointerException
2021/04/20 12:08:58 Job state: FAILED
21/04/20 12:08:58 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for go0job0501618920535353288511-jenkins-0420120858-3729a02e_1e0090ed-b3fe-4846-8eb0-95fbd6aedb34
21/04/20 12:08:58 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for go0job0501618920535353288511-jenkins-0420120858-3729a02e_1e0090ed-b3fe-4846-8eb0-95fbd6aedb34
--- FAIL: TestWordCount (13.89s)
    wordcount_test.go:87: WordCount("foo") failed: job go0job0101618920524210978018-jenkins-0420120847-77d67964_6d7ab512-f404-44c8-b4e1-0a4e8e1cb377 failed
    wordcount_test.go:87: WordCount("foo foo foo|foo foo|foo") failed: job go0job0201618920527056766204-jenkins-0420120849-9c3a05f4_cce53a32-cc8c-4391-8857-4d6207348e7b failed
    wordcount_test.go:87: WordCount("bar bar foo bar foo foo") failed: job go0job0301618920529790062237-jenkins-0420120852-7ff43f9b_476b1730-ac85-4025-ac35-ecf21c9a19c0 failed
    wordcount_test.go:87: WordCount("foo bar foo bar foo bar") failed: job go0job0401618920532601979346-jenkins-0420120855-ede8bc31_9ac4d945-fc1a-476d-a38a-7ab026078ece failed
    wordcount_test.go:87: WordCount("|bar foo bar|  	 | 
        
        
         |foo bar|       foo") failed: job go0job0501618920535353288511-jenkins-0420120858-3729a02e_1e0090ed-b3fe-4846-8eb0-95fbd6aedb34 failed
FAIL
FAIL	github.com/apache/beam/sdks/go/test/integration/wordcount	13.915s
2021/04/20 12:08:59 WARNING: proto: file "v1.proto" is already registered
A future release will panic on registration conflicts. See:
https://developers.google.com/protocol-buffers/docs/reference/go/faq#namespace-conflict

=== RUN   TestXLang_CoGroupBy
--- SKIP: TestXLang_CoGroupBy (0.00s)
    integration.go:105: Test TestXLang_CoGroupBy is currently sickbayed on all runners
=== RUN   TestXLang_Combine
--- SKIP: TestXLang_Combine (0.00s)
    integration.go:139: Test TestXLang_Combine is currently filtered for runner spark
=== RUN   TestXLang_CombineGlobally
--- SKIP: TestXLang_CombineGlobally (0.00s)
    integration.go:139: Test TestXLang_CombineGlobally is currently filtered for runner spark
=== RUN   TestXLang_Flatten
--- SKIP: TestXLang_Flatten (0.00s)
    integration.go:139: Test TestXLang_Flatten is currently filtered for runner spark
=== RUN   TestXLang_GroupBy
--- SKIP: TestXLang_GroupBy (0.00s)
    integration.go:139: Test TestXLang_GroupBy is currently filtered for runner spark
=== RUN   TestXLang_Multi
--- SKIP: TestXLang_Multi (0.00s)
    integration.go:105: Test TestXLang_Multi is currently sickbayed on all runners
=== RUN   TestXLang_Partition
--- SKIP: TestXLang_Partition (0.00s)
    integration.go:105: Test TestXLang_Partition is currently sickbayed on all runners
PASS
ok  	github.com/apache/beam/sdks/go/test/integration/xlang	0.022s

if [[ "$RUNNER" == "dataflow" ]]; then
  # Delete the container locally and remotely
  docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
  gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"

  if [[ -n "$EXPANSION_ADDR" ]]; then
    # Delete the java cross-language container locally and remotely
    docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
    gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container"
  fi

  # Clean up tempdir
  rm -rf $TMPDIR
fi

exit $TEST_EXIT_CODE
exit_background_processes

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 114

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 29s
82 actionable tasks: 54 executed, 28 from cache

Publishing build scan...
https://gradle.com/s/4w6d54wjo66vo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org