You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/12/20 23:28:33 UTC

Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1870

See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1870/display/redirect?page=changes>

Changes:

[chamikara] Fixes Go formatting.


------------------------------------------
[...truncated 265.24 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191220-232648"
    >
  >
>
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/20 23:28:27 Prepared job with id: go-job-7-1576884507447344174_b77d254d-438b-4877-a84c-fc9a414671bb and staging token: {"sessionId":"go-job-7-1576884507447344174_b77d254d-438b-4877-a84c-fc9a414671bb","basePath":"/tmp/beam-artifact-staging"}
2019/12/20 23:28:27 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/20 23:28:27 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576884507447344174_b77d254d-438b-4877-a84c-fc9a414671bb/MANIFEST
19/12/20 23:28:27 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576884507447344174-jenkins-1220232827-4167fa04_80fba769-521c-4666-9633-754a2bb10cd6
19/12/20 23:28:27 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576884507447344174-jenkins-1220232827-4167fa04_80fba769-521c-4666-9633-754a2bb10cd6
2019/12/20 23:28:27 Submitted job: go0job0701576884507447344174-jenkins-1220232827-4167fa04_80fba769-521c-4666-9633-754a2bb10cd6
2019/12/20 23:28:27 Job state: STOPPED
2019/12/20 23:28:27 Job state: STARTING
2019/12/20 23:28:27 Job state: RUNNING
19/12/20 23:28:27 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576884507447344174-jenkins-1220232827-4167fa04_80fba769-521c-4666-9633-754a2bb10cd6.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/20 23:28:27  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/20 23:28:27  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/20 23:28:27 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576884507447344174_b77d254d-438b-4877-a84c-fc9a414671bb/MANIFEST has 1 artifact locations
19/12/20 23:28:27 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576884507447344174_b77d254d-438b-4877-a84c-fc9a414671bb/
2019/12/20 23:28:27 Job state: FAILED
2019/12/20 23:28:27 Test flatten:flatten failed: job go0job0701576884507447344174-jenkins-1220232827-4167fa04_80fba769-521c-4666-9633-754a2bb10cd6 failed
2019/12/20 23:28:27 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191220-232648
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:f3b1912eabf3929e18f04b5145b245ad75efa154bb2b00b2d3df5fb423557e8e
Deleted: sha256:8c5097a4d598e52d4338c31fb191358d7380cd12ee5c56a403c525b3c9402a2f
Deleted: sha256:bc772bbea84b3c12ee15903a520a5f9ba1735f07f75d15f34a8520c5c5176475
Deleted: sha256:f5da44d9b0618b75635d39865116320ba08aa99ab539d37a1004d61f87e90184
Deleted: sha256:80e3aba9355cbb387956d89be2a7b5e578af94a8618f85e5a5bc18a9a461fb43
Deleted: sha256:9de358b46c4de2cb50ab17665fd45505c4959edb0f673b318c8cff6b096e72a8
Deleted: sha256:8fcf1f6bfc9d76c79726263a3ec86865aea77637e88bac585eaed76f7b5aac07
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:f3b1912eabf3929e18f04b5145b245ad75efa154bb2b00b2d3df5fb423557e8e
  Associated tags:
 - 20191220-232648
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191220-232648
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191220-232648].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:f3b1912eabf3929e18f04b5145b245ad75efa154bb2b00b2d3df5fb423557e8e].

# Clean up tempdir
rm -rf $TMPDIR

>>> FAILURE
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 38s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/wse7jpdb5zmds

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Go_VR_Spark #1895

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1895/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1894

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1894/display/redirect?page=changes>

Changes:

[bhulette] [BEAM-8988] RangeTracker for _CustomBigQuerySource (#10412)


------------------------------------------
[...truncated 265.35 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-211958"
    >
  >
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 21:21:31 Prepared job with id: go-job-7-1577136091352527165_5834ce2b-4c03-4d85-be92-2feee95b80cc and staging token: {"sessionId":"go-job-7-1577136091352527165_5834ce2b-4c03-4d85-be92-2feee95b80cc","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 21:21:31 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 21:21:31 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577136091352527165_5834ce2b-4c03-4d85-be92-2feee95b80cc/MANIFEST
19/12/23 21:21:31 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577136091352527165-jenkins-1223212131-6a3097ee_02476310-4a62-43de-a4f0-328306ce8501
19/12/23 21:21:31 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577136091352527165-jenkins-1223212131-6a3097ee_02476310-4a62-43de-a4f0-328306ce8501
2019/12/23 21:21:31 Submitted job: go0job0701577136091352527165-jenkins-1223212131-6a3097ee_02476310-4a62-43de-a4f0-328306ce8501
2019/12/23 21:21:31 Job state: STOPPED
2019/12/23 21:21:31 Job state: STARTING
2019/12/23 21:21:31 Job state: RUNNING
19/12/23 21:21:31 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577136091352527165-jenkins-1223212131-6a3097ee_02476310-4a62-43de-a4f0-328306ce8501.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 21:21:31  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 21:21:31  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 21:21:31 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577136091352527165_5834ce2b-4c03-4d85-be92-2feee95b80cc/MANIFEST has 1 artifact locations
19/12/23 21:21:31 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577136091352527165_5834ce2b-4c03-4d85-be92-2feee95b80cc/
2019/12/23 21:21:31 Job state: FAILED
2019/12/23 21:21:31 Test flatten:flatten failed: job go0job0701577136091352527165-jenkins-1223212131-6a3097ee_02476310-4a62-43de-a4f0-328306ce8501 failed
2019/12/23 21:21:31 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-211958
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:9d23da8695c19f933e16a923d8dfb3fedba79d95d9ddcc171536f9a059438cfa
Deleted: sha256:de49c238e1a3bfe67ba86849365a2e92b757d50b165a617209afc1f48e36078b
Deleted: sha256:a988b8a0d6eb5f8b65566ff0bc23fde46cd91a41d0c897a513c76a9834398b4a
Deleted: sha256:f77adf816d1d2e8b46bc1dbb25dabbd381b2dab09f8e0d9e4cbe996ee3db236f
Deleted: sha256:706d6f09d56e17d2d430aa75d0ed13af1315bfa1c74c74f84d47826de285ae4a
Deleted: sha256:61f0d33e6f30332a691210d6022a7b4b3dc401474efbc045d40bd1937126424f
Deleted: sha256:27cc2ad123a548fafbc10b72577cf3ddacd0ed0c50060dd786573165e904d356
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:9d23da8695c19f933e16a923d8dfb3fedba79d95d9ddcc171536f9a059438cfa
  Associated tags:
 - 20191223-211958
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-211958
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-211958].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:9d23da8695c19f933e16a923d8dfb3fedba79d95d9ddcc171536f9a059438cfa].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 46s
53 actionable tasks: 41 executed, 12 from cache

Publishing build scan...
https://gradle.com/s/re3ectzkq5qwe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1893

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1893/display/redirect?page=changes>

Changes:

[chamikara] Adds documentation for environment_id fields.


------------------------------------------
[...truncated 266.33 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-210709"
    >
  >
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 21:08:35 Prepared job with id: go-job-7-1577135315774352744_0811e71d-534c-4acf-a56a-dd6428cdd731 and staging token: {"sessionId":"go-job-7-1577135315774352744_0811e71d-534c-4acf-a56a-dd6428cdd731","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 21:08:35 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 21:08:36 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577135315774352744_0811e71d-534c-4acf-a56a-dd6428cdd731/MANIFEST
19/12/23 21:08:36 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577135315774352744-jenkins-1223210836-29e49daf_1c432526-07f5-4c10-ba36-4a8eb25b5fb1
19/12/23 21:08:36 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577135315774352744-jenkins-1223210836-29e49daf_1c432526-07f5-4c10-ba36-4a8eb25b5fb1
2019/12/23 21:08:36 Submitted job: go0job0701577135315774352744-jenkins-1223210836-29e49daf_1c432526-07f5-4c10-ba36-4a8eb25b5fb1
2019/12/23 21:08:36 Job state: STOPPED
2019/12/23 21:08:36 Job state: STARTING
2019/12/23 21:08:36 Job state: RUNNING
19/12/23 21:08:36 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577135315774352744-jenkins-1223210836-29e49daf_1c432526-07f5-4c10-ba36-4a8eb25b5fb1.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 21:08:36  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 21:08:36  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 21:08:36 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577135315774352744_0811e71d-534c-4acf-a56a-dd6428cdd731/MANIFEST has 1 artifact locations
19/12/23 21:08:36 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577135315774352744_0811e71d-534c-4acf-a56a-dd6428cdd731/
2019/12/23 21:08:36 Job state: FAILED
2019/12/23 21:08:36 Test flatten:flatten failed: job go0job0701577135315774352744-jenkins-1223210836-29e49daf_1c432526-07f5-4c10-ba36-4a8eb25b5fb1 failed
2019/12/23 21:08:36 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-210709
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:a785ce7a505817887a3afa4137a794cdde2248e854c1db59cc9d0f03a8830326
Deleted: sha256:27c44d04d15ac372223dba9c48f3a012913ec25446cb9b4006449cb090e7c778
Deleted: sha256:e528fe1ba546d19d76dad4f4cda06e3d53d8bdb5a08697ca4b2914d3ff60a0c6
Deleted: sha256:9cfad9e5f0f42f3634c84f52fb6e428267f20d45701f93028486f5abd3ae0165
Deleted: sha256:12afd2a4f61b43ccd295da5c520356a1f267f52ca779b22710bdbae171d93dd1
Deleted: sha256:e57ec4eb7fecb1c2c1afaad6d619f4d0c8e2353dbcb15921ffcc746b79f01740
Deleted: sha256:5d2619077dd3b2d7e834fbfe820f04058278fa5577fe20f9cbf38ef55ac58bb4
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:a785ce7a505817887a3afa4137a794cdde2248e854c1db59cc9d0f03a8830326
  Associated tags:
 - 20191223-210709
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-210709
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-210709].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:a785ce7a505817887a3afa4137a794cdde2248e854c1db59cc9d0f03a8830326].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 21s
53 actionable tasks: 41 executed, 12 from cache

Publishing build scan...
https://gradle.com/s/2g7xzmke6pnau

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1892

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1892/display/redirect?page=changes>

Changes:

[apilloud] [BEAM-9023] Upgrade to ZetaSQL 2019.12.1


------------------------------------------
[...truncated 265.40 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-205537"
    >
  >
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 20:57:07 Prepared job with id: go-job-7-1577134627461279674_c942df81-2708-4633-a685-f2a974fbd2fd and staging token: {"sessionId":"go-job-7-1577134627461279674_c942df81-2708-4633-a685-f2a974fbd2fd","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 20:57:07 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 20:57:07 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577134627461279674_c942df81-2708-4633-a685-f2a974fbd2fd/MANIFEST
19/12/23 20:57:07 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577134627461279674-jenkins-1223205707-dd19ca2b_e745a6fd-bb2b-479e-b033-30400122ff45
19/12/23 20:57:07 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577134627461279674-jenkins-1223205707-dd19ca2b_e745a6fd-bb2b-479e-b033-30400122ff45
2019/12/23 20:57:07 Submitted job: go0job0701577134627461279674-jenkins-1223205707-dd19ca2b_e745a6fd-bb2b-479e-b033-30400122ff45
2019/12/23 20:57:07 Job state: STOPPED
2019/12/23 20:57:07 Job state: STARTING
2019/12/23 20:57:07 Job state: RUNNING
19/12/23 20:57:07 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577134627461279674-jenkins-1223205707-dd19ca2b_e745a6fd-bb2b-479e-b033-30400122ff45.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 20:57:07  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 20:57:07  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 20:57:07 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577134627461279674_c942df81-2708-4633-a685-f2a974fbd2fd/MANIFEST has 1 artifact locations
19/12/23 20:57:07 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577134627461279674_c942df81-2708-4633-a685-f2a974fbd2fd/
2019/12/23 20:57:07 Job state: FAILED
2019/12/23 20:57:07 Test flatten:flatten failed: job go0job0701577134627461279674-jenkins-1223205707-dd19ca2b_e745a6fd-bb2b-479e-b033-30400122ff45 failed
2019/12/23 20:57:07 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-205537
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:8dc7eedaf511878bd60b559c2f4be7124227c8908758964750733c97724f8034
Deleted: sha256:7e53dc70c59a8caeeb66c483ce9573fe2348f24a859c4b49390dd083992f5230
Deleted: sha256:d42628381be55a821a3723e9d7ecbf3e8a8b6f055efc9d4b431699a65b878489
Deleted: sha256:aecaf06518922070097da02015909443d576b8252323fe611c4871667c9a1908
Deleted: sha256:cb851b6ec60aa80a5390b9e2c8430c85c743ea4377a3a55f3242ac36331cb5b3
Deleted: sha256:f938c84748a2b2fdc20caaf3cb39c281186a839317cd96174a51dbae5e67e146
Deleted: sha256:a7df1694f34bb4c55e9f0e1aa2e988c92d215b972c3dc149d3935f5cd424a3f7
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:8dc7eedaf511878bd60b559c2f4be7124227c8908758964750733c97724f8034
  Associated tags:
 - 20191223-205537
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-205537
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-205537].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:8dc7eedaf511878bd60b559c2f4be7124227c8908758964750733c97724f8034].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 23s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/wjf5mhtobdn7y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1891

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1891/display/redirect?page=changes>

Changes:

[lukecwik] [BEAM-7951] Allow runner to configure customization WindowedValue coder.


------------------------------------------
[...truncated 265.56 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-203349"
    >
  >
>
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 20:35:12 Prepared job with id: go-job-7-1577133312945527705_f9fa2386-e340-40d4-9c81-43127d35ed4d and staging token: {"sessionId":"go-job-7-1577133312945527705_f9fa2386-e340-40d4-9c81-43127d35ed4d","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 20:35:12 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 20:35:13 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577133312945527705_f9fa2386-e340-40d4-9c81-43127d35ed4d/MANIFEST
19/12/23 20:35:13 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577133312945527705-jenkins-1223203513-347b0e37_c927fee7-db75-4072-953b-162f0962124d
19/12/23 20:35:13 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577133312945527705-jenkins-1223203513-347b0e37_c927fee7-db75-4072-953b-162f0962124d
2019/12/23 20:35:13 Submitted job: go0job0701577133312945527705-jenkins-1223203513-347b0e37_c927fee7-db75-4072-953b-162f0962124d
2019/12/23 20:35:13 Job state: STOPPED
2019/12/23 20:35:13 Job state: STARTING
2019/12/23 20:35:13 Job state: RUNNING
19/12/23 20:35:13 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577133312945527705-jenkins-1223203513-347b0e37_c927fee7-db75-4072-953b-162f0962124d.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 20:35:13  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 20:35:13  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 20:35:13 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577133312945527705_f9fa2386-e340-40d4-9c81-43127d35ed4d/MANIFEST has 1 artifact locations
19/12/23 20:35:13 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577133312945527705_f9fa2386-e340-40d4-9c81-43127d35ed4d/
2019/12/23 20:35:13 Job state: FAILED
2019/12/23 20:35:13 Test flatten:flatten failed: job go0job0701577133312945527705-jenkins-1223203513-347b0e37_c927fee7-db75-4072-953b-162f0962124d failed
2019/12/23 20:35:13 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-203349
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:a6384fa2edafa55d0f2357dad8eb6d6d17b68897321bce48c5ff1087ddcc33c1
Deleted: sha256:6789f0f5ca1cdace21c164e53d28f19dd5244a7fa84b670d8296d662095a19c1
Deleted: sha256:89f86787c7b482645ea6f50d39ae17776d268e75bedfae54b09430a861812f77
Deleted: sha256:b8b7325c234c65379556708f81fb1a4f05c023ebefc64fdbd618a689d1b5c9f1
Deleted: sha256:880fffa76bd24a50e521a5d73ff1605ded8fbeea808940a71c955b6180dd7ff4
Deleted: sha256:91dda54b9d3aed5dbb35c74c835cfbfd6d8febdce225921264696be29ef0595f
Deleted: sha256:e55c8d146168169b497fe3f821b8929a5cb4463202294499cb2bd2a4e2726f67
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:a6384fa2edafa55d0f2357dad8eb6d6d17b68897321bce48c5ff1087ddcc33c1
  Associated tags:
 - 20191223-203349
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-203349
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-203349].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:a6384fa2edafa55d0f2357dad8eb6d6d17b68897321bce48c5ff1087ddcc33c1].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 27s
53 actionable tasks: 41 executed, 12 from cache

Publishing build scan...
https://gradle.com/s/ksybrqmngurii

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1890

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1890/display/redirect?page=changes>

Changes:

[suztomo] GenericJsonAssert

[suztomo] Refactoring with assertEqualsAsJson

[lukecwik] [BEAM-8846] Update documentation about stream observers and factories,


------------------------------------------
[...truncated 265.72 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-195231"
    >
  >
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 19:53:51 Prepared job with id: go-job-7-1577130831133338527_3e8f2408-832a-4397-ab07-ef444f54712a and staging token: {"sessionId":"go-job-7-1577130831133338527_3e8f2408-832a-4397-ab07-ef444f54712a","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 19:53:51 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 19:53:51 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577130831133338527_3e8f2408-832a-4397-ab07-ef444f54712a/MANIFEST
19/12/23 19:53:51 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577130831133338527-jenkins-1223195351-a1381d95_395346e3-bb9f-4566-b008-62953046865a
19/12/23 19:53:51 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577130831133338527-jenkins-1223195351-a1381d95_395346e3-bb9f-4566-b008-62953046865a
2019/12/23 19:53:51 Submitted job: go0job0701577130831133338527-jenkins-1223195351-a1381d95_395346e3-bb9f-4566-b008-62953046865a
2019/12/23 19:53:51 Job state: STOPPED
2019/12/23 19:53:51 Job state: STARTING
2019/12/23 19:53:51 Job state: RUNNING
19/12/23 19:53:51 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577130831133338527-jenkins-1223195351-a1381d95_395346e3-bb9f-4566-b008-62953046865a.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 19:53:51  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 19:53:51  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 19:53:51 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577130831133338527_3e8f2408-832a-4397-ab07-ef444f54712a/MANIFEST has 1 artifact locations
19/12/23 19:53:51 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577130831133338527_3e8f2408-832a-4397-ab07-ef444f54712a/
2019/12/23 19:53:51 Job state: FAILED
2019/12/23 19:53:51 Test flatten:flatten failed: job go0job0701577130831133338527-jenkins-1223195351-a1381d95_395346e3-bb9f-4566-b008-62953046865a failed
2019/12/23 19:53:51 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-195231
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:15fe4994fada30e515124d398868ae2eca4032d789962e09c8e6c7163b1eb3b7
Deleted: sha256:d442c5fac905e772eb8fe7b9925d0574d0d5335199bfcadcfe7a5ba95f024caa
Deleted: sha256:50e8d817f995a37c9a44025d6644b10a6c38796ddb874524d5aac38f4e30249b
Deleted: sha256:4991b3e4d1f0bd7a346f234b912b49115cd33bf441ed8e7d73f15dfa379e0f3b
Deleted: sha256:e098e30ce6be7de6a545e6cae89802792ea80243649c0db339bb6680a2ea9a07
Deleted: sha256:7dd4a4e69ef70530838e1986c91b15bd51425ad6e2917f60400a26e7a622b28f
Deleted: sha256:cf577e070f7b67b3a4443dd63588439d062b02ebe036a433118e3e87c18257f0
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:15fe4994fada30e515124d398868ae2eca4032d789962e09c8e6c7163b1eb3b7
  Associated tags:
 - 20191223-195231
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-195231
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-195231].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:15fe4994fada30e515124d398868ae2eca4032d789962e09c8e6c7163b1eb3b7].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 16s
53 actionable tasks: 41 executed, 12 from cache

Publishing build scan...
https://gradle.com/s/uun3jcowb6bii

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1889

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1889/display/redirect?page=changes>

Changes:

[github] Update dataflow container images to beam-master-20191220 (#10448)


------------------------------------------
[...truncated 264.98 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-180813"
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "e3"
root_transform_ids: "e6"
root_transform_ids: "e4"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 18:09:33 Prepared job with id: go-job-7-1577124573689944697_04838886-6806-4ebf-8c60-c88c5d6c6935 and staging token: {"sessionId":"go-job-7-1577124573689944697_04838886-6806-4ebf-8c60-c88c5d6c6935","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 18:09:33 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 18:09:34 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577124573689944697_04838886-6806-4ebf-8c60-c88c5d6c6935/MANIFEST
19/12/23 18:09:34 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577124573689944697-jenkins-1223180934-c9db7ec5_35c7fe1a-edb6-4417-b86a-703bfe3bdc48
19/12/23 18:09:34 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577124573689944697-jenkins-1223180934-c9db7ec5_35c7fe1a-edb6-4417-b86a-703bfe3bdc48
2019/12/23 18:09:34 Submitted job: go0job0701577124573689944697-jenkins-1223180934-c9db7ec5_35c7fe1a-edb6-4417-b86a-703bfe3bdc48
2019/12/23 18:09:34 Job state: STOPPED
2019/12/23 18:09:34 Job state: STARTING
2019/12/23 18:09:34 Job state: RUNNING
19/12/23 18:09:34 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577124573689944697-jenkins-1223180934-c9db7ec5_35c7fe1a-edb6-4417-b86a-703bfe3bdc48.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 18:09:34  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 18:09:34  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 18:09:34 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577124573689944697_04838886-6806-4ebf-8c60-c88c5d6c6935/MANIFEST has 1 artifact locations
19/12/23 18:09:34 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577124573689944697_04838886-6806-4ebf-8c60-c88c5d6c6935/
2019/12/23 18:09:34 Job state: FAILED
2019/12/23 18:09:34 Test flatten:flatten failed: job go0job0701577124573689944697-jenkins-1223180934-c9db7ec5_35c7fe1a-edb6-4417-b86a-703bfe3bdc48 failed
2019/12/23 18:09:34 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-180813
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:478f383dc97b0e2bcebb6370d4b970ea2717fc7b0b637896851b05c64d1a4476
Deleted: sha256:9192853d750cd104c96f84b62d80f000306894fc0a241d59fe4c075663f5160f
Deleted: sha256:5739b563de0727320d24fdcabf0d4e558d74430901a111eda8bb56f71cd8ca97
Deleted: sha256:662fd07c4afa94e2855c6e2c1e9a96c01f73aa1fc68f87d5057926cbf2bcee6d
Deleted: sha256:70bb5287725f47c2e73d00d6451b80af040d2e93f859318da645bdf4b6c79f55
Deleted: sha256:68761cee4c5ee598669f2174c59a727a594d97124f367010865644bab0dfaad6
Deleted: sha256:3ab7737cd4beb4d71c0677c5b44fc2a98decbbcb1b55e8bcdcddd083badabd18
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:478f383dc97b0e2bcebb6370d4b970ea2717fc7b0b637896851b05c64d1a4476
  Associated tags:
 - 20191223-180813
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-180813
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-180813].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:478f383dc97b0e2bcebb6370d4b970ea2717fc7b0b637896851b05c64d1a4476].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 27s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/7resvoh4rnzzg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1888

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1888/display/redirect?page=changes>

Changes:

[github] [BEAM-8999] Respect timestamp combiners in PGBKCVOperation. (#10425)


------------------------------------------
[...truncated 265.69 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-174737"
    >
  >
>
root_transform_ids: "e3"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e4"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 17:49:06 Prepared job with id: go-job-7-1577123346024492586_cd432cf6-cee7-471a-b588-d390813f92c7 and staging token: {"sessionId":"go-job-7-1577123346024492586_cd432cf6-cee7-471a-b588-d390813f92c7","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 17:49:06 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 17:49:06 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577123346024492586_cd432cf6-cee7-471a-b588-d390813f92c7/MANIFEST
19/12/23 17:49:06 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577123346024492586-jenkins-1223174906-93afa9af_b4546c38-2c43-493b-a458-bda5b37338df
19/12/23 17:49:06 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577123346024492586-jenkins-1223174906-93afa9af_b4546c38-2c43-493b-a458-bda5b37338df
2019/12/23 17:49:06 Submitted job: go0job0701577123346024492586-jenkins-1223174906-93afa9af_b4546c38-2c43-493b-a458-bda5b37338df
2019/12/23 17:49:06 Job state: STOPPED
2019/12/23 17:49:06 Job state: STARTING
2019/12/23 17:49:06 Job state: RUNNING
19/12/23 17:49:06 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577123346024492586-jenkins-1223174906-93afa9af_b4546c38-2c43-493b-a458-bda5b37338df.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 17:49:06  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 17:49:06  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 17:49:06 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577123346024492586_cd432cf6-cee7-471a-b588-d390813f92c7/MANIFEST has 1 artifact locations
19/12/23 17:49:06 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577123346024492586_cd432cf6-cee7-471a-b588-d390813f92c7/
2019/12/23 17:49:06 Job state: FAILED
2019/12/23 17:49:06 Test flatten:flatten failed: job go0job0701577123346024492586-jenkins-1223174906-93afa9af_b4546c38-2c43-493b-a458-bda5b37338df failed
2019/12/23 17:49:06 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-174737
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:bf6462382fae09500fb3b2fd291dc45f6599fcc95b0a3702acf1bbc3495c6fd0
Deleted: sha256:2fe6731641aef58f395af94964185ef575d7bbc293c23872c0f77da90aec9f0e
Deleted: sha256:f374acdfae4ecd20469d10e8509c9c58ff2c7d9deeb2d9fed9d2e40632165fc8
Deleted: sha256:c5406b02817d85e39c5b6dd32861a3e6df6a041813f24bc647b3b542273e4b45
Deleted: sha256:0f245702be9a039766b0126c073bc6f7c650049805cbf2685d5695114e65cb86
Deleted: sha256:e5938fc82988eae1deb8356c0084e38d3a82343ccbc70c30f3e8f1f6a358f2be
Deleted: sha256:0737e4b5630f813b41d0e6f72afb4713e2a55e5cfd93fc2097a0ea742eb6275e
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:bf6462382fae09500fb3b2fd291dc45f6599fcc95b0a3702acf1bbc3495c6fd0
  Associated tags:
 - 20191223-174737
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-174737
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-174737].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:bf6462382fae09500fb3b2fd291dc45f6599fcc95b0a3702acf1bbc3495c6fd0].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 31s
53 actionable tasks: 41 executed, 12 from cache

Publishing build scan...
https://gradle.com/s/lhhdg55q4wz2c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1887

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1887/display/redirect?page=changes>

Changes:

[lukecwik] [BEAM-8623] Add status_endpoint field to provision api ProvisionInfo


------------------------------------------
[...truncated 266.81 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-172759"
    >
  >
>
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 17:29:21 Prepared job with id: go-job-7-1577122161864842625_5ca422d7-c1bd-4641-bc48-efe685b8bddf and staging token: {"sessionId":"go-job-7-1577122161864842625_5ca422d7-c1bd-4641-bc48-efe685b8bddf","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 17:29:21 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 17:29:22 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577122161864842625_5ca422d7-c1bd-4641-bc48-efe685b8bddf/MANIFEST
19/12/23 17:29:22 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577122161864842625-jenkins-1223172922-35927e7e_7fb93ef4-276d-4c83-a5b1-2797447378bc
19/12/23 17:29:22 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577122161864842625-jenkins-1223172922-35927e7e_7fb93ef4-276d-4c83-a5b1-2797447378bc
2019/12/23 17:29:22 Submitted job: go0job0701577122161864842625-jenkins-1223172922-35927e7e_7fb93ef4-276d-4c83-a5b1-2797447378bc
2019/12/23 17:29:22 Job state: STOPPED
2019/12/23 17:29:22 Job state: STARTING
2019/12/23 17:29:22 Job state: RUNNING
19/12/23 17:29:22 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577122161864842625-jenkins-1223172922-35927e7e_7fb93ef4-276d-4c83-a5b1-2797447378bc.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 17:29:22  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 17:29:22  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 17:29:22 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577122161864842625_5ca422d7-c1bd-4641-bc48-efe685b8bddf/MANIFEST has 1 artifact locations
19/12/23 17:29:22 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577122161864842625_5ca422d7-c1bd-4641-bc48-efe685b8bddf/
2019/12/23 17:29:22 Job state: FAILED
2019/12/23 17:29:22 Test flatten:flatten failed: job go0job0701577122161864842625-jenkins-1223172922-35927e7e_7fb93ef4-276d-4c83-a5b1-2797447378bc failed
2019/12/23 17:29:22 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-172759
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:816eb723a0695bc88be64b85d442cc192d544478a07c96efbbdabe2b4edffc17
Deleted: sha256:fe9402ddb290dc33510389f393eecac9a26b62d6ffba2c4928ca286dc5e992ad
Deleted: sha256:7985993c9871f6dece6a4830b8a91026a93cfc733aa95d3b3876b2f57f7c6361
Deleted: sha256:4e4f38e960ce29ea40caa141e6cccbcb4cdbd541770965e2fb5356960d42af85
Deleted: sha256:3c47b335a96d631271124a68a3bb2dfc21d91142b2130c5e99aa921393d29eb9
Deleted: sha256:23303d9f39b3dd364b1b1a0bb2d3e6164b6150ebc41a7eae0e1b7776a2504e02
Deleted: sha256:747f7c3c330aaf09e2947e9ec1141592a7f24ec4540a615da33770d257e5d71b
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:816eb723a0695bc88be64b85d442cc192d544478a07c96efbbdabe2b4edffc17
  Associated tags:
 - 20191223-172759
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-172759
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-172759].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:816eb723a0695bc88be64b85d442cc192d544478a07c96efbbdabe2b4edffc17].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
>>> FAILURE
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 26s
53 actionable tasks: 46 executed, 7 from cache

Publishing build scan...
https://gradle.com/s/r2w7v7rfg4dym

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1886

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1886/display/redirect?page=changes>

Changes:

[kcweaver] [BEAM-8296] containerize spark job server


------------------------------------------
[...truncated 263.41 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-163910"
    >
  >
>
root_transform_ids: "e1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 16:42:30 Prepared job with id: go-job-7-1577119350702006857_70266280-c667-44a9-b02d-12820eb41f99 and staging token: {"sessionId":"go-job-7-1577119350702006857_70266280-c667-44a9-b02d-12820eb41f99","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 16:42:30 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 16:42:32 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577119350702006857_70266280-c667-44a9-b02d-12820eb41f99/MANIFEST
19/12/23 16:42:32 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577119350702006857-jenkins-1223164232-63c1866a_a9ed58df-c3eb-44e6-b06a-3ce3f6b2994f
19/12/23 16:42:32 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577119350702006857-jenkins-1223164232-63c1866a_a9ed58df-c3eb-44e6-b06a-3ce3f6b2994f
2019/12/23 16:42:32 Submitted job: go0job0701577119350702006857-jenkins-1223164232-63c1866a_a9ed58df-c3eb-44e6-b06a-3ce3f6b2994f
2019/12/23 16:42:32 Job state: STOPPED
2019/12/23 16:42:32 Job state: STARTING
2019/12/23 16:42:32 Job state: RUNNING
19/12/23 16:42:32 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577119350702006857-jenkins-1223164232-63c1866a_a9ed58df-c3eb-44e6-b06a-3ce3f6b2994f.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 16:42:32  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 16:42:32  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 16:42:32 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577119350702006857_70266280-c667-44a9-b02d-12820eb41f99/MANIFEST has 1 artifact locations
19/12/23 16:42:32 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577119350702006857_70266280-c667-44a9-b02d-12820eb41f99/
2019/12/23 16:42:32 Job state: FAILED
2019/12/23 16:42:32 Test flatten:flatten failed: job go0job0701577119350702006857-jenkins-1223164232-63c1866a_a9ed58df-c3eb-44e6-b06a-3ce3f6b2994f failed
2019/12/23 16:42:32 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-163910
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:30e9ade0024027c84aa147c3ac96de7a28e6e186c405739a5d84822d7e331577
Deleted: sha256:4994c78421a679b455462ff653f8400992b2c3a758aeebffc676e2fc3d7bd3ec
Deleted: sha256:d33526aa5bb981bb643a802a1f4d7d4b522f60ec729f32ba0f56742c3b6f30ae
Deleted: sha256:9f1e67d65c29568728f94e479add48182d2ef4ed8daecb43e7a22e20b3918bbf
Deleted: sha256:d6ef2f5b7814a0d33e1b13b11bfeb2c63e34ab9839bffff917a6498806e78f93
Deleted: sha256:97f41f7405a1573324319493e5834ad167a4c244f631f51b0d4afa43af0d7ec7
Deleted: sha256:f026dc887bb2472e0989d6bc820473abb29cdb3e92703dc00664ae3cde3472b9
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:30e9ade0024027c84aa147c3ac96de7a28e6e186c405739a5d84822d7e331577
  Associated tags:
 - 20191223-163910
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-163910
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-163910].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:30e9ade0024027c84aa147c3ac96de7a28e6e186c405739a5d84822d7e331577].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
>>> FAILURE
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5m 23s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/yubbqpk6wsfiy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1885

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1885/display/redirect>

Changes:


------------------------------------------
[...truncated 265.24 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-120356"
    >
  >
>
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 12:05:24 Prepared job with id: go-job-7-1577102724444089310_64a911f6-0ef3-49e0-a972-37ba04d29e59 and staging token: {"sessionId":"go-job-7-1577102724444089310_64a911f6-0ef3-49e0-a972-37ba04d29e59","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 12:05:24 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 12:05:24 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577102724444089310_64a911f6-0ef3-49e0-a972-37ba04d29e59/MANIFEST
19/12/23 12:05:24 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577102724444089310-jenkins-1223120524-28505474_e287907f-26db-4b45-a85e-b91687949c07
19/12/23 12:05:24 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577102724444089310-jenkins-1223120524-28505474_e287907f-26db-4b45-a85e-b91687949c07
2019/12/23 12:05:24 Submitted job: go0job0701577102724444089310-jenkins-1223120524-28505474_e287907f-26db-4b45-a85e-b91687949c07
2019/12/23 12:05:24 Job state: STOPPED
2019/12/23 12:05:24 Job state: STARTING
2019/12/23 12:05:24 Job state: RUNNING
19/12/23 12:05:24 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577102724444089310-jenkins-1223120524-28505474_e287907f-26db-4b45-a85e-b91687949c07.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 12:05:24  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 12:05:24  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 12:05:24 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577102724444089310_64a911f6-0ef3-49e0-a972-37ba04d29e59/MANIFEST has 1 artifact locations
19/12/23 12:05:24 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577102724444089310_64a911f6-0ef3-49e0-a972-37ba04d29e59/
2019/12/23 12:05:24 Job state: FAILED
2019/12/23 12:05:24 Test flatten:flatten failed: job go0job0701577102724444089310-jenkins-1223120524-28505474_e287907f-26db-4b45-a85e-b91687949c07 failed
2019/12/23 12:05:24 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-120356
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:2b9e13ecf764dfcc8c4403e99e7a8b83b2678f2c691e1e5dfc54338b18631766
Deleted: sha256:1489c7755abd58d88b1d25e769a31a1aa5593d007be1cbaa38900c53c6e30a0b
Deleted: sha256:3523ba2623ae2588c0c2776722acadd49d302cfcaeaac49c73b3718074bc824b
Deleted: sha256:b78c6c645837d5bdf4ff1a47686d2db90575104eda1917c61a1232edb8d2d665
Deleted: sha256:2d347af2fe22c98f945909aebda67f2b81333d1f7845ee08df55dca2932f957f
Deleted: sha256:2a74f85fe5a8ebbff0f4f9ffee63ef27ef9ce1c292862e33f13ea8b17897f807
Deleted: sha256:5d1d0fd65e8625710c49390846f6f49d2d03520974696b92429f243e48e9fa1d
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:2b9e13ecf764dfcc8c4403e99e7a8b83b2678f2c691e1e5dfc54338b18631766
  Associated tags:
 - 20191223-120356
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-120356
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-120356].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:2b9e13ecf764dfcc8c4403e99e7a8b83b2678f2c691e1e5dfc54338b18631766].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5m 2s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/366wnjnvpgjue

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1884

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1884/display/redirect>

Changes:


------------------------------------------
[...truncated 265.46 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-060357"
    >
  >
>
root_transform_ids: "e3"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e1"
root_transform_ids: "e4"
root_transform_ids: "e2"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 06:05:27 Prepared job with id: go-job-7-1577081127983649666_73a3ef13-92a3-4813-b7ae-c0202d8c630a and staging token: {"sessionId":"go-job-7-1577081127983649666_73a3ef13-92a3-4813-b7ae-c0202d8c630a","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 06:05:27 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 06:05:28 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577081127983649666_73a3ef13-92a3-4813-b7ae-c0202d8c630a/MANIFEST
19/12/23 06:05:28 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577081127983649666-jenkins-1223060528-2c99ce77_08ce48b2-0767-4025-98b3-1c8bc24cd907
19/12/23 06:05:28 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577081127983649666-jenkins-1223060528-2c99ce77_08ce48b2-0767-4025-98b3-1c8bc24cd907
2019/12/23 06:05:28 Submitted job: go0job0701577081127983649666-jenkins-1223060528-2c99ce77_08ce48b2-0767-4025-98b3-1c8bc24cd907
2019/12/23 06:05:28 Job state: STOPPED
2019/12/23 06:05:28 Job state: STARTING
2019/12/23 06:05:28 Job state: RUNNING
19/12/23 06:05:28 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577081127983649666-jenkins-1223060528-2c99ce77_08ce48b2-0767-4025-98b3-1c8bc24cd907.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 06:05:28  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 06:05:28  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 06:05:28 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577081127983649666_73a3ef13-92a3-4813-b7ae-c0202d8c630a/MANIFEST has 1 artifact locations
19/12/23 06:05:28 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577081127983649666_73a3ef13-92a3-4813-b7ae-c0202d8c630a/
2019/12/23 06:05:28 Job state: FAILED
2019/12/23 06:05:28 Test flatten:flatten failed: job go0job0701577081127983649666-jenkins-1223060528-2c99ce77_08ce48b2-0767-4025-98b3-1c8bc24cd907 failed
2019/12/23 06:05:28 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-060357
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:0bee489606db46f1ae23e1fbfdbb948e9dadb848ea03386c32ebfb3dd8cc4f8d
Deleted: sha256:6d9e38b4152fd5b64841e350254bcefde0723813946067673a30f3ddf17687ae
Deleted: sha256:ae27a0d55f1402277397800765ca2e79e1a4988937f53d3c286bb429dad03d25
Deleted: sha256:f1104447c374181884ccb02e2e8a66d60fccb7be101691721a2ff201be750afe
Deleted: sha256:08aac41564c0992170cd9ace827915ca7ea0fe5e22185894be0f5727f6c7a7c7
Deleted: sha256:160664082f56b7556cf500ff120efcac6dfe70def0b4d0b0d2c930ce765ef163
Deleted: sha256:077e74c3f3153ba8bce22205a1f31fe6d271b0a2aa0019e1b4b1d0660eac0d50
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:0bee489606db46f1ae23e1fbfdbb948e9dadb848ea03386c32ebfb3dd8cc4f8d
  Associated tags:
 - 20191223-060357
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-060357
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-060357].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:0bee489606db46f1ae23e1fbfdbb948e9dadb848ea03386c32ebfb3dd8cc4f8d].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
>>> FAILURE
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5m 8s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/trpqogcap4vhe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1883

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1883/display/redirect>

Changes:


------------------------------------------
[...truncated 265.35 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-000351"
    >
  >
>
root_transform_ids: "e3"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/23 00:05:25 Prepared job with id: go-job-7-1577059525941239559_87632fab-f690-4d72-91b5-a07795b15749 and staging token: {"sessionId":"go-job-7-1577059525941239559_87632fab-f690-4d72-91b5-a07795b15749","basePath":"/tmp/beam-artifact-staging"}
2019/12/23 00:05:25 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/23 00:05:26 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577059525941239559_87632fab-f690-4d72-91b5-a07795b15749/MANIFEST
19/12/23 00:05:26 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577059525941239559-jenkins-1223000526-e00b3bdb_491c82ae-32e7-4f92-bdfc-51d8723e0701
19/12/23 00:05:26 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577059525941239559-jenkins-1223000526-e00b3bdb_491c82ae-32e7-4f92-bdfc-51d8723e0701
2019/12/23 00:05:26 Submitted job: go0job0701577059525941239559-jenkins-1223000526-e00b3bdb_491c82ae-32e7-4f92-bdfc-51d8723e0701
2019/12/23 00:05:26 Job state: STOPPED
2019/12/23 00:05:26 Job state: STARTING
2019/12/23 00:05:26 Job state: RUNNING
19/12/23 00:05:26 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577059525941239559-jenkins-1223000526-e00b3bdb_491c82ae-32e7-4f92-bdfc-51d8723e0701.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 00:05:26  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/23 00:05:26  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/23 00:05:26 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577059525941239559_87632fab-f690-4d72-91b5-a07795b15749/MANIFEST has 1 artifact locations
19/12/23 00:05:26 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577059525941239559_87632fab-f690-4d72-91b5-a07795b15749/
2019/12/23 00:05:26 Job state: FAILED
2019/12/23 00:05:26 Test flatten:flatten failed: job go0job0701577059525941239559-jenkins-1223000526-e00b3bdb_491c82ae-32e7-4f92-bdfc-51d8723e0701 failed
2019/12/23 00:05:26 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-000351
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:d51349d0dcf20f7e342a9a03802917d8cab758afdc0831284455f3ab3511a0ee
Deleted: sha256:8a41f982df8f9d94c4e9586dcac18b99ae2a18dde194b9389add9a436662a776
Deleted: sha256:48f75650d5a4dc4700c50e1318bc6b793fca63d84efc2448a4a41df41b7c3ff7
Deleted: sha256:f09df1891cc1ff5be571a14d5fdb5fa948749bd41c2fa737b98413979444529b
Deleted: sha256:9d699b24b435eb08c7a4ef2c68701163ceff9d5fc7e4711b5f405142558be4d6
Deleted: sha256:5c041b3c28fe51b2afa7946cb541aa5c3bb8f209736bfcd154ab42cdb00066ac
Deleted: sha256:54b838584786971bd9aabcd64fd6a6c105068c67fc42d9f13b52699a9b34cae1
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:d51349d0dcf20f7e342a9a03802917d8cab758afdc0831284455f3ab3511a0ee
  Associated tags:
 - 20191223-000351
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-000351
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191223-000351].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:d51349d0dcf20f7e342a9a03802917d8cab758afdc0831284455f3ab3511a0ee].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
>>> FAILURE
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5m 9s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/i26ybaujjz7eg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1882

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1882/display/redirect>

Changes:


------------------------------------------
[...truncated 264.91 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-180402"
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "e1"
root_transform_ids: "e6"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/22 18:05:26 Prepared job with id: go-job-7-1577037926536833992_728033ca-d222-4a4a-b2e7-f5a187d2efee and staging token: {"sessionId":"go-job-7-1577037926536833992_728033ca-d222-4a4a-b2e7-f5a187d2efee","basePath":"/tmp/beam-artifact-staging"}
2019/12/22 18:05:26 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/22 18:05:26 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577037926536833992_728033ca-d222-4a4a-b2e7-f5a187d2efee/MANIFEST
19/12/22 18:05:26 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577037926536833992-jenkins-1222180526-d4d1f68d_30726851-8ef5-4236-97ef-aabdf5b3b164
19/12/22 18:05:26 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577037926536833992-jenkins-1222180526-d4d1f68d_30726851-8ef5-4236-97ef-aabdf5b3b164
2019/12/22 18:05:26 Submitted job: go0job0701577037926536833992-jenkins-1222180526-d4d1f68d_30726851-8ef5-4236-97ef-aabdf5b3b164
2019/12/22 18:05:26 Job state: STOPPED
2019/12/22 18:05:26 Job state: STARTING
2019/12/22 18:05:26 Job state: RUNNING
19/12/22 18:05:26 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577037926536833992-jenkins-1222180526-d4d1f68d_30726851-8ef5-4236-97ef-aabdf5b3b164.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/22 18:05:26  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/22 18:05:26  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/22 18:05:26 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577037926536833992_728033ca-d222-4a4a-b2e7-f5a187d2efee/MANIFEST has 1 artifact locations
19/12/22 18:05:26 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577037926536833992_728033ca-d222-4a4a-b2e7-f5a187d2efee/
2019/12/22 18:05:26 Job state: FAILED
2019/12/22 18:05:26 Test flatten:flatten failed: job go0job0701577037926536833992-jenkins-1222180526-d4d1f68d_30726851-8ef5-4236-97ef-aabdf5b3b164 failed
2019/12/22 18:05:26 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-180402
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:bd170958200741c501a3c75d15c7587725cba03ec2cc7132f364fafe06295634
Deleted: sha256:22b170d47e9a03c10e840bfac7a6eb92f066041d739286dc3118441ead2f6306
Deleted: sha256:40627144fa9bfded95280e150c83080b95d512384cd287cd15331e49b26a388d
Deleted: sha256:31231d16a6a8a50fd31eb0d9aecd6ba7db32d25158aff8bd3801506508f42172
Deleted: sha256:b5548288ad4fbdca3cdf056a609b57f302186e994b0aaf4debed40c175db0daa
Deleted: sha256:0a6169bb7d34183efde88bdf45ea9b392b130f5f4f7d9aebdc5c42e4f6af9c02
Deleted: sha256:4d33f9b9fb97be7eb0a554647a99839c7bced75813c30e780e22010ef26807ad
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:bd170958200741c501a3c75d15c7587725cba03ec2cc7132f364fafe06295634
  Associated tags:
 - 20191222-180402
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-180402
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-180402].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:bd170958200741c501a3c75d15c7587725cba03ec2cc7132f364fafe06295634].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
>>> FAILURE
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5m 9s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/k2bzsi5exizrg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1881

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1881/display/redirect>

Changes:


------------------------------------------
[...truncated 265.80 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-120348"
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/22 12:05:07 Prepared job with id: go-job-7-1577016307524877546_286cd176-e080-4f51-8c81-f07d56d31b32 and staging token: {"sessionId":"go-job-7-1577016307524877546_286cd176-e080-4f51-8c81-f07d56d31b32","basePath":"/tmp/beam-artifact-staging"}
2019/12/22 12:05:07 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/22 12:05:07 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1577016307524877546_286cd176-e080-4f51-8c81-f07d56d31b32/MANIFEST
19/12/22 12:05:07 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701577016307524877546-jenkins-1222120507-2d95ee83_8d8a61fd-87ea-47b5-b25d-1d9d85fdd3b5
19/12/22 12:05:07 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701577016307524877546-jenkins-1222120507-2d95ee83_8d8a61fd-87ea-47b5-b25d-1d9d85fdd3b5
2019/12/22 12:05:07 Submitted job: go0job0701577016307524877546-jenkins-1222120507-2d95ee83_8d8a61fd-87ea-47b5-b25d-1d9d85fdd3b5
2019/12/22 12:05:07 Job state: STOPPED
2019/12/22 12:05:07 Job state: STARTING
2019/12/22 12:05:07 Job state: RUNNING
19/12/22 12:05:07 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701577016307524877546-jenkins-1222120507-2d95ee83_8d8a61fd-87ea-47b5-b25d-1d9d85fdd3b5.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/22 12:05:07  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/22 12:05:07  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/22 12:05:07 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1577016307524877546_286cd176-e080-4f51-8c81-f07d56d31b32/MANIFEST has 1 artifact locations
19/12/22 12:05:07 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1577016307524877546_286cd176-e080-4f51-8c81-f07d56d31b32/
2019/12/22 12:05:07 Job state: FAILED
2019/12/22 12:05:07 Test flatten:flatten failed: job go0job0701577016307524877546-jenkins-1222120507-2d95ee83_8d8a61fd-87ea-47b5-b25d-1d9d85fdd3b5 failed
2019/12/22 12:05:07 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-120348
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:3ebe9578d66543e9e08b513b7c8a25f64f632a7f313e279dc54248b8edf584a2
Deleted: sha256:d158987c861a11e29323462f7e286e1fa10434cc8c75d562212cf2b9c0faaf78
Deleted: sha256:d2da46cedc44bfcf4b921081cb9260d6ec708d3624e1ef60564c0c7d4f4a80dc
Deleted: sha256:7311e90c40f84f89b1ea87cbf9c96182686efd224fdbcf65c699dfa936477446
Deleted: sha256:966b294cf27047bcb70cd7405b9b221fd6814dc208ecbc2eb6b4016da8b634bb
Deleted: sha256:340b60c23a77ef90edb5dd07ff0a1fe9dd2d4f94b33736a1af3b017da8125bef
Deleted: sha256:ae2769d224fbb591dde95d547c9fc44ced06a152e3425cb9904976960c5bb83d
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:3ebe9578d66543e9e08b513b7c8a25f64f632a7f313e279dc54248b8edf584a2
  Associated tags:
 - 20191222-120348
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-120348
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-120348].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:3ebe9578d66543e9e08b513b7c8a25f64f632a7f313e279dc54248b8edf584a2].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 51s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/4zvceo5dapbso

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1880

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1880/display/redirect>

Changes:


------------------------------------------
[...truncated 265.33 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-060357"
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/22 06:05:21 Prepared job with id: go-job-7-1576994721521246628_0617b490-d2f4-47fa-9531-af401b04eb86 and staging token: {"sessionId":"go-job-7-1576994721521246628_0617b490-d2f4-47fa-9531-af401b04eb86","basePath":"/tmp/beam-artifact-staging"}
2019/12/22 06:05:21 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/22 06:05:21 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576994721521246628_0617b490-d2f4-47fa-9531-af401b04eb86/MANIFEST
19/12/22 06:05:21 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576994721521246628-jenkins-1222060521-3114a70a_f8294790-431f-4d31-ab1c-8857df2c91c7
19/12/22 06:05:21 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576994721521246628-jenkins-1222060521-3114a70a_f8294790-431f-4d31-ab1c-8857df2c91c7
2019/12/22 06:05:21 Submitted job: go0job0701576994721521246628-jenkins-1222060521-3114a70a_f8294790-431f-4d31-ab1c-8857df2c91c7
2019/12/22 06:05:21 Job state: STOPPED
2019/12/22 06:05:21 Job state: STARTING
2019/12/22 06:05:21 Job state: RUNNING
19/12/22 06:05:21 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576994721521246628-jenkins-1222060521-3114a70a_f8294790-431f-4d31-ab1c-8857df2c91c7.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/22 06:05:21  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/22 06:05:21  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/22 06:05:21 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576994721521246628_0617b490-d2f4-47fa-9531-af401b04eb86/MANIFEST has 1 artifact locations
19/12/22 06:05:21 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576994721521246628_0617b490-d2f4-47fa-9531-af401b04eb86/
2019/12/22 06:05:21 Job state: FAILED
2019/12/22 06:05:21 Test flatten:flatten failed: job go0job0701576994721521246628-jenkins-1222060521-3114a70a_f8294790-431f-4d31-ab1c-8857df2c91c7 failed
2019/12/22 06:05:21 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-060357
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:617b77f29c5ed9c05c981aeda52c4f5e53f4cc73d15ed8a27c3da4fd49ea3ce6
Deleted: sha256:8621665e6f7ff3de53c4d10abcd1010c9eb487e35d13f6e7e18e84bf537e2944
Deleted: sha256:22a28e6c1c7212554cab9c5319fbade3a6c1de5ae5efca743c207ec269d28a39
Deleted: sha256:82c8b801c1c470cf4e8a6e7030a51cae66e69efc7f157748e0628c93bedf8b13
Deleted: sha256:abbf9b56e419a974f3ca02aab5b12b13dd94698391a5f206dadbd2485020d512
Deleted: sha256:976f40b5d3664116e346be5d0eedb2d7794eb4e0b872417daeabbece60879276
Deleted: sha256:4f87f46e32ab774af894b435676840b6441355a5818d11488fbbcf143790f318
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:617b77f29c5ed9c05c981aeda52c4f5e53f4cc73d15ed8a27c3da4fd49ea3ce6
  Associated tags:
 - 20191222-060357
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-060357
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-060357].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:617b77f29c5ed9c05c981aeda52c4f5e53f4cc73d15ed8a27c3da4fd49ea3ce6].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5m 3s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/76u7wgyujwdic

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1879

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1879/display/redirect>

Changes:


------------------------------------------
[...truncated 265.56 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-000228"
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "e3"
root_transform_ids: "e6"
root_transform_ids: "e1"
root_transform_ids: "e4"
root_transform_ids: "e2"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/22 00:03:57 Prepared job with id: go-job-7-1576973037364744029_e2c57c33-a887-4f3f-8ffe-b90ac774452f and staging token: {"sessionId":"go-job-7-1576973037364744029_e2c57c33-a887-4f3f-8ffe-b90ac774452f","basePath":"/tmp/beam-artifact-staging"}
2019/12/22 00:03:57 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/22 00:03:57 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576973037364744029_e2c57c33-a887-4f3f-8ffe-b90ac774452f/MANIFEST
19/12/22 00:03:57 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576973037364744029-jenkins-1222000357-40e20c15_ad8f2b32-5cab-42f4-bba6-216da9ca7e5e
19/12/22 00:03:57 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576973037364744029-jenkins-1222000357-40e20c15_ad8f2b32-5cab-42f4-bba6-216da9ca7e5e
2019/12/22 00:03:57 Submitted job: go0job0701576973037364744029-jenkins-1222000357-40e20c15_ad8f2b32-5cab-42f4-bba6-216da9ca7e5e
2019/12/22 00:03:57 Job state: STOPPED
2019/12/22 00:03:57 Job state: STARTING
2019/12/22 00:03:57 Job state: RUNNING
19/12/22 00:03:57 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576973037364744029-jenkins-1222000357-40e20c15_ad8f2b32-5cab-42f4-bba6-216da9ca7e5e.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/22 00:03:57  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/22 00:03:57  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/22 00:03:57 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576973037364744029_e2c57c33-a887-4f3f-8ffe-b90ac774452f/MANIFEST has 1 artifact locations
19/12/22 00:03:57 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576973037364744029_e2c57c33-a887-4f3f-8ffe-b90ac774452f/
2019/12/22 00:03:57 Job state: FAILED
2019/12/22 00:03:57 Test flatten:flatten failed: job go0job0701576973037364744029-jenkins-1222000357-40e20c15_ad8f2b32-5cab-42f4-bba6-216da9ca7e5e failed
2019/12/22 00:03:57 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-000228
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:db3b6c121e130a8c19127b970c1c5934dd02758f41f2c21d2607e8d4fcad0787
Deleted: sha256:e0b983c777bee270471f4e95ee5bdcc7df37c1be764450a73940140d6f9afaef
Deleted: sha256:a53984e8b9c526ebb3ae8e3b34d774fab1f3235ac43fb86c83b388a501e8c636
Deleted: sha256:be51587f1a69987a2b7c3cf9ef50551d54a6241529f4525640492d747220ad80
Deleted: sha256:1f3d4fad347131ec7d32bbe2dbc2424fe2bd213090598e7eaed458455ca2ce2b
Deleted: sha256:bb58ee73727ed71b0a05bcbd0aea81c66e395a83a6bf12dc742752aaa39eb6ed
Deleted: sha256:cc2d46b2cf9c1272620b5a19388689f16cccca4a755e135b00df3acc73769c83
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:db3b6c121e130a8c19127b970c1c5934dd02758f41f2c21d2607e8d4fcad0787
  Associated tags:
 - 20191222-000228
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-000228
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191222-000228].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:db3b6c121e130a8c19127b970c1c5934dd02758f41f2c21d2607e8d4fcad0787].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
>>> FAILURE
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 39s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/wz3xmzgtcx3nw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1878

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1878/display/redirect?page=changes>

Changes:

[github] Merge pull request #10356: [BEAM-7274] Infer a Beam Schema from a


------------------------------------------
[...truncated 265.26 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-183900"
    >
  >
>
root_transform_ids: "e1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/21 18:40:32 Prepared job with id: go-job-7-1576953632835310467_a2ad4514-87a2-46c6-b222-787cfe4dec3d and staging token: {"sessionId":"go-job-7-1576953632835310467_a2ad4514-87a2-46c6-b222-787cfe4dec3d","basePath":"/tmp/beam-artifact-staging"}
2019/12/21 18:40:32 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/21 18:40:33 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576953632835310467_a2ad4514-87a2-46c6-b222-787cfe4dec3d/MANIFEST
19/12/21 18:40:33 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576953632835310467-jenkins-1221184033-682190b6_bf07af81-c950-41e0-9b7c-ec949599bccb
19/12/21 18:40:33 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576953632835310467-jenkins-1221184033-682190b6_bf07af81-c950-41e0-9b7c-ec949599bccb
2019/12/21 18:40:33 Submitted job: go0job0701576953632835310467-jenkins-1221184033-682190b6_bf07af81-c950-41e0-9b7c-ec949599bccb
2019/12/21 18:40:33 Job state: STOPPED
2019/12/21 18:40:33 Job state: STARTING
2019/12/21 18:40:33 Job state: RUNNING
19/12/21 18:40:33 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576953632835310467-jenkins-1221184033-682190b6_bf07af81-c950-41e0-9b7c-ec949599bccb.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 18:40:33  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 18:40:33  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/21 18:40:33 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576953632835310467_a2ad4514-87a2-46c6-b222-787cfe4dec3d/MANIFEST has 1 artifact locations
19/12/21 18:40:33 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576953632835310467_a2ad4514-87a2-46c6-b222-787cfe4dec3d/
2019/12/21 18:40:33 Job state: FAILED
2019/12/21 18:40:33 Test flatten:flatten failed: job go0job0701576953632835310467-jenkins-1221184033-682190b6_bf07af81-c950-41e0-9b7c-ec949599bccb failed
2019/12/21 18:40:33 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-183900
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:83638e87a90da5c1e02ba3b7e165b978a6e2b4a530014fbea1014704c3e4184b
Deleted: sha256:50ec69d8c1753774167b0276b8f77c5a205f8e78cc8c1a4d62955f55b7e4c898
Deleted: sha256:18d6638da653d17daf3d0a4dcdce8c693d500901d75d217f7b5a7e504d78c502
Deleted: sha256:435719bf5929e68008116c1bd9cd38ac9d5cac01fb1d6a4affe4ea0b478cb6aa
Deleted: sha256:91282c4e529b9d1b9c883f6e5851f5ca19a9a7acf0f83922f1973cdf28f348e1
Deleted: sha256:058eae614fce7e2f55e3db7bae5ab4db53dcf97d75d0e74da5214ab44aed8520
Deleted: sha256:af005bb23428bef8365cd7877a4293bae907174cc106c4323bbe20d754dce71b
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:83638e87a90da5c1e02ba3b7e165b978a6e2b4a530014fbea1014704c3e4184b
  Associated tags:
 - 20191221-183900
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-183900
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-183900].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:83638e87a90da5c1e02ba3b7e165b978a6e2b4a530014fbea1014704c3e4184b].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
>>> FAILURE
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 34s
53 actionable tasks: 41 executed, 12 from cache

Publishing build scan...
https://gradle.com/s/uvvoizme5zu3c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1877

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1877/display/redirect>

Changes:


------------------------------------------
[...truncated 265.11 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-180348"
    >
  >
>
root_transform_ids: "e3"
root_transform_ids: "e1"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e2"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/21 18:05:14 Prepared job with id: go-job-7-1576951514378828887_264e3b07-ac8d-4c32-9d63-c0067df2f134 and staging token: {"sessionId":"go-job-7-1576951514378828887_264e3b07-ac8d-4c32-9d63-c0067df2f134","basePath":"/tmp/beam-artifact-staging"}
2019/12/21 18:05:14 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/21 18:05:14 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576951514378828887_264e3b07-ac8d-4c32-9d63-c0067df2f134/MANIFEST
19/12/21 18:05:14 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576951514378828887-jenkins-1221180514-3d3a1829_f07aeb02-a4b9-4dd2-983b-b9a3f94118ea
19/12/21 18:05:14 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576951514378828887-jenkins-1221180514-3d3a1829_f07aeb02-a4b9-4dd2-983b-b9a3f94118ea
2019/12/21 18:05:14 Submitted job: go0job0701576951514378828887-jenkins-1221180514-3d3a1829_f07aeb02-a4b9-4dd2-983b-b9a3f94118ea
2019/12/21 18:05:14 Job state: STOPPED
2019/12/21 18:05:14 Job state: STARTING
2019/12/21 18:05:14 Job state: RUNNING
19/12/21 18:05:14 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576951514378828887-jenkins-1221180514-3d3a1829_f07aeb02-a4b9-4dd2-983b-b9a3f94118ea.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 18:05:14  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 18:05:14  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/21 18:05:14 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576951514378828887_264e3b07-ac8d-4c32-9d63-c0067df2f134/MANIFEST has 1 artifact locations
19/12/21 18:05:14 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576951514378828887_264e3b07-ac8d-4c32-9d63-c0067df2f134/
2019/12/21 18:05:14 Job state: FAILED
2019/12/21 18:05:14 Test flatten:flatten failed: job go0job0701576951514378828887-jenkins-1221180514-3d3a1829_f07aeb02-a4b9-4dd2-983b-b9a3f94118ea failed
2019/12/21 18:05:14 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-180348
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:a8a86559801182add9a11e6f88b297444486b2b68714368033573f5cef45170e
Deleted: sha256:579fc15dd7be4367fa680549379705929e0020b8ec8b991cd4dce7f54ca68745
Deleted: sha256:3d4f717215fa0afd6318d264212b242d92a3f4bf8ff02f50abc5cd409c4aa18c
Deleted: sha256:06e64b1c2fccedd9f151dcd69eb6f4a994319bbc3fcef16bcdafeab1466a0933
Deleted: sha256:7a7abbed21b3a65e828345d5a059e5cde1cf2d01e8dbaa302f659d07d6bbf9d6
Deleted: sha256:cae819fe37e1a378ce4c98f2428eb60d1a1ad9acccc4fb6b8416a3a9e9da0b34
Deleted: sha256:a15dee0a7519e54f577faa8d457daa45b25644f673cbcc1669e4817f1540c8b3
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:a8a86559801182add9a11e6f88b297444486b2b68714368033573f5cef45170e
  Associated tags:
 - 20191221-180348
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-180348
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-180348].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:a8a86559801182add9a11e6f88b297444486b2b68714368033573f5cef45170e].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 56s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/oenis2yezwyv2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1876

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1876/display/redirect>

Changes:


------------------------------------------
[...truncated 265.11 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-120352"
    >
  >
>
root_transform_ids: "e3"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e4"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/21 12:05:17 Prepared job with id: go-job-7-1576929917110941088_962e35f7-6923-4b74-8f54-c863d17cb87a and staging token: {"sessionId":"go-job-7-1576929917110941088_962e35f7-6923-4b74-8f54-c863d17cb87a","basePath":"/tmp/beam-artifact-staging"}
2019/12/21 12:05:17 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/21 12:05:17 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576929917110941088_962e35f7-6923-4b74-8f54-c863d17cb87a/MANIFEST
19/12/21 12:05:17 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576929917110941088-jenkins-1221120517-2c95a54b_8f3e383f-a608-4248-86c1-ad461d0d5eac
19/12/21 12:05:17 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576929917110941088-jenkins-1221120517-2c95a54b_8f3e383f-a608-4248-86c1-ad461d0d5eac
2019/12/21 12:05:17 Submitted job: go0job0701576929917110941088-jenkins-1221120517-2c95a54b_8f3e383f-a608-4248-86c1-ad461d0d5eac
2019/12/21 12:05:17 Job state: STOPPED
2019/12/21 12:05:17 Job state: STARTING
2019/12/21 12:05:17 Job state: RUNNING
19/12/21 12:05:17 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576929917110941088-jenkins-1221120517-2c95a54b_8f3e383f-a608-4248-86c1-ad461d0d5eac.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 12:05:17  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 12:05:17  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/21 12:05:17 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576929917110941088_962e35f7-6923-4b74-8f54-c863d17cb87a/MANIFEST has 1 artifact locations
19/12/21 12:05:17 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576929917110941088_962e35f7-6923-4b74-8f54-c863d17cb87a/
2019/12/21 12:05:17 Job state: FAILED
2019/12/21 12:05:17 Test flatten:flatten failed: job go0job0701576929917110941088-jenkins-1221120517-2c95a54b_8f3e383f-a608-4248-86c1-ad461d0d5eac failed
2019/12/21 12:05:17 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-120352
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:9a0a4a1914bb22d071afdb4a30c627d42671db7d50d95933da58c0cd1917d40f
Deleted: sha256:924541fcf285ece5f1ef440420fe3452c271de8256fdf2f086a1d7700bb4e74d
Deleted: sha256:fa589b1832810a29b58e152bccdce255a9664878f186680d965c3212e7e7bb66
Deleted: sha256:e7ab97373f2b56f339344274468f89e8e5039228b1790068a8d086bce3974c43
Deleted: sha256:2d6d542d5cfa7f9280ad95b27e8c6ea28c51515bb039d25e4cad5da3f0a68067
Deleted: sha256:ca58e90aac63e3f88508ade55ee017a78d82b8484034251c80a83ee7ff1e0ab4
Deleted: sha256:909658f0225fd757f429d76009cc655dceaed586ccfbe43aeae449386656e0f3
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:9a0a4a1914bb22d071afdb4a30c627d42671db7d50d95933da58c0cd1917d40f
  Associated tags:
 - 20191221-120352
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-120352
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-120352].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:9a0a4a1914bb22d071afdb4a30c627d42671db7d50d95933da58c0cd1917d40f].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
>>> FAILURE
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5m 0s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/e2e5x63tkugzc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1875

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1875/display/redirect?page=changes>

Changes:

[mxm] [BEAM-8996] Improvements to the Flink runner page


------------------------------------------
[...truncated 266.07 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-063336"
    >
  >
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/21 06:35:28 Prepared job with id: go-job-7-1576910128826859223_f0bfd979-334a-489c-843b-ee4bb664b55e and staging token: {"sessionId":"go-job-7-1576910128826859223_f0bfd979-334a-489c-843b-ee4bb664b55e","basePath":"/tmp/beam-artifact-staging"}
2019/12/21 06:35:28 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/21 06:35:29 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576910128826859223_f0bfd979-334a-489c-843b-ee4bb664b55e/MANIFEST
19/12/21 06:35:29 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576910128826859223-jenkins-1221063529-e5a250e_5e1be44e-263d-470b-8802-6ed123823237
19/12/21 06:35:29 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576910128826859223-jenkins-1221063529-e5a250e_5e1be44e-263d-470b-8802-6ed123823237
2019/12/21 06:35:29 Submitted job: go0job0701576910128826859223-jenkins-1221063529-e5a250e_5e1be44e-263d-470b-8802-6ed123823237
2019/12/21 06:35:29 Job state: STOPPED
2019/12/21 06:35:29 Job state: STARTING
2019/12/21 06:35:29 Job state: RUNNING
19/12/21 06:35:29 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576910128826859223-jenkins-1221063529-e5a250e_5e1be44e-263d-470b-8802-6ed123823237.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 06:35:29  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 06:35:29  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/21 06:35:29 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576910128826859223_f0bfd979-334a-489c-843b-ee4bb664b55e/MANIFEST has 1 artifact locations
19/12/21 06:35:29 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576910128826859223_f0bfd979-334a-489c-843b-ee4bb664b55e/
2019/12/21 06:35:29 Job state: FAILED
2019/12/21 06:35:29 Test flatten:flatten failed: job go0job0701576910128826859223-jenkins-1221063529-e5a250e_5e1be44e-263d-470b-8802-6ed123823237 failed
2019/12/21 06:35:29 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-063336
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:955011fe4ab9e54df849479c1d115bf9034d578f3576a86eb32ea57de6fdc274
Deleted: sha256:920d33831330629ff0ae87ab006601b7eadc745f19c590a1c4bb208885ceb33d
Deleted: sha256:9f3888389689501455a40ee4e5e6f9dc8fda9b92e45b7cf4942b7201b51b99b8
Deleted: sha256:da8a3e99e3048e87a83445151933914b14c52cd2b170314867b3387d6e9aa0fa
Deleted: sha256:9330f892fd81a1ff9b331b4ff9a7f9a268d09a8db768e832f0accfe6f2455024
Deleted: sha256:72e1cbcc7a8756ef699414f0196a93febfc19de9326e5634399cd3b2031dd1c2
Deleted: sha256:71d07e564b029ec9448a790a4d31ec7cf09516753f4893030d7f4e414957910e
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:955011fe4ab9e54df849479c1d115bf9034d578f3576a86eb32ea57de6fdc274
  Associated tags:
 - 20191221-063336
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-063336
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-063336].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:955011fe4ab9e54df849479c1d115bf9034d578f3576a86eb32ea57de6fdc274].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
>>> FAILURE
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 43s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/ktwdexosn5zwo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1874

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1874/display/redirect>

Changes:


------------------------------------------
[...truncated 265.11 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-060400"
    >
  >
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/21 06:05:26 Prepared job with id: go-job-7-1576908326976433545_1c1d5058-4cbd-4a2b-bd85-d799b4a53fa8 and staging token: {"sessionId":"go-job-7-1576908326976433545_1c1d5058-4cbd-4a2b-bd85-d799b4a53fa8","basePath":"/tmp/beam-artifact-staging"}
2019/12/21 06:05:26 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/21 06:05:27 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576908326976433545_1c1d5058-4cbd-4a2b-bd85-d799b4a53fa8/MANIFEST
19/12/21 06:05:27 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576908326976433545-jenkins-1221060527-2ce58c1d_cfb5bf85-cb79-4b56-972a-11d8abc0e572
19/12/21 06:05:27 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576908326976433545-jenkins-1221060527-2ce58c1d_cfb5bf85-cb79-4b56-972a-11d8abc0e572
2019/12/21 06:05:27 Submitted job: go0job0701576908326976433545-jenkins-1221060527-2ce58c1d_cfb5bf85-cb79-4b56-972a-11d8abc0e572
2019/12/21 06:05:27 Job state: STOPPED
2019/12/21 06:05:27 Job state: STARTING
2019/12/21 06:05:27 Job state: RUNNING
19/12/21 06:05:27 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576908326976433545-jenkins-1221060527-2ce58c1d_cfb5bf85-cb79-4b56-972a-11d8abc0e572.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 06:05:27  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 06:05:27  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/21 06:05:27 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576908326976433545_1c1d5058-4cbd-4a2b-bd85-d799b4a53fa8/MANIFEST has 1 artifact locations
19/12/21 06:05:27 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576908326976433545_1c1d5058-4cbd-4a2b-bd85-d799b4a53fa8/
2019/12/21 06:05:27 Job state: FAILED
2019/12/21 06:05:27 Test flatten:flatten failed: job go0job0701576908326976433545-jenkins-1221060527-2ce58c1d_cfb5bf85-cb79-4b56-972a-11d8abc0e572 failed
2019/12/21 06:05:27 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-060400
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:906ded4543cc34983aee7cec57ee7a8d36f3865ce9cf94cb797500e7a1b2dc7c
Deleted: sha256:74fdf2e9b7f6eade6af7999b8852f3e875beae721105eb886391cb7f4f3e18e2
Deleted: sha256:b86cee6476b127f1bd0a6368eaf359e3a85fca663f1be8f5dd83bb7331c67b48
Deleted: sha256:e691ec8ab60624284375e27f2abb16b255c19c5c723dcb0214b7743d5e1db4fd
Deleted: sha256:92fb5c25e0e726d8fc4458af090589e910c9f1bfe30941e1d49b8193468937cb
Deleted: sha256:120555542c75f274b59a02b3d2d5672250e6fb5ca598d70218b7959cd83bfb90
Deleted: sha256:1816f374aa757ac959c5f1d0f0e9371beb15b873e8cdf6ff368e8c608bef3bd2
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:906ded4543cc34983aee7cec57ee7a8d36f3865ce9cf94cb797500e7a1b2dc7c
  Associated tags:
 - 20191221-060400
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-060400
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-060400].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:906ded4543cc34983aee7cec57ee7a8d36f3865ce9cf94cb797500e7a1b2dc7c].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5m 11s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/cpuhpm4g4gw7w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1873

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1873/display/redirect?page=changes>

Changes:

[kamil.wasilewski] [BEAM-8671] Add Python 3.7 support for LoadTestBuilder

[kamil.wasilewski] [BEAM-8671] Add ParDo test running on Python 3.7


------------------------------------------
[...truncated 265.26 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-025602"
    >
  >
>
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/21 02:57:33 Prepared job with id: go-job-7-1576897053875474028_d31e64e8-f9af-43fe-b6cf-23ad7c8ede13 and staging token: {"sessionId":"go-job-7-1576897053875474028_d31e64e8-f9af-43fe-b6cf-23ad7c8ede13","basePath":"/tmp/beam-artifact-staging"}
2019/12/21 02:57:33 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/21 02:57:34 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576897053875474028_d31e64e8-f9af-43fe-b6cf-23ad7c8ede13/MANIFEST
19/12/21 02:57:34 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576897053875474028-jenkins-1221025734-719af3bc_534d8e3c-82f8-436c-8adc-78fc2e896980
19/12/21 02:57:34 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576897053875474028-jenkins-1221025734-719af3bc_534d8e3c-82f8-436c-8adc-78fc2e896980
2019/12/21 02:57:34 Submitted job: go0job0701576897053875474028-jenkins-1221025734-719af3bc_534d8e3c-82f8-436c-8adc-78fc2e896980
2019/12/21 02:57:34 Job state: STOPPED
2019/12/21 02:57:34 Job state: STARTING
2019/12/21 02:57:34 Job state: RUNNING
19/12/21 02:57:34 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576897053875474028-jenkins-1221025734-719af3bc_534d8e3c-82f8-436c-8adc-78fc2e896980.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 02:57:34  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 02:57:34  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/21 02:57:34 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576897053875474028_d31e64e8-f9af-43fe-b6cf-23ad7c8ede13/MANIFEST has 1 artifact locations
19/12/21 02:57:34 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576897053875474028_d31e64e8-f9af-43fe-b6cf-23ad7c8ede13/
2019/12/21 02:57:34 Job state: FAILED
2019/12/21 02:57:34 Test flatten:flatten failed: job go0job0701576897053875474028-jenkins-1221025734-719af3bc_534d8e3c-82f8-436c-8adc-78fc2e896980 failed
2019/12/21 02:57:34 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-025602
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:ae503cf9a292c74ef399b33126193d37ff546b005643589a93d1ccf2c47148c2
Deleted: sha256:b7da9e0dfb6e97b5c45d7978fc89d950a4c1aa67aa8eac0929db858ac2891869
Deleted: sha256:4c2ce48582cd6618e196fc43ddfd5ac43964490b63c20ebca227eba832d06338
Deleted: sha256:429d488c752aedccf4bf03bd5b5c35e316f8ffa9d373c7635ba8562f04492676
Deleted: sha256:6a36d66d6980ca43e294d209859e27b54d8fef8b07b923957c1679afd7cd5d5c
Deleted: sha256:46fabfcb2c59cc6cf54401a2f5355279a1cb114606d4cdd302a7a27f0cfa2086
Deleted: sha256:566e833c31c94674db85fe500520d5b5a978667b5f6574c9f5584f660545bdbe
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:ae503cf9a292c74ef399b33126193d37ff546b005643589a93d1ccf2c47148c2
  Associated tags:
 - 20191221-025602
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-025602
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-025602].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:ae503cf9a292c74ef399b33126193d37ff546b005643589a93d1ccf2c47148c2].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
>>> FAILURE
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 39s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/bn3hq77e4bldy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1872

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1872/display/redirect?page=changes>

Changes:

[pabloem] [BEAM-2572] Python SDK S3 Filesystem (#9955)

[github] [BEAM-8974] Wait for log messages to be processed before checking them.


------------------------------------------
[...truncated 265.41 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-014618"
    >
  >
>
root_transform_ids: "e1"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e2"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/21 01:47:53 Prepared job with id: go-job-7-1576892873795463046_5f662778-4f12-45ed-af66-272fae37eb20 and staging token: {"sessionId":"go-job-7-1576892873795463046_5f662778-4f12-45ed-af66-272fae37eb20","basePath":"/tmp/beam-artifact-staging"}
2019/12/21 01:47:53 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/21 01:47:54 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576892873795463046_5f662778-4f12-45ed-af66-272fae37eb20/MANIFEST
19/12/21 01:47:54 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576892873795463046-jenkins-1221014754-40df080a_7958743e-362f-4322-8361-7044505cdea2
19/12/21 01:47:54 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576892873795463046-jenkins-1221014754-40df080a_7958743e-362f-4322-8361-7044505cdea2
2019/12/21 01:47:54 Submitted job: go0job0701576892873795463046-jenkins-1221014754-40df080a_7958743e-362f-4322-8361-7044505cdea2
2019/12/21 01:47:54 Job state: STOPPED
2019/12/21 01:47:54 Job state: STARTING
2019/12/21 01:47:54 Job state: RUNNING
19/12/21 01:47:54 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576892873795463046-jenkins-1221014754-40df080a_7958743e-362f-4322-8361-7044505cdea2.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 01:47:54  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 01:47:54  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/21 01:47:54 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576892873795463046_5f662778-4f12-45ed-af66-272fae37eb20/MANIFEST has 1 artifact locations
19/12/21 01:47:54 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576892873795463046_5f662778-4f12-45ed-af66-272fae37eb20/
2019/12/21 01:47:54 Job state: FAILED
2019/12/21 01:47:54 Test flatten:flatten failed: job go0job0701576892873795463046-jenkins-1221014754-40df080a_7958743e-362f-4322-8361-7044505cdea2 failed
2019/12/21 01:47:54 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-014618
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:cdd6a02fd1915d9c9a5a67600b3ae38698cb3d010566803f04299d333a42aa88
Deleted: sha256:cb9a189a7332ac682f803f57c80bab07f4463bfdbb2dfc579b51e3bfbfc6ae42
Deleted: sha256:82cf0ec3e242d639c1892ab0f67207762c24180b95ef5f29fb2007f17bd18c2c
Deleted: sha256:853b78abc0c3dc5df713ce5dd33c507371942b87273b44e8c0b50eb0e1b36b77
Deleted: sha256:cf63facfc8b253a9b5f335d0cc6e722b2a59b2c790fd8ab63401553cd8fe60a9
Deleted: sha256:42bd6083ce2d4c50c03c33a7770127ba54f40faccfb6edf9f7bf25d030aec14c
Deleted: sha256:f2195a9c8cef180211264e802b91a0df241310e0a3c75f153d5ffd375e80ff95
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:cdd6a02fd1915d9c9a5a67600b3ae38698cb3d010566803f04299d333a42aa88
  Associated tags:
 - 20191221-014618
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-014618
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-014618].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:cdd6a02fd1915d9c9a5a67600b3ae38698cb3d010566803f04299d333a42aa88].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 55s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/3rets4slpo6qa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Go_VR_Spark #1871

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/1871/display/redirect?page=changes>

Changes:

[tysonjh] CachingShuffleBatchReader use bytes to limit size.

[lukecwik] Minor cleanup of tests using TestStream. (#10188)


------------------------------------------
[...truncated 267.02 KB...]
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n7"
    value: <
      unique_name: "n7"
      coder_id: "c3"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n8"
    value: <
      unique_name: "n8"
      coder_id: "c4"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  pcollections: <
    key: "n9"
    value: <
      unique_name: "n9"
      coder_id: "c6"
      is_bounded: BOUNDED
      windowing_strategy_id: "w0"
    >
  >
  windowing_strategies: <
    key: "w0"
    value: <
      window_fn: <
        urn: "beam:windowfn:global_windows:v0.1"
      >
      merge_status: NON_MERGING
      window_coder_id: "c1"
      trigger: <
        default: <
        >
      >
      accumulation_mode: DISCARDING
      output_time: END_OF_WINDOW
      closing_behavior: EMIT_IF_NONEMPTY
      OnTimeBehavior: FIRE_ALWAYS
    >
  >
  coders: <
    key: "c0"
    value: <
      spec: <
        urn: "beam:coder:bytes:v1"
      >
    >
  >
  coders: <
    key: "c1"
    value: <
      spec: <
        urn: "beam:coder:global_window:v1"
      >
    >
  >
  coders: <
    key: "c2"
    value: <
      spec: <
        urn: "beam:go:coder:custom:v1"
        payload: "Cgd2YXJpbnR6EgIIAhqFAQpxZ2l0aHViLmNvbS9hcGFjaGUvYmVhbS9zZGtzL2dvL3Rlc3QvdmVuZG9yL2dpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby9wa2cvYmVhbS9jb3JlL3J1bnRpbWUvY29kZXJ4LmVuY1ZhckludFoSEAgWIgQIGUAPKgYIFBICCAgikQEKcWdpdGh1Yi5jb20vYXBhY2hlL2JlYW0vc2Rrcy9nby90ZXN0L3ZlbmRvci9naXRodWIuY29tL2FwYWNoZS9iZWFtL3Nka3MvZ28vcGtnL2JlYW0vY29yZS9ydW50aW1lL2NvZGVyeC5kZWNWYXJJbnRaEhwIFiIECBlAAyIGCBQSAggIKgQIGUAPKgQIGUAB"
      >
    >
  >
  coders: <
    key: "c3"
    value: <
      spec: <
        urn: "beam:coder:length_prefix:v1"
      >
      component_coder_ids: "c2"
    >
  >
  coders: <
    key: "c4"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c5"
    value: <
      spec: <
        urn: "beam:coder:iterable:v1"
      >
      component_coder_ids: "c3"
    >
  >
  coders: <
    key: "c6"
    value: <
      spec: <
        urn: "beam:coder:kv:v1"
      >
      component_coder_ids: "c3"
      component_coder_ids: "c5"
    >
  >
  environments: <
    key: "go"
    value: <
      urn: "beam:env:docker:v1"
      payload: "\n<us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-003258"
    >
  >
>
root_transform_ids: "e3"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e4"
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e7"
root_transform_ids: "s1"
2019/12/21 00:37:11 Prepared job with id: go-job-7-1576888631493330524_735c835e-3af6-4199-8fb2-f26dbef485bc and staging token: {"sessionId":"go-job-7-1576888631493330524_735c835e-3af6-4199-8fb2-f26dbef485bc","basePath":"/tmp/beam-artifact-staging"}
2019/12/21 00:37:11 Using specified worker binary: './sdks/go/test/build/bin/linux-amd64/worker'
2019/12/21 00:37:12 Staged binary artifact with token: /tmp/beam-artifact-staging/go-job-7-1576888631493330524_735c835e-3af6-4199-8fb2-f26dbef485bc/MANIFEST
19/12/21 00:37:12 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job go0job0701576888631493330524-jenkins-1221003712-168b5823_d93d75f3-c3e8-4f3e-a02f-30c48d76b2ac
19/12/21 00:37:12 INFO org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Starting job invocation go0job0701576888631493330524-jenkins-1221003712-168b5823_d93d75f3-c3e8-4f3e-a02f-30c48d76b2ac
2019/12/21 00:37:12 Submitted job: go0job0701576888631493330524-jenkins-1221003712-168b5823_d93d75f3-c3e8-4f3e-a02f-30c48d76b2ac
2019/12/21 00:37:12 Job state: STOPPED
2019/12/21 00:37:12 Job state: STARTING
2019/12/21 00:37:12 Job state: RUNNING
19/12/21 00:37:12 ERROR org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation: Error during job invocation go0job0701576888631493330524-jenkins-1221003712-168b5823_d93d75f3-c3e8-4f3e-a02f-30c48d76b2ac.
java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 00:37:12  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:235)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:77)
	at org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:93)
	at org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
2019/12/21 00:37:12  (): java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=n2, PCollection=unique_name: "n2"
coder_id: "c3"
is_bounded: BOUNDED
windowing_strategy_id: "w0"
}] were consumed but never produced
19/12/21 00:37:12 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService: Manifest at /tmp/beam-artifact-staging/go-job-7-1576888631493330524_735c835e-3af6-4199-8fb2-f26dbef485bc/MANIFEST has 1 artifact locations
19/12/21 00:37:12 INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService: Removed dir /tmp/beam-artifact-staging/go-job-7-1576888631493330524_735c835e-3af6-4199-8fb2-f26dbef485bc/
2019/12/21 00:37:12 Job state: FAILED
2019/12/21 00:37:12 Test flatten:flatten failed: job go0job0701576888631493330524-jenkins-1221003712-168b5823_d93d75f3-c3e8-4f3e-a02f-30c48d76b2ac failed
2019/12/21 00:37:12 Result: 4 tests failed

if [[ ! -z "$JOB_PORT" ]]; then
  # Shut down the job server
  kill %1 || echo "Failed to shut down job server"
fi

# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-003258
Untagged: us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:25ac20ba99d506ce06ebbe9817cef20ee2be418298411400cb689bf4697aed69
Deleted: sha256:107502742a50a4cd1524625a0716fd526c23d3f28747cc1447a632a176eb6e2a
Deleted: sha256:8cacdc4572ce2ac8056643dd6b4552a4ebba0e82ab318722e67063ea03076358
Deleted: sha256:ac5418c217b4c733fa537681d3bff9b38125e1d37092dabad3313dc4b362969d
Deleted: sha256:e28d5c7d0fd110fcac0993d15f59e4270cfbde1bf64eba39085333ff9ff3dc16
Deleted: sha256:bfe96e1f87f1e2972573ad05af7a9b94924e24fda2d601171633dc0e5971bd19
Deleted: sha256:da1a347f9d62d394c95e4492e2575f7d5c4d31a479c221b762f19876be9d4f92
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:25ac20ba99d506ce06ebbe9817cef20ee2be418298411400cb689bf4697aed69
  Associated tags:
 - 20191221-003258
Tags:
- us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-003258
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk:20191221-003258].
Deleted [us.gcr.io/apache-beam-testing/jenkins/go_sdk@sha256:25ac20ba99d506ce06ebbe9817cef20ee2be418298411400cb689bf4697aed69].

# Clean up tempdir
rm -rf $TMPDIR

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
>>> FAILURE
exit $TEST_EXIT_CODE

> Task :sdks:go:test:sparkValidatesRunner FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/ws/src/sdks/go/test/build.gradle'> line: 75

* What went wrong:
Execution failed for task ':sdks:go:test:sparkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 34s
53 actionable tasks: 40 executed, 13 from cache

Publishing build scan...
https://gradle.com/s/wht3ngvtf4p4e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org