You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/03/05 17:45:16 UTC
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #2660
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/2660/display/redirect?page=changes>
Changes:
[hktang] [BEAM-9453] Changed new string creation to use StandardCharsets.UTF_8
------------------------------------------
[...truncated 822.53 KB...]
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (98c7135924f243ef62b791b132872424).
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (98c7135924f243ef62b791b132872424) [FINISHED]
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) 98c7135924f243ef62b791b132872424.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (98c7135924f243ef62b791b132872424) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupReduce (GroupReduce at CoGBK) (1/1) (attempt #0) to cc812ea2-8675-410b-add3-69b5131d3ca6 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-11] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupReduce (GroupReduce at CoGBK) (1/1).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) switched from CREATED to DEPLOYING.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) [DEPLOYING]
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-11] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) switched from DEPLOYING to RUNNING.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (d7e20e558a2081b5ef55f795e08bcdd6) switched from RUNNING to FINISHED.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (d7e20e558a2081b5ef55f795e08bcdd6).
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (d7e20e558a2081b5ef55f795e08bcdd6) [FINISHED]
[flink-akka.actor.default-dispatcher-11] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) d7e20e558a2081b5ef55f795e08bcdd6.
[flink-akka.actor.default-dispatcher-11] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (d7e20e558a2081b5ef55f795e08bcdd6) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-11] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-11] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-11] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (attempt #0) to cc812ea2-8675-410b-add3-69b5131d3ca6 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-12] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1).
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) switched from CREATED to DEPLOYING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) [DEPLOYING]
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) switched from DEPLOYING to RUNNING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.flink.metrics.MetricGroup - The operator name MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) exceeded the 80 characters length limit and was truncated.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) switched from RUNNING to FINISHED.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) [FINISHED]
[flink-akka.actor.default-dispatcher-12] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at CoGBK) 36b7dc429db94a2a9f119faea3ea0af5.
[flink-akka.actor.default-dispatcher-12] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (36b7dc429db94a2a9f119faea3ea0af5) switched from RUNNING to FINISHED.
[grpc-default-executor-5] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583430254581691927_6d9e2910-cd74-4224-a9a3-02881605472b/MANIFEST
[grpc-default-executor-5] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583430254581691927_6d9e2910-cd74-4224-a9a3-02881605472b/MANIFEST -> 1 artifacts
[grpc-default-executor-5] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 18-1
[grpc-default-executor-5] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:41929 ...
[grpc-default-executor-5] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:40581 ...
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:43807 ...
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:246 - DataSource: 1 elements in 3469797 ns
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing environment urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-173825"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment - Closing Docker container b08bbf315dfb52c13bcf361811658a029f68887f29a3518b52dc8cb0f5f3e725. Logs:
2020/03/05 17:45:06 Provision info:
pipeline_options:<fields:<key:"beam:option:app_name:v1" value:<string_value:"go-job-7-1583430254581691927" > > fields:<key:"beam:option:experiments:v1" value:<list_value:<values:<string_value:"beam_fn_api" > > > > fields:<key:"beam:option:flink_master:v1" value:<string_value:"[local]" > > fields:<key:"beam:option:go_options:v1" value:<struct_value:<fields:<key:"options" value:<struct_value:<fields:<key:"hooks" value:<string_value:"{}" > > > > > > > > fields:<key:"beam:option:job_name:v1" value:<string_value:"go0job0701583430254581691927-jenkins-0305174415-7b2d8c7d" > > fields:<key:"beam:option:options_id:v1" value:<number_value:7 > > fields:<key:"beam:option:output_executable_path:v1" value:<null_value:NULL_VALUE > > fields:<key:"beam:option:runner:v1" value:<null_value:NULL_VALUE > > > retrieval_token:"/tmp/beam-artifact-staging/go-job-7-1583430254581691927_6d9e2910-cd74-4224-a9a3-02881605472b/MANIFEST" logging_endpoint:<url:"localhost:40581" > artifact_endpoint:<url:"localhost:45825" > control_endpoint:<url:"localhost:41929" >
2020/03/05 17:45:06 Initializing Go harness: /opt/apache/beam/boot --id=18-1 --provision_endpoint=localhost:37275
Worker exited successfully!
Failed to send message: EOF
severity:WARN timestamp:<seconds:1583430306 nanos:882687544 > message:"forcing DataChannel[localhost:43807] reconnection on port {localhost:43807} due to rpc error: code = Canceled desc = Multiplexer hanging up" instruction_id:"2" log_location:"<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:119" Remote logging failed: EOF. Retrying in 5 sec ...
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-173825"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
java.io.IOException: Received exit code 1 for command 'docker rm b08bbf315dfb52c13bcf361811658a029f68887f29a3518b52dc8cb0f5f3e725'. stderr: Error: No such container: b08bbf315dfb52c13bcf361811658a029f68887f29a3518b52dc8cb0f5f3e725
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:234)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:168)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.removeContainer(DockerCommand.java:163)
at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:95)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:494)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$1600(DefaultJobBundleFactory.java:432)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:169)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:259)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:184)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:173)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:132)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:44)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:291)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:43)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:508)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:369)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530)
at java.lang.Thread.run(Thread.java:748)
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28).
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) switched from CREATED to SCHEDULED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) [FINISHED]
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) a824d5efbaf6eaab4e4f1899062d3f28.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink (DiscardingOutput) (1/1) (attempt #0) to cc812ea2-8675-410b-add3-69b5131d3ca6 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink (DiscardingOutput) (1/1).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) switched from CREATED to DEPLOYING.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a824d5efbaf6eaab4e4f1899062d3f28) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) [DEPLOYING]
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) switched from DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) [FINISHED]
[flink-akka.actor.default-dispatcher-16] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) a8565eac4eeff195a4e5b4d0afe09af2.
[flink-akka.actor.default-dispatcher-16] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (a8565eac4eeff195a4e5b4d0afe09af2) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-16] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job go0job0701583430254581691927-jenkins-0305174415-7b2d8c7d (d79f12343ea91af0c9f50cc4a4be24b3) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job d79f12343ea91af0c9f50cc4a4be24b3 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job go0job0701583430254581691927-jenkins-0305174415-7b2d8c7d(d79f12343ea91af0c9f50cc4a4be24b3).
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647, directMemoryInMB=2147483647, nativeMemoryInMB=2147483647, networkMemoryInMB=2147483647, managedMemoryInMB=16273}, allocationId: 5b7481a10e2ff482bf26ca09740814d2, jobId: d79f12343ea91af0c9f50cc4a4be24b3).
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 01ef6c354bb6d9a7c67bbaa3c87bfa39: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job d79f12343ea91af0c9f50cc4a4be24b3 from job leader monitoring.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job d79f12343ea91af0c9f50cc4a4be24b3.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-16] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 9f5162f733f2795f0fd4b526b32047d5@akka://flink/user/jobmanager_13 for job d79f12343ea91af0c9f50cc4a4be24b3 from the resource manager.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job d79f12343ea91af0c9f50cc4a4be24b3.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Cannot reconnect to job d79f12343ea91af0c9f50cc4a4be24b3 because it is not registered.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_12.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close ResourceManager connection 01ef6c354bb6d9a7c67bbaa3c87bfa39.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-14] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing TaskExecutor connection cc812ea2-8675-410b-add3-69b5131d3ca6 because: The TaskExecutor is shutting down.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-io-cc6e3f75-6246-4464-a1f9-040325d2032a
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-86231f00-e1a5-4835-bc6c-ba8c99113225
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the kvState service and its components.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.filecache.FileCache - removed file cache directory /tmp/flink-dist-cache-2a3ac1d3-9c51-4967-abb6-4971dbfaabcb
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_12.
[ForkJoinPool.commonPool-worker-13] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-13] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-14] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-13] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:35313
[flink-akka.actor.default-dispatcher-10] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 53438 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers : MetricQueryResults(Counters(n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n5}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n3}: 1, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:1}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n4}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n2}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n6}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n1}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:0}: 3, n9/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n9}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:2}: 3)Distributions(n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n2}: DistributionResult{sum=4, count=2, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=4, count=2, min=2, max=2}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=2, count=1, min=2, max=2}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n1}: DistributionResult{sum=1, count=1, min=1, max=1}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:0}: DistributionResult{sum=8, count=2, min=4, max=4}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n5}: DistributionResult{sum=1, count=1, min=1, max=1}, n9/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n9}: DistributionResult{sum=20, count=1, min=20, max=20}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:2}: DistributionResult{sum=12, count=3, min=4, max=4}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n4}: DistributionResult{sum=4, count=2, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n3}: DistributionResult{sum=1, count=1, min=1, max=1}))
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/go-job-7-1583430254581691927_6d9e2910-cd74-4224-a9a3-02881605472b/MANIFEST has 1 artifact locations
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/go-job-7-1583430254581691927_6d9e2910-cd74-4224-a9a3-02881605472b/
2020/03/05 17:45:10 Job state: DONE
2020/03/05 17:45:10 Test flatten:flatten completed
2020/03/05 17:45:10 Result: 1 tests failed
if [[ ! -z "$JOB_PORT" ]]; then
# Shut down the job server
kill %1 || echo "Failed to shut down job server"
fi
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Error response from daemon: conflict: unable to remove repository reference "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-173825" (must force) - container 3b5eb4d8d947 is using its referenced image 8117e73f47ab
Failed to remove container
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7215ccc3d325d3248d1d85cc6ecbab07b3132aa022ed62e3bbb0fcdc8b58a10a
Associated tags:
- 20200305-173825
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-173825
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-173825].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:7215ccc3d325d3248d1d85cc6ecbab07b3132aa022ed62e3bbb0fcdc8b58a10a].
# Clean up tempdir
rm -rf $TMPDIR
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 59
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 6s
67 actionable tasks: 49 executed, 18 from cache
Publishing build scan...
https://gradle.com/s/mmo446nxtmpjy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Go_VR_Flink #2668
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/2668/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #2667
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/2667/display/redirect?page=changes>
Changes:
[chuck.yang] Use Avro format for file loads to BigQuery
------------------------------------------
[...truncated 816.11 KB...]
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (e808addb0e7041a76387f8a99a269bdd).
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (e808addb0e7041a76387f8a99a269bdd) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) e808addb0e7041a76387f8a99a269bdd.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (e808addb0e7041a76387f8a99a269bdd) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupReduce (GroupReduce at CoGBK) (1/1) (attempt #0) to c79e4450-6a8a-4020-b97e-539b4868f984 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupReduce (GroupReduce at CoGBK) (1/1).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) switched from CREATED to DEPLOYING.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) [DEPLOYING]
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) switched from DEPLOYING to RUNNING.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (1df1c6076ec62defe3031f05865efb70) switched from RUNNING to FINISHED.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (1df1c6076ec62defe3031f05865efb70).
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (1df1c6076ec62defe3031f05865efb70) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) 1df1c6076ec62defe3031f05865efb70.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (1df1c6076ec62defe3031f05865efb70) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (attempt #0) to c79e4450-6a8a-4020-b97e-539b4868f984 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1).
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) switched from CREATED to DEPLOYING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) [DEPLOYING]
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) switched from DEPLOYING to RUNNING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.flink.metrics.MetricGroup - The operator name MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) exceeded the 80 characters length limit and was truncated.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) switched from DEPLOYING to RUNNING.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) switched from RUNNING to FINISHED.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at CoGBK) 0c5e5e6861a0eb244d24f2fa06988444.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (0c5e5e6861a0eb244d24f2fa06988444) switched from RUNNING to FINISHED.
[grpc-default-executor-3] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583457120063368055_312fd317-8fca-4ca4-84eb-e21dff290375/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583457120063368055_312fd317-8fca-4ca4-84eb-e21dff290375/MANIFEST -> 1 artifacts
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 18-1
[grpc-default-executor-3] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:44743 ...
[grpc-default-executor-3] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:34303 ...
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:42171 ...
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:246 - DataSource: 1 elements in 2780589 ns
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing environment urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200306-010654"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment - Closing Docker container e2ddbc5b265ea38a16bae51303048cef672b47bfed37b83ea25405568e8961dc. Logs:
2020/03/06 01:12:09 Provision info:
pipeline_options:<fields:<key:"beam:option:app_name:v1" value:<string_value:"go-job-7-1583457120063368055" > > fields:<key:"beam:option:experiments:v1" value:<list_value:<values:<string_value:"beam_fn_api" > > > > fields:<key:"beam:option:flink_master:v1" value:<string_value:"[local]" > > fields:<key:"beam:option:go_options:v1" value:<struct_value:<fields:<key:"options" value:<struct_value:<fields:<key:"hooks" value:<string_value:"{}" > > > > > > > > fields:<key:"beam:option:job_name:v1" value:<string_value:"go0job0701583457120063368055-jenkins-0306011200-d6aeaff2" > > fields:<key:"beam:option:options_id:v1" value:<number_value:7 > > fields:<key:"beam:option:output_executable_path:v1" value:<null_value:NULL_VALUE > > fields:<key:"beam:option:runner:v1" value:<null_value:NULL_VALUE > > > retrieval_token:"/tmp/beam-artifact-staging/go-job-7-1583457120063368055_312fd317-8fca-4ca4-84eb-e21dff290375/MANIFEST" logging_endpoint:<url:"localhost:34303" > artifact_endpoint:<url:"localhost:44503" > control_endpoint:<url:"localhost:44743" >
2020/03/06 01:12:09 Initializing Go harness: /opt/apache/beam/boot --id=18-1 --provision_endpoint=localhost:34237
Worker exited successfully!
Failed to send message: EOF
severity:WARN timestamp:<seconds:1583457129 nanos:511933793 > message:"forcing DataChannel[localhost:42171] reconnection on port {localhost:42171} due to rpc error: code = Canceled desc = Multiplexer hanging up" instruction_id:"2" log_location:"<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:119" Remote logging failed: EOF. Retrying in 5 sec ...
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200306-010654"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
java.io.IOException: Received exit code 1 for command 'docker rm e2ddbc5b265ea38a16bae51303048cef672b47bfed37b83ea25405568e8961dc'. stderr: Error: No such container: e2ddbc5b265ea38a16bae51303048cef672b47bfed37b83ea25405568e8961dc
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:234)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:168)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.removeContainer(DockerCommand.java:163)
at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:95)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:494)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$1600(DefaultJobBundleFactory.java:432)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:169)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:259)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:184)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:173)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:132)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:44)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:291)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:43)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:508)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:369)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530)
at java.lang.Thread.run(Thread.java:748)
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) switched from CREATED to SCHEDULED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) 1165a2d23f96377a7cb2907f81077326.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink (DiscardingOutput) (1/1) (attempt #0) to c79e4450-6a8a-4020-b97e-539b4868f984 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (1165a2d23f96377a7cb2907f81077326) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink (DiscardingOutput) (1/1).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) [DEPLOYING]
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) switched from DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) f6a64230b2a2eb08a09db45ae70a8bcd.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (f6a64230b2a2eb08a09db45ae70a8bcd) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job go0job0701583457120063368055-jenkins-0306011200-d6aeaff2 (39c6ce33bff01d90bfdd34ca9e83549c) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 39c6ce33bff01d90bfdd34ca9e83549c reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job go0job0701583457120063368055-jenkins-0306011200-d6aeaff2(39c6ce33bff01d90bfdd34ca9e83549c).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647, directMemoryInMB=2147483647, nativeMemoryInMB=2147483647, networkMemoryInMB=2147483647, managedMemoryInMB=16272}, allocationId: 1fcd869e0b98650f790dfe6a4df2c2bd, jobId: 39c6ce33bff01d90bfdd34ca9e83549c).
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 245fe0844b2f17925cadbdb41eb1c4ec: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 39c6ce33bff01d90bfdd34ca9e83549c from job leader monitoring.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 39c6ce33bff01d90bfdd34ca9e83549c.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 971051a1eb0deaf5788f3beb36a9420d@akka://flink/user/jobmanager_13 for job 39c6ce33bff01d90bfdd34ca9e83549c from the resource manager.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 39c6ce33bff01d90bfdd34ca9e83549c.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Cannot reconnect to job 39c6ce33bff01d90bfdd34ca9e83549c because it is not registered.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_12.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close ResourceManager connection 245fe0844b2f17925cadbdb41eb1c4ec.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing TaskExecutor connection c79e4450-6a8a-4020-b97e-539b4868f984 because: The TaskExecutor is shutting down.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-io-0495d78a-44e5-43d0-a8f7-85f125f84460
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-245260c2-cf48-4650-ba33-62cdd0b7025e
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the kvState service and its components.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.filecache.FileCache - removed file cache directory /tmp/flink-dist-cache-d24d7169-91fa-48a7-ae06-71f09a7a08c9
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_12.
[ForkJoinPool.commonPool-worker-13] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-13] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:39187
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 7874 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers : MetricQueryResults(Counters(n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:2}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n5}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n3}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n4}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n2}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:1}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n6}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n1}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:0}: 3, n9/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n9}: 1)Distributions(n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=4, count=2, min=2, max=2}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n6}: DistributionResult{sum=4, count=2, min=2, max=2}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:2}: DistributionResult{sum=12, count=3, min=4, max=4}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n1}: DistributionResult{sum=1, count=1, min=1, max=1}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:0}: DistributionResult{sum=8, count=2, min=4, max=4}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n5}: DistributionResult{sum=1, count=1, min=1, max=1}, n9/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n9}: DistributionResult{sum=20, count=1, min=20, max=20}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n4}: DistributionResult{sum=4, count=2, min=2, max=2}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=2, count=1, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n3}: DistributionResult{sum=1, count=1, min=1, max=1}))
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/go-job-7-1583457120063368055_312fd317-8fca-4ca4-84eb-e21dff290375/MANIFEST has 1 artifact locations
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/go-job-7-1583457120063368055_312fd317-8fca-4ca4-84eb-e21dff290375/
2020/03/06 01:12:10 Job state: DONE
2020/03/06 01:12:10 Test flatten:flatten completed
2020/03/06 01:12:10 Result: 1 tests failed
if [[ ! -z "$JOB_PORT" ]]; then
# Shut down the job server
kill %1 || echo "Failed to shut down job server"
fi
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Error response from daemon: conflict: unable to remove repository reference "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200306-010654" (must force) - container 4822a6faf2d8 is using its referenced image a038259f03ae
Failed to remove container
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f8818c320d3d086e90973edba97c969fb26eba078f32cdaa62af68c1b7f0a20b
Associated tags:
- 20200306-010654
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200306-010654
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200306-010654].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:f8818c320d3d086e90973edba97c969fb26eba078f32cdaa62af68c1b7f0a20b].
# Clean up tempdir
rm -rf $TMPDIR
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 59
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 5s
67 actionable tasks: 49 executed, 18 from cache
Publishing build scan...
https://gradle.com/s/mr5iyytqxi7jq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #2666
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/2666/display/redirect>
Changes:
------------------------------------------
[...truncated 815.13 KB...]
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (959b0810cfb5094ff15910dddee01316).
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (959b0810cfb5094ff15910dddee01316) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) 959b0810cfb5094ff15910dddee01316.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (959b0810cfb5094ff15910dddee01316) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupReduce (GroupReduce at CoGBK) (1/1) (attempt #0) to dd5298ed-15ba-44e7-bae6-9d01868e15e3 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupReduce (GroupReduce at CoGBK) (1/1).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) switched from CREATED to DEPLOYING.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) [DEPLOYING]
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) switched from DEPLOYING to RUNNING.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (01add40ff09e92313e66da4a0a163fa1) switched from RUNNING to FINISHED.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (01add40ff09e92313e66da4a0a163fa1).
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (01add40ff09e92313e66da4a0a163fa1) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) 01add40ff09e92313e66da4a0a163fa1.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (01add40ff09e92313e66da4a0a163fa1) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (attempt #0) to dd5298ed-15ba-44e7-bae6-9d01868e15e3 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1).
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) switched from CREATED to DEPLOYING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) [DEPLOYING]
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) switched from DEPLOYING to RUNNING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.flink.metrics.MetricGroup - The operator name MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) exceeded the 80 characters length limit and was truncated.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) switched from RUNNING to FINISHED.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at CoGBK) de7d2be0b71ace632cba2c8170b7c3f5.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (de7d2be0b71ace632cba2c8170b7c3f5) switched from RUNNING to FINISHED.
[grpc-default-executor-3] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583453298653138460_872b917b-a022-441e-ade6-225e21e0ba8d/MANIFEST
[grpc-default-executor-3] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583453298653138460_872b917b-a022-441e-ade6-225e21e0ba8d/MANIFEST -> 1 artifacts
[grpc-default-executor-3] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 18-1
[grpc-default-executor-3] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:38179 ...
[grpc-default-executor-3] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:43863 ...
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:33391 ...
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:246 - DataSource: 1 elements in 3359461 ns
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing environment urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200306-000251"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment - Closing Docker container a747d5d4b94cb153e5bed872bcb28e715ddae5afe2beca0531af64a10fdaebd6. Logs:
2020/03/06 00:08:28 Provision info:
pipeline_options:<fields:<key:"beam:option:app_name:v1" value:<string_value:"go-job-7-1583453298653138460" > > fields:<key:"beam:option:experiments:v1" value:<list_value:<values:<string_value:"beam_fn_api" > > > > fields:<key:"beam:option:flink_master:v1" value:<string_value:"[local]" > > fields:<key:"beam:option:go_options:v1" value:<struct_value:<fields:<key:"options" value:<struct_value:<fields:<key:"hooks" value:<string_value:"{}" > > > > > > > > fields:<key:"beam:option:job_name:v1" value:<string_value:"go0job0701583453298653138460-jenkins-0306000819-38717644" > > fields:<key:"beam:option:options_id:v1" value:<number_value:7 > > fields:<key:"beam:option:output_executable_path:v1" value:<null_value:NULL_VALUE > > fields:<key:"beam:option:runner:v1" value:<null_value:NULL_VALUE > > > retrieval_token:"/tmp/beam-artifact-staging/go-job-7-1583453298653138460_872b917b-a022-441e-ade6-225e21e0ba8d/MANIFEST" logging_endpoint:<url:"localhost:43863" > artifact_endpoint:<url:"localhost:46841" > control_endpoint:<url:"localhost:38179" >
2020/03/06 00:08:28 Initializing Go harness: /opt/apache/beam/boot --id=18-1 --provision_endpoint=localhost:40429
Worker exited successfully!
Failed to send message: EOF
severity:WARN timestamp:<seconds:1583453309 nanos:12607547 > message:"forcing DataChannel[localhost:33391] reconnection on port {localhost:33391} due to rpc error: code = Canceled desc = Multiplexer hanging up" instruction_id:"2" log_location:"<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:119" Remote logging failed: EOF. Retrying in 5 sec ...
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200306-000251"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
java.io.IOException: Received exit code 1 for command 'docker rm a747d5d4b94cb153e5bed872bcb28e715ddae5afe2beca0531af64a10fdaebd6'. stderr: Error: No such container: a747d5d4b94cb153e5bed872bcb28e715ddae5afe2beca0531af64a10fdaebd6
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:234)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:168)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.removeContainer(DockerCommand.java:163)
at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:95)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:494)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$1600(DefaultJobBundleFactory.java:432)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:169)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:259)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:184)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:173)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:132)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:44)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:291)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:43)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:508)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:369)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530)
at java.lang.Thread.run(Thread.java:748)
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) switched from CREATED to SCHEDULED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) aeb20974a7334318ecec54344d77796c.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink (DiscardingOutput) (1/1) (attempt #0) to dd5298ed-15ba-44e7-bae6-9d01868e15e3 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink (DiscardingOutput) (1/1).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (aeb20974a7334318ecec54344d77796c) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) [DEPLOYING]
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) switched from DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) 8c44080c03bbc344b7d6a8765f342112.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (8c44080c03bbc344b7d6a8765f342112) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job go0job0701583453298653138460-jenkins-0306000819-38717644 (4d228daf5c1097cc4fec13e189d3063b) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 4d228daf5c1097cc4fec13e189d3063b reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job go0job0701583453298653138460-jenkins-0306000819-38717644(4d228daf5c1097cc4fec13e189d3063b).
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection de50004289720d7771c76894b1c7f85c: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager b8b9aadabd379584d184e3f954e545ca@akka://flink/user/jobmanager_13 for job 4d228daf5c1097cc4fec13e189d3063b from the resource manager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647, directMemoryInMB=2147483647, nativeMemoryInMB=2147483647, networkMemoryInMB=2147483647, managedMemoryInMB=16274}, allocationId: 05d722d4736cb083b18e9d08c98f1759, jobId: 4d228daf5c1097cc4fec13e189d3063b).
[flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 4d228daf5c1097cc4fec13e189d3063b from job leader monitoring.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 4d228daf5c1097cc4fec13e189d3063b.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 4d228daf5c1097cc4fec13e189d3063b.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Cannot reconnect to job 4d228daf5c1097cc4fec13e189d3063b because it is not registered.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_12.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close ResourceManager connection de50004289720d7771c76894b1c7f85c.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing TaskExecutor connection dd5298ed-15ba-44e7-bae6-9d01868e15e3 because: The TaskExecutor is shutting down.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-io-803bad74-a866-47aa-9a5b-ecae1419778e
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-ad30d139-2390-431b-9563-315c175ea32f
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the kvState service and its components.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.filecache.FileCache - removed file cache directory /tmp/flink-dist-cache-e8d1a0fb-b4ab-4d8f-9e82-4678d5a79993
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_12.
[ForkJoinPool.commonPool-worker-13] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-13] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:40879
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 9609 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers : MetricQueryResults(Counters(n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:0}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n5}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n3}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n4}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n2}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:1}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n6}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n1}: 1, n9/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n9}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:2}: 3)Distributions(n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n2}: DistributionResult{sum=4, count=2, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=2, count=1, min=2, max=2}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n6}: DistributionResult{sum=4, count=2, min=2, max=2}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:0}: DistributionResult{sum=8, count=2, min=4, max=4}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n1}: DistributionResult{sum=1, count=1, min=1, max=1}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:2}: DistributionResult{sum=12, count=3, min=4, max=4}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n5}: DistributionResult{sum=1, count=1, min=1, max=1}, n9/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n9}: DistributionResult{sum=20, count=1, min=20, max=20}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=4, count=2, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n3}: DistributionResult{sum=1, count=1, min=1, max=1}))
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/go-job-7-1583453298653138460_872b917b-a022-441e-ade6-225e21e0ba8d/MANIFEST has 1 artifact locations
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/go-job-7-1583453298653138460_872b917b-a022-441e-ade6-225e21e0ba8d/
2020/03/06 00:08:30 Job state: DONE
2020/03/06 00:08:30 Test flatten:flatten completed
2020/03/06 00:08:30 Result: 1 tests failed
if [[ ! -z "$JOB_PORT" ]]; then
# Shut down the job server
kill %1 || echo "Failed to shut down job server"
fi
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Error response from daemon: conflict: unable to remove repository reference "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200306-000251" (must force) - container a5e07befd504 is using its referenced image 911155a24695
Failed to remove container
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:3bd2cfd7c0117ad0e42f221c5d91f1a913d1aa32a124ad927c1e367a95d7af0c
Associated tags:
- 20200306-000251
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200306-000251
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200306-000251].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:3bd2cfd7c0117ad0e42f221c5d91f1a913d1aa32a124ad927c1e367a95d7af0c].
# Clean up tempdir
rm -rf $TMPDIR
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 59
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 11s
67 actionable tasks: 49 executed, 18 from cache
Publishing build scan...
https://gradle.com/s/p6qmnpi4qhtpy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #2665
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/2665/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-9450] Update www.apache.org/dist/ links to downloads.apache.org
[iemejia] [BEAM-9450] Convert links available via https to use https
------------------------------------------
[...truncated 815.26 KB...]
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (e7cbaca52475f6a075b2a61cf5bd7fcd) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) e7cbaca52475f6a075b2a61cf5bd7fcd.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (e7cbaca52475f6a075b2a61cf5bd7fcd) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupReduce (GroupReduce at CoGBK) (1/1) (attempt #0) to ea66f5d9-eabd-4ead-8647-98ac57c1833b @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupReduce (GroupReduce at CoGBK) (1/1).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) switched from CREATED to DEPLOYING.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) [DEPLOYING]
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) switched from DEPLOYING to RUNNING.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (99119afea3ff64a4834b0113a193bfe8) switched from RUNNING to FINISHED.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (99119afea3ff64a4834b0113a193bfe8).
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (99119afea3ff64a4834b0113a193bfe8) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) 99119afea3ff64a4834b0113a193bfe8.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (99119afea3ff64a4834b0113a193bfe8) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (attempt #0) to ea66f5d9-eabd-4ead-8647-98ac57c1833b @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1).
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) switched from CREATED to DEPLOYING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) [DEPLOYING]
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) switched from DEPLOYING to RUNNING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.flink.metrics.MetricGroup - The operator name MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) exceeded the 80 characters length limit and was truncated.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) switched from RUNNING to FINISHED.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at CoGBK) 5deabdd3a6cc7ee9f1616ea455a1c4d3.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (5deabdd3a6cc7ee9f1616ea455a1c4d3) switched from RUNNING to FINISHED.
[grpc-default-executor-5] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583445148516325106_7ac4fc6e-177b-44a9-8dcb-6369e2e6c226/MANIFEST
[grpc-default-executor-5] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583445148516325106_7ac4fc6e-177b-44a9-8dcb-6369e2e6c226/MANIFEST -> 1 artifacts
[grpc-default-executor-5] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-6] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 18-1
[grpc-default-executor-5] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:35383 ...
[grpc-default-executor-5] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:40201 ...
[grpc-default-executor-6] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:42967 ...
[grpc-default-executor-6] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-6] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:246 - DataSource: 1 elements in 2943746 ns
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing environment urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-214710"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment - Closing Docker container 4c5cb810c6c75610647fd00312c9a3287c8a0a0061a9424cfafda2ce1a1ce654. Logs:
2020/03/05 21:52:37 Provision info:
pipeline_options:<fields:<key:"beam:option:app_name:v1" value:<string_value:"go-job-7-1583445148516325106" > > fields:<key:"beam:option:experiments:v1" value:<list_value:<values:<string_value:"beam_fn_api" > > > > fields:<key:"beam:option:flink_master:v1" value:<string_value:"[local]" > > fields:<key:"beam:option:go_options:v1" value:<struct_value:<fields:<key:"options" value:<struct_value:<fields:<key:"hooks" value:<string_value:"{}" > > > > > > > > fields:<key:"beam:option:job_name:v1" value:<string_value:"go0job0701583445148516325106-jenkins-0305215228-401364b7" > > fields:<key:"beam:option:options_id:v1" value:<number_value:7 > > fields:<key:"beam:option:output_executable_path:v1" value:<null_value:NULL_VALUE > > fields:<key:"beam:option:runner:v1" value:<null_value:NULL_VALUE > > > retrieval_token:"/tmp/beam-artifact-staging/go-job-7-1583445148516325106_7ac4fc6e-177b-44a9-8dcb-6369e2e6c226/MANIFEST" logging_endpoint:<url:"localhost:40201" > artifact_endpoint:<url:"localhost:38477" > control_endpoint:<url:"localhost:35383" >
2020/03/05 21:52:37 Initializing Go harness: /opt/apache/beam/boot --id=18-1 --provision_endpoint=localhost:44955
Worker exited successfully!
Failed to send message: rpc error: code = Unavailable desc = transport is closing
severity:WARN timestamp:<seconds:1583445157 nanos:506749435 > message:"forcing DataChannel[localhost:42967] reconnection on port {localhost:42967} due to rpc error: code = Canceled desc = Multiplexer hanging up" instruction_id:"2" log_location:"<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:119" Remote logging failed: rpc error: code = Unavailable desc = transport is closing. Retrying in 5 sec ...
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-214710"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
java.io.IOException: Received exit code 1 for command 'docker rm 4c5cb810c6c75610647fd00312c9a3287c8a0a0061a9424cfafda2ce1a1ce654'. stderr: Error: No such container: 4c5cb810c6c75610647fd00312c9a3287c8a0a0061a9424cfafda2ce1a1ce654
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:234)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:168)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.removeContainer(DockerCommand.java:163)
at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:95)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:494)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$1600(DefaultJobBundleFactory.java:432)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:169)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:259)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:184)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:173)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:132)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:44)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:291)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:43)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:508)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:369)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530)
at java.lang.Thread.run(Thread.java:748)
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece).
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) switched from CREATED to SCHEDULED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) 76294368be81cd706dccc067f23e2ece.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink (DiscardingOutput) (1/1) (attempt #0) to ea66f5d9-eabd-4ead-8647-98ac57c1833b @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink (DiscardingOutput) (1/1).
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (76294368be81cd706dccc067f23e2ece) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) [DEPLOYING]
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) switched from DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) 5898e1fb71daf77055990e2a9d087c7b.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (5898e1fb71daf77055990e2a9d087c7b) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job go0job0701583445148516325106-jenkins-0305215228-401364b7 (50dbe3bd26f41ca9832227bba5e44f7b) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 50dbe3bd26f41ca9832227bba5e44f7b reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job go0job0701583445148516325106-jenkins-0305215228-401364b7(50dbe3bd26f41ca9832227bba5e44f7b).
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 6cae4ab2bd691e76c33616aef50eaf5d: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager bbdec7314c3cf44da0b9ffc9dfdb4584@akka://flink/user/jobmanager_13 for job 50dbe3bd26f41ca9832227bba5e44f7b from the resource manager.
[mini-cluster-io-thread-14] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job 50dbe3bd26f41ca9832227bba5e44f7b with leader id bbdec7314c3cf44da0b9ffc9dfdb4584 lost leadership.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647, directMemoryInMB=2147483647, nativeMemoryInMB=2147483647, networkMemoryInMB=2147483647, managedMemoryInMB=16273}, allocationId: 97d4fcb9cbf679918f2b5fc09eabca78, jobId: 50dbe3bd26f41ca9832227bba5e44f7b).
[flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 50dbe3bd26f41ca9832227bba5e44f7b from job leader monitoring.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 50dbe3bd26f41ca9832227bba5e44f7b.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 50dbe3bd26f41ca9832227bba5e44f7b.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Cannot reconnect to job 50dbe3bd26f41ca9832227bba5e44f7b because it is not registered.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_12.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close ResourceManager connection 6cae4ab2bd691e76c33616aef50eaf5d.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing TaskExecutor connection ea66f5d9-eabd-4ead-8647-98ac57c1833b because: The TaskExecutor is shutting down.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-io-740f5090-4025-48e2-a6ac-01c52e2ec5e5
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-8a56a669-8d34-4a34-ba3e-97d93a000e35
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the kvState service and its components.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.filecache.FileCache - removed file cache directory /tmp/flink-dist-cache-0fefc26f-ac90-46b6-bd20-d497a65a3738
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_12.
[ForkJoinPool.commonPool-worker-4] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-4] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:32785
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 8050 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers : MetricQueryResults(Counters(n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:2}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n5}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n3}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n4}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n2}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:1}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n6}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n1}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:0}: 3, n9/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n9}: 1)Distributions(n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n2}: DistributionResult{sum=4, count=2, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=4, count=2, min=2, max=2}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=2, count=1, min=2, max=2}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n1}: DistributionResult{sum=1, count=1, min=1, max=1}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:0}: DistributionResult{sum=8, count=2, min=4, max=4}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n5}: DistributionResult{sum=1, count=1, min=1, max=1}, n9/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n9}: DistributionResult{sum=20, count=1, min=20, max=20}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n4}: DistributionResult{sum=4, count=2, min=2, max=2}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:1}: DistributionResult{sum=12, count=3, min=4, max=4}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n3}: DistributionResult{sum=1, count=1, min=1, max=1}))
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/go-job-7-1583445148516325106_7ac4fc6e-177b-44a9-8dcb-6369e2e6c226/MANIFEST has 1 artifact locations
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/go-job-7-1583445148516325106_7ac4fc6e-177b-44a9-8dcb-6369e2e6c226/
2020/03/05 21:52:38 Job state: DONE
2020/03/05 21:52:38 Test flatten:flatten completed
2020/03/05 21:52:38 Result: 1 tests failed
if [[ ! -z "$JOB_PORT" ]]; then
# Shut down the job server
kill %1 || echo "Failed to shut down job server"
fi
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Error response from daemon: conflict: unable to remove repository reference "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-214710" (must force) - container 0a063ad30a37 is using its referenced image b3ffdfa52db9
Failed to remove container
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9b30dcd004458196a6329b804abce4379ad7ac1f2180a7a465faaf9d809db01a
Associated tags:
- 20200305-214710
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-214710
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-214710].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:9b30dcd004458196a6329b804abce4379ad7ac1f2180a7a465faaf9d809db01a].
# Clean up tempdir
rm -rf $TMPDIR
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 59
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 7s
67 actionable tasks: 49 executed, 18 from cache
Publishing build scan...
https://gradle.com/s/fmzkmq2r42ak6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #2664
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/2664/display/redirect?page=changes>
Changes:
[git] Remove optionality and add sensible defaults to PubsubIO builders.
------------------------------------------
[...truncated 814.06 KB...]
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (36f7c649c5a62a9592dcdd24ab42d5fd).
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (36f7c649c5a62a9592dcdd24ab42d5fd) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) 36f7c649c5a62a9592dcdd24ab42d5fd.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupReduce (GroupReduce at CoGBK) (1/1) (attempt #0) to b9aa5d5d-4e54-4525-871f-56e4a4703821 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupReduce (GroupReduce at CoGBK) (1/1).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (36f7c649c5a62a9592dcdd24ab42d5fd) switched from RUNNING to FINISHED.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) switched from CREATED to DEPLOYING.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) [DEPLOYING]
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) switched from DEPLOYING to RUNNING.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (f7561365ae76fa3149e9ceeca0180e86) switched from RUNNING to FINISHED.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (f7561365ae76fa3149e9ceeca0180e86).
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (f7561365ae76fa3149e9ceeca0180e86) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) f7561365ae76fa3149e9ceeca0180e86.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (f7561365ae76fa3149e9ceeca0180e86) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (attempt #0) to b9aa5d5d-4e54-4525-871f-56e4a4703821 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1).
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) switched from CREATED to DEPLOYING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) [DEPLOYING]
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) switched from DEPLOYING to RUNNING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.flink.metrics.MetricGroup - The operator name MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) exceeded the 80 characters length limit and was truncated.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) switched from RUNNING to FINISHED.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) [FINISHED]
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at CoGBK) 83aa8a231c1bc8068cea60ab0862de34.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (83aa8a231c1bc8068cea60ab0862de34) switched from RUNNING to FINISHED.
[grpc-default-executor-5] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583441936923625831_e051ac32-68e7-4506-af8a-98fe91df044d/MANIFEST
[grpc-default-executor-5] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583441936923625831_e051ac32-68e7-4506-af8a-98fe91df044d/MANIFEST -> 1 artifacts
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 18-1
[grpc-default-executor-5] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-5] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:44271 ...
[grpc-default-executor-5] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:43971 ...
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:34013 ...
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:246 - DataSource: 1 elements in 3145522 ns
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing environment urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-205339"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment - Closing Docker container 1d2575746880f623c6b07dc21421d47f761550a03216d68d8be6dee62df82ca5. Logs:
2020/03/05 20:59:05 Provision info:
pipeline_options:<fields:<key:"beam:option:app_name:v1" value:<string_value:"go-job-7-1583441936923625831" > > fields:<key:"beam:option:experiments:v1" value:<list_value:<values:<string_value:"beam_fn_api" > > > > fields:<key:"beam:option:flink_master:v1" value:<string_value:"[local]" > > fields:<key:"beam:option:go_options:v1" value:<struct_value:<fields:<key:"options" value:<struct_value:<fields:<key:"hooks" value:<string_value:"{}" > > > > > > > > fields:<key:"beam:option:job_name:v1" value:<string_value:"go0job0701583441936923625831-jenkins-0305205857-9f66694f" > > fields:<key:"beam:option:options_id:v1" value:<number_value:7 > > fields:<key:"beam:option:output_executable_path:v1" value:<null_value:NULL_VALUE > > fields:<key:"beam:option:runner:v1" value:<null_value:NULL_VALUE > > > retrieval_token:"/tmp/beam-artifact-staging/go-job-7-1583441936923625831_e051ac32-68e7-4506-af8a-98fe91df044d/MANIFEST" logging_endpoint:<url:"localhost:43971" > artifact_endpoint:<url:"localhost:46799" > control_endpoint:<url:"localhost:44271" >
2020/03/05 20:59:05 Initializing Go harness: /opt/apache/beam/boot --id=18-1 --provision_endpoint=localhost:41723
Worker exited successfully!
Failed to send message: rpc error: code = Unavailable desc = transport is closing
severity:WARN timestamp:<seconds:1583441946 nanos:176234127 > message:"forcing DataChannel[localhost:34013] reconnection on port {localhost:34013} due to rpc error: code = Canceled desc = Multiplexer hanging up" instruction_id:"2" log_location:"<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:119" Remote logging failed: rpc error: code = Unavailable desc = transport is closing. Retrying in 5 sec ...
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-205339"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
java.io.IOException: Received exit code 1 for command 'docker rm 1d2575746880f623c6b07dc21421d47f761550a03216d68d8be6dee62df82ca5'. stderr: Error: No such container: 1d2575746880f623c6b07dc21421d47f761550a03216d68d8be6dee62df82ca5
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:234)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:168)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.removeContainer(DockerCommand.java:163)
at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:95)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:494)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$1600(DefaultJobBundleFactory.java:432)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:169)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:259)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:184)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:173)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:132)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:44)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:291)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:43)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:508)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:369)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530)
at java.lang.Thread.run(Thread.java:748)
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2).
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) switched from CREATED to SCHEDULED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) [FINISHED]
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) 0161884c0972fb5c938f9e09e09fbcc2.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink (DiscardingOutput) (1/1) (attempt #0) to b9aa5d5d-4e54-4525-871f-56e4a4703821 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (0161884c0972fb5c938f9e09e09fbcc2) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink (DiscardingOutput) (1/1).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) [DEPLOYING]
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) switched from DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) 1366ca2e1b9948fecdf935d5e66c278a.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (1366ca2e1b9948fecdf935d5e66c278a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job go0job0701583441936923625831-jenkins-0305205857-9f66694f (2df28e4811fc5b6bd35afe128e309587) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 2df28e4811fc5b6bd35afe128e309587 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job go0job0701583441936923625831-jenkins-0305205857-9f66694f(2df28e4811fc5b6bd35afe128e309587).
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 24781fd6767db8fb3616359737ee34c9: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 900076656bdb38212b95807f7d904a36@akka://flink/user/jobmanager_13 for job 2df28e4811fc5b6bd35afe128e309587 from the resource manager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647, directMemoryInMB=2147483647, nativeMemoryInMB=2147483647, networkMemoryInMB=2147483647, managedMemoryInMB=16273}, allocationId: 1923f019370096ef8f4d9df5e6b55760, jobId: 2df28e4811fc5b6bd35afe128e309587).
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 2df28e4811fc5b6bd35afe128e309587 from job leader monitoring.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 2df28e4811fc5b6bd35afe128e309587.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 2df28e4811fc5b6bd35afe128e309587.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Cannot reconnect to job 2df28e4811fc5b6bd35afe128e309587 because it is not registered.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_12.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close ResourceManager connection 24781fd6767db8fb3616359737ee34c9.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing TaskExecutor connection b9aa5d5d-4e54-4525-871f-56e4a4703821 because: The TaskExecutor is shutting down.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-io-413e218d-57ed-4699-b763-67758762c159
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-8b1e20cf-74bc-44de-98d5-2c86a7c84c32
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the kvState service and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.filecache.FileCache - removed file cache directory /tmp/flink-dist-cache-ffa94fd8-82f1-4fd3-b842-b2b454d46138
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_12.
[ForkJoinPool.commonPool-worker-4] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-4] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:40517
[flink-akka.actor.default-dispatcher-8] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 8199 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers : MetricQueryResults(Counters(n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:0}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n5}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n3}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n4}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n2}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n6}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n1}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:1}: 3, n9/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n9}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:2}: 3)Distributions(n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n2}: DistributionResult{sum=4, count=2, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=4, count=2, min=2, max=2}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=2, count=1, min=2, max=2}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n1}: DistributionResult{sum=1, count=1, min=1, max=1}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:1}: DistributionResult{sum=8, count=2, min=4, max=4}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n5}: DistributionResult{sum=1, count=1, min=1, max=1}, n9/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n9}: DistributionResult{sum=20, count=1, min=20, max=20}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:2}: DistributionResult{sum=12, count=3, min=4, max=4}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n4}: DistributionResult{sum=4, count=2, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n3}: DistributionResult{sum=1, count=1, min=1, max=1}))
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/go-job-7-1583441936923625831_e051ac32-68e7-4506-af8a-98fe91df044d/MANIFEST has 1 artifact locations
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/go-job-7-1583441936923625831_e051ac32-68e7-4506-af8a-98fe91df044d/
2020/03/05 20:59:07 Job state: DONE
2020/03/05 20:59:07 Test flatten:flatten completed
2020/03/05 20:59:07 Result: 1 tests failed
if [[ ! -z "$JOB_PORT" ]]; then
# Shut down the job server
kill %1 || echo "Failed to shut down job server"
fi
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Error response from daemon: conflict: unable to remove repository reference "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-205339" (must force) - container 8c5404b263c8 is using its referenced image 66502089c971
Failed to remove container
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4e6ca8a9bfbd35548fa8833b23a09fe6f493e3756ae48f8720b66f6140bc4e1f
Associated tags:
- 20200305-205339
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-205339
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-205339].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:4e6ca8a9bfbd35548fa8833b23a09fe6f493e3756ae48f8720b66f6140bc4e1f].
# Clean up tempdir
rm -rf $TMPDIR
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 59
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 39s
67 actionable tasks: 50 executed, 17 from cache
Publishing build scan...
https://gradle.com/s/3bteh6j7a7ybm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #2663
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/2663/display/redirect?page=changes>
Changes:
[jkai] [Hotfix] fix rabbitmp spotless check
------------------------------------------
[...truncated 50.03 KB...]
date +%Y%m%d-%H%M%S
CONTAINER=us.gcr.io/$PROJECT/$USER/beam_go_sdk
echo "Using container $CONTAINER"
Using container us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk
./gradlew :sdks:go:container:docker -Pdocker-repository-root=us.gcr.io/$PROJECT/$USER -Pdocker-tag=$TAG
Starting a Gradle Daemon, 2 busy Daemons could not be reused, use --status for details
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validateTaskProperties UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Configure project :sdks:go:container
Found go 1.12 in /usr/bin/go, use it.
> Configure project :sdks:go
Found go 1.12 in /usr/bin/go, use it.
> Task :sdks:go:goPrepare
Use project GOPATH: <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/.gogradle/project_gopath>
> Task :sdks:go:container:copyLicenses
> Task :sdks:go:container:dockerClean UP-TO-DATE
> Task :sdks:go:container:goPrepare
Use project GOPATH: <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/container/.gogradle/project_gopath>
> Task :sdks:go:resolveBuildDependencies
Resolving cached cloud.google.com/go: commit='4f6c921ec566a33844f4e7879b31cd8575a6982d', urls=[https://code.googlesource.com/gocloud]
Resolving cached github.com/Shopify/sarama: commit='541689b9f4212043471eb537fa72da507025d3ea', urls=[https://github.com/Shopify/sarama.git, git@github.com:Shopify/sarama.git]
Resolving cached github.com/armon/consul-api: commit='eb2c6b5be1b66bab83016e0b05f01b8d5496ffbd', urls=[https://github.com/armon/consul-api.git, git@github.com:armon/consul-api.git]
Resolving github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving cached github.com/davecgh/go-spew: commit='87df7c60d5820d0f8ae11afede5aa52325c09717', urls=[https://github.com/davecgh/go-spew.git, git@github.com:davecgh/go-spew.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/eapache/go-resiliency: commit='ef9aaa7ea8bd2448429af1a77cf41b2b3b34bdd6', urls=[https://github.com/eapache/go-resiliency.git, git@github.com:eapache/go-resiliency.git]
Resolving cached github.com/eapache/go-xerial-snappy: commit='bb955e01b9346ac19dc29eb16586c90ded99a98c', urls=[https://github.com/eapache/go-xerial-snappy.git, git@github.com:eapache/go-xerial-snappy.git]
Resolving cached github.com/eapache/queue: commit='44cc805cf13205b55f69e14bcb69867d1ae92f98', urls=[https://github.com/eapache/queue.git, git@github.com:eapache/queue.git]
Resolving cached github.com/fsnotify/fsnotify: commit='c2828203cd70a50dcccfb2761f8b1f8ceef9a8e9', urls=[https://github.com/fsnotify/fsnotify.git, git@github.com:fsnotify/fsnotify.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/golang/glog: commit='23def4e6c14b4da8ac2ed8007337bc5eb5007998', urls=[https://github.com/golang/glog.git, git@github.com:golang/glog.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/golang/mock: commit='b3e60bcdc577185fce3cf625fc96b62857ce5574', urls=[https://github.com/golang/mock.git, git@github.com:golang/mock.git]
Resolving cached github.com/golang/protobuf: commit='ed6926b37a637426117ccab59282c3839528a700', urls=[https://github.com/golang/protobuf.git, git@github.com:golang/protobuf.git]
Resolving cached github.com/golang/snappy: commit='553a641470496b2327abcac10b36396bd98e45c9', urls=[https://github.com/golang/snappy.git, git@github.com:golang/snappy.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/google/go-cmp: commit='3af367b6b30c263d47e8895973edcca9a49cf029', urls=[https://github.com/google/go-cmp.git, git@github.com:google/go-cmp.git]
Resolving cached github.com/google/pprof: commit='a8f279b7952b27edbcb72e5a6c69ee9be4c8ad93', urls=[https://github.com/google/pprof.git, git@github.com:google/pprof.git]
Resolving cached github.com/googleapis/gax-go: commit='317e0006254c44a0ac427cc52a0e083ff0b9622f', urls=[https://github.com/googleapis/gax-go.git, git@github.com:googleapis/gax-go.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/hashicorp/hcl: commit='23c074d0eceb2b8a5bfdbb271ab780cde70f05a8', urls=[https://github.com/hashicorp/hcl.git, git@github.com:hashicorp/hcl.git]
Resolving cached github.com/ianlancetaylor/demangle: commit='4883227f66371e02c4948937d3e2be1664d9be38', urls=[https://github.com/ianlancetaylor/demangle.git, git@github.com:ianlancetaylor/demangle.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/kr/fs: commit='2788f0dbd16903de03cb8186e5c7d97b69ad387b', urls=[https://github.com/kr/fs.git, git@github.com:kr/fs.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/magiconair/properties: commit='49d762b9817ba1c2e9d0c69183c2b4a8b8f1d934', urls=[https://github.com/magiconair/properties.git, git@github.com:magiconair/properties.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/mitchellh/go-homedir: commit='b8bc1bf767474819792c23f32d8286a45736f1c6', urls=[https://github.com/mitchellh/go-homedir.git, git@github.com:mitchellh/go-homedir.git]
Resolving cached github.com/mitchellh/mapstructure: commit='a4e142e9c047c904fa2f1e144d9a84e6133024bc', urls=[https://github.com/mitchellh/mapstructure.git, git@github.com:mitchellh/mapstructure.git]
Resolving cached github.com/nightlyone/lockfile: commit='0ad87eef1443f64d3d8c50da647e2b1552851124', urls=[https://github.com/nightlyone/lockfile, git@github.com:nightlyone/lockfile.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/openzipkin/zipkin-go: commit='3741243b287094fda649c7f0fa74bd51f37dc122', urls=[https://github.com/openzipkin/zipkin-go.git, git@github.com:openzipkin/zipkin-go.git]
Resolving cached github.com/pelletier/go-toml: commit='acdc4509485b587f5e675510c4f2c63e90ff68a8', urls=[https://github.com/pelletier/go-toml.git, git@github.com:pelletier/go-toml.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/pierrec/lz4: commit='ed8d4cc3b461464e69798080a0092bd028910298', urls=[https://github.com/pierrec/lz4.git, git@github.com:pierrec/lz4.git]
Resolving cached github.com/pierrec/xxHash: commit='a0006b13c722f7f12368c00a3d3c2ae8a999a0c6', urls=[https://github.com/pierrec/xxHash.git, git@github.com:pierrec/xxHash.git]
Resolving cached github.com/pkg/errors: commit='30136e27e2ac8d167177e8a583aa4c3fea5be833', urls=[https://github.com/pkg/errors.git, git@github.com:pkg/errors.git]
Resolving cached github.com/pkg/sftp: commit='22e9c1ccc02fc1b9fa3264572e49109b68a86947', urls=[https://github.com/pkg/sftp.git, git@github.com:pkg/sftp.git]
Resolving cached github.com/prometheus/client_golang: commit='9bb6ab929dcbe1c8393cd9ef70387cb69811bd1c', urls=[https://github.com/prometheus/client_golang.git, git@github.com:prometheus/client_golang.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/prometheus/procfs: commit='cb4147076ac75738c9a7d279075a253c0cc5acbd', urls=[https://github.com/prometheus/procfs.git, git@github.com:prometheus/procfs.git]
Resolving cached github.com/rcrowley/go-metrics: commit='8732c616f52954686704c8645fe1a9d59e9df7c1', urls=[https://github.com/rcrowley/go-metrics.git, git@github.com:rcrowley/go-metrics.git]
Resolving github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving cached github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/spf13/afero: commit='bb8f1927f2a9d3ab41c9340aa034f6b803f4359c', urls=[https://github.com/spf13/afero.git, git@github.com:spf13/afero.git]
Resolving cached github.com/spf13/cast: commit='acbeb36b902d72a7a4c18e8f3241075e7ab763e4', urls=[https://github.com/spf13/cast.git, git@github.com:spf13/cast.git]
Resolving cached github.com/spf13/cobra: commit='93959269ad99e80983c9ba742a7e01203a4c0e4f', urls=[https://github.com/spf13/cobra.git, git@github.com:spf13/cobra.git]
Resolving cached github.com/spf13/jwalterweatherman: commit='7c0cea34c8ece3fbeb2b27ab9b59511d360fb394', urls=[https://github.com/spf13/jwalterweatherman.git, git@github.com:spf13/jwalterweatherman.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/spf13/viper: commit='aafc9e6bc7b7bb53ddaa75a5ef49a17d6e654be5', urls=[https://github.com/spf13/viper.git, git@github.com:spf13/viper.git]
Resolving cached github.com/stathat/go: commit='74669b9f388d9d788c97399a0824adbfee78400e', urls=[https://github.com/stathat/go.git, git@github.com:stathat/go.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/xordataexchange/crypt: commit='b2862e3d0a775f18c7cfe02273500ae307b61218', urls=[https://github.com/xordataexchange/crypt.git, git@github.com:xordataexchange/crypt.git]
Resolving cached go.opencensus.io: commit='aa2b39d1618ef56ba156f27cfcdae9042f68f0bc', urls=[https://github.com/census-instrumentation/opencensus-go]
Resolving cached golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto]
Resolving cached golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug]
Resolving cached golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net]
Resolving cached golang.org/x/oauth2: commit='a032972e28060ca4f5644acffae3dfc268cc09db', urls=[https://go.googlesource.com/oauth2]
Resolving cached golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync]
Resolving cached golang.org/x/sys: commit='37707fdb30a5b38865cfb95e5aab41707daec7fd', urls=[https://go.googlesource.com/sys]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached google.golang.org/api: commit='386d4e5f4f92f86e6aec85985761bba4b938a2d5', urls=[https://code.googlesource.com/google-api-go-client]
Resolving cached google.golang.org/genproto: commit='2b5a72b8730b0b16380010cfe5286c42108d88e7', urls=[https://github.com/google/go-genproto]
Resolving cached google.golang.org/grpc: commit='7646b5360d049a7ca31e9133315db43456f39e2e', urls=[https://github.com/grpc/grpc-go]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
Resolving cached github.com/coreos/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/coreos/etcd.git, git@github.com:coreos/etcd.git]
> Task :sdks:go:installDependencies
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild
> Task :sdks:go:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go>
> Task :sdks:go:container:installDependencies
> Task :sdks:go:container:buildLinuxAmd64
> Task :sdks:go:container:goBuild
> Task :sdks:go:container:dockerPrepare FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:go:container:dockerPrepare'.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
> Could not copy file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/container/build/target/linux_amd64/boot'> to '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/container/build/docker/target/linux_amd64/boot'.>
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
13 actionable tasks: 12 executed, 1 up-to-date
A build scan cannot be produced as an error occurred spooling the build data.
Please report this problem via https://gradle.com/scans/help/plugin and include the following via copy/paste:
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
----------
Gradle version: 5.2.1
* Get more help at https://help.gradle.org
Plugin version: 2.3
BUILD FAILED in 33s
java.lang.IllegalStateException: java.io.IOException: No space left on device
at com.gradle.scan.a.e.b.flush(SourceFile:233)
at com.gradle.scan.a.e.b.close(SourceFile:244)
at com.gradle.scan.a.e.c.close(SourceFile:66)
at com.gradle.scan.plugin.internal.n.a(SourceFile:78)
at com.gradle.scan.plugin.internal.e.c.c.b(SourceFile:125)
at com.gradle.scan.plugin.internal.e.c.c.a(SourceFile:117)
at com.gradle.scan.plugin.internal.o.a$a.a(SourceFile:30)
at com.gradle.scan.plugin.internal.o.a$a.a(SourceFile:19)
at com.gradle.scan.plugin.internal.o.a.c(SourceFile:60)
Caused by: java.io.IOException: No space left on device
at com.gradle.scan.a.e.b.flush(SourceFile:231)
... 8 more
----------
FAILURE: Build failed with an exception.
* What went wrong:
Could not update <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/.gradle/5.2.1/fileChanges/last-build.bin>
> No space left on device
* Try:
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
* Get more help at https://help.gradle.org
BUILD FAILED in 33s
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 59
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 38s
67 actionable tasks: 51 executed, 16 from cache
Publishing build scan...
https://gradle.com/s/lhphkpo7osb6c
FAILURE: Build failed with an exception.
* What went wrong:
Could not update <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/.gradle/5.2.1/fileChanges/last-build.bin>
> No space left on device
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 39s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #2662
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/2662/display/redirect?page=changes>
Changes:
[amaliujia] [BEAM-9288] Not bundle conscrypt in gRPC vendor in META-INF/
[lcwik] [BEAM-9452] Update classgraph to latest version to resolve windows
------------------------------------------
[...truncated 816.64 KB...]
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (a5170c90f5ff82a71cc9630479fd5530).
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (a5170c90f5ff82a71cc9630479fd5530) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) a5170c90f5ff82a71cc9630479fd5530.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (a5170c90f5ff82a71cc9630479fd5530) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupReduce (GroupReduce at CoGBK) (1/1) (attempt #0) to 0e28cc4e-5882-498c-86c7-5c89b8182862 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupReduce (GroupReduce at CoGBK) (1/1).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) switched from CREATED to DEPLOYING.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) [DEPLOYING]
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) switched from DEPLOYING to RUNNING.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (e2b6036bfcf425211e893361d0c1b5e1) switched from RUNNING to FINISHED.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (e2b6036bfcf425211e893361d0c1b5e1).
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (e2b6036bfcf425211e893361d0c1b5e1) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) e2b6036bfcf425211e893361d0c1b5e1.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (e2b6036bfcf425211e893361d0c1b5e1) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (attempt #0) to 0e28cc4e-5882-498c-86c7-5c89b8182862 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1).
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) switched from CREATED to DEPLOYING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) [DEPLOYING]
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) switched from DEPLOYING to RUNNING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.flink.metrics.MetricGroup - The operator name MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) exceeded the 80 characters length limit and was truncated.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) switched from RUNNING to FINISHED.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at CoGBK) b34b578e9d671962e353ff981d0bcc70.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (b34b578e9d671962e353ff981d0bcc70) switched from RUNNING to FINISHED.
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583434459606605934_9df13e4a-cf72-457b-96f8-7b617ff87a2a/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583434459606605934_9df13e4a-cf72-457b-96f8-7b617ff87a2a/MANIFEST -> 1 artifacts
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-5] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 18-1
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:39825 ...
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:38009 ...
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:43527 ...
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:246 - DataSource: 1 elements in 2761315 ns
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing environment urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-184907"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment - Closing Docker container 7353c0b40ea6470221f6c4f034d4be2dfed5d442c51fe3195ee2ac0dacd1636d. Logs:
2020/03/05 18:54:28 Provision info:
pipeline_options:<fields:<key:"beam:option:app_name:v1" value:<string_value:"go-job-7-1583434459606605934" > > fields:<key:"beam:option:experiments:v1" value:<list_value:<values:<string_value:"beam_fn_api" > > > > fields:<key:"beam:option:flink_master:v1" value:<string_value:"[local]" > > fields:<key:"beam:option:go_options:v1" value:<struct_value:<fields:<key:"options" value:<struct_value:<fields:<key:"hooks" value:<string_value:"{}" > > > > > > > > fields:<key:"beam:option:job_name:v1" value:<string_value:"go0job0701583434459606605934-jenkins-0305185420-c861d0c3" > > fields:<key:"beam:option:options_id:v1" value:<number_value:7 > > fields:<key:"beam:option:output_executable_path:v1" value:<null_value:NULL_VALUE > > fields:<key:"beam:option:runner:v1" value:<null_value:NULL_VALUE > > > retrieval_token:"/tmp/beam-artifact-staging/go-job-7-1583434459606605934_9df13e4a-cf72-457b-96f8-7b617ff87a2a/MANIFEST" logging_endpoint:<url:"localhost:38009" > artifact_endpoint:<url:"localhost:37893" > control_endpoint:<url:"localhost:39825" >
2020/03/05 18:54:28 Initializing Go harness: /opt/apache/beam/boot --id=18-1 --provision_endpoint=localhost:43787
Worker exited successfully!
Failed to send message: rpc error: code = Unavailable desc = transport is closing
severity:WARN timestamp:<seconds:1583434468 nanos:828049310 > message:"forcing DataChannel[localhost:43527] reconnection on port {localhost:43527} due to rpc error: code = Canceled desc = Multiplexer hanging up" instruction_id:"2" log_location:"<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:119" Remote logging failed: rpc error: code = Unavailable desc = transport is closing. Retrying in 5 sec ...
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-184907"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
java.io.IOException: Received exit code 1 for command 'docker rm 7353c0b40ea6470221f6c4f034d4be2dfed5d442c51fe3195ee2ac0dacd1636d'. stderr: Error: No such container: 7353c0b40ea6470221f6c4f034d4be2dfed5d442c51fe3195ee2ac0dacd1636d
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:234)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:168)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.removeContainer(DockerCommand.java:163)
at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:95)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:494)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$1600(DefaultJobBundleFactory.java:432)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:169)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:259)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:184)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:173)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:132)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:44)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:291)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:43)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:508)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:369)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530)
at java.lang.Thread.run(Thread.java:748)
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) switched from CREATED to SCHEDULED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) a35711537ee2267ac95c9fd6c050d551.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink (DiscardingOutput) (1/1) (attempt #0) to 0e28cc4e-5882-498c-86c7-5c89b8182862 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a35711537ee2267ac95c9fd6c050d551) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink (DiscardingOutput) (1/1).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) [DEPLOYING]
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) switched from DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) 837ea67ccab62a71ee663f90366bdfd5.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (837ea67ccab62a71ee663f90366bdfd5) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job go0job0701583434459606605934-jenkins-0305185420-c861d0c3 (548680ab14856328d460f7aa38fcb773) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 548680ab14856328d460f7aa38fcb773 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job go0job0701583434459606605934-jenkins-0305185420-c861d0c3(548680ab14856328d460f7aa38fcb773).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 2a47667a43953e64615d5422bd3bd210: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647, directMemoryInMB=2147483647, nativeMemoryInMB=2147483647, networkMemoryInMB=2147483647, managedMemoryInMB=16273}, allocationId: 8e8c1fbf64170f1a7f09c3ff6fdff492, jobId: 548680ab14856328d460f7aa38fcb773).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 548680ab14856328d460f7aa38fcb773 from job leader monitoring.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 82985b587a9e273af8c3de37de214498@akka://flink/user/jobmanager_13 for job 548680ab14856328d460f7aa38fcb773 from the resource manager.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 548680ab14856328d460f7aa38fcb773.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 548680ab14856328d460f7aa38fcb773.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Cannot reconnect to job 548680ab14856328d460f7aa38fcb773 because it is not registered.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_12.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close ResourceManager connection 2a47667a43953e64615d5422bd3bd210.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing TaskExecutor connection 0e28cc4e-5882-498c-86c7-5c89b8182862 because: The TaskExecutor is shutting down.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-io-d836aecb-740e-4581-8eab-fa7a18cd4251
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-029ee7b0-bedd-4121-adc7-023ca149316d
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the kvState service and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.filecache.FileCache - removed file cache directory /tmp/flink-dist-cache-971b17b1-b86c-4b13-a80e-bce0d7bd5252
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_12.
[ForkJoinPool.commonPool-worker-4] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-4] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:41553
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 8183 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers : MetricQueryResults(Counters(n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:0}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n5}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n3}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n4}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n2}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n6}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n1}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:1}: 3, n9/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n9}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:2}: 3)Distributions(n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n2}: DistributionResult{sum=4, count=2, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=4, count=2, min=2, max=2}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=2, count=1, min=2, max=2}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n1}: DistributionResult{sum=1, count=1, min=1, max=1}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:1}: DistributionResult{sum=8, count=2, min=4, max=4}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n5}: DistributionResult{sum=1, count=1, min=1, max=1}, n9/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n9}: DistributionResult{sum=20, count=1, min=20, max=20}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:2}: DistributionResult{sum=12, count=3, min=4, max=4}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n4}: DistributionResult{sum=4, count=2, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n3}: DistributionResult{sum=1, count=1, min=1, max=1}))
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/go-job-7-1583434459606605934_9df13e4a-cf72-457b-96f8-7b617ff87a2a/MANIFEST has 1 artifact locations
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/go-job-7-1583434459606605934_9df13e4a-cf72-457b-96f8-7b617ff87a2a/
2020/03/05 18:54:29 Job state: DONE
2020/03/05 18:54:29 Test flatten:flatten completed
2020/03/05 18:54:29 Result: 1 tests failed
if [[ ! -z "$JOB_PORT" ]]; then
# Shut down the job server
kill %1 || echo "Failed to shut down job server"
fi
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Error response from daemon: conflict: unable to remove repository reference "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-184907" (must force) - container 6071e8f0919f is using its referenced image 0877df4c901d
Failed to remove container
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e2378428d0de31c80c0cd38b6a3b3ea4f3380c7c9638fa4c6d7be1e7073e1620
Associated tags:
- 20200305-184907
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-184907
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-184907].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e2378428d0de31c80c0cd38b6a3b3ea4f3380c7c9638fa4c6d7be1e7073e1620].
# Clean up tempdir
rm -rf $TMPDIR
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> FAILURE
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 59
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 8m 26s
67 actionable tasks: 66 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/r2rw5iagc2vfw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Go_VR_Flink #2661
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/2661/display/redirect>
Changes:
------------------------------------------
[...truncated 814.99 KB...]
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (823fd9571bf6c602cc940bfd78ef7e8e).
[CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (823fd9571bf6c602cc940bfd78ef7e8e) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) 823fd9571bf6c602cc940bfd78ef7e8e.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition (MapPartition at [3]{github.com, Flatten}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (823fd9571bf6c602cc940bfd78ef7e8e) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupReduce (GroupReduce at CoGBK) (1/1) (attempt #0) to a9527357-ba60-4a47-84e8-ff2c67f3d765 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupReduce (GroupReduce at CoGBK) (1/1).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) switched from CREATED to DEPLOYING.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) [DEPLOYING]
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) [DEPLOYING].
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) switched from DEPLOYING to RUNNING.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (018fb486f73fff05cdc89c48d5916f03) switched from RUNNING to FINISHED.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (018fb486f73fff05cdc89c48d5916f03).
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (018fb486f73fff05cdc89c48d5916f03) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) 018fb486f73fff05cdc89c48d5916f03.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: CoGBK) -> Map (Key Extractor) (1/1) (018fb486f73fff05cdc89c48d5916f03) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (attempt #0) to a9527357-ba60-4a47-84e8-ff2c67f3d765 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1).
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) switched from CREATED to DEPLOYING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) [DEPLOYING]
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) [DEPLOYING].
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) switched from DEPLOYING to RUNNING.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.flink.metrics.MetricGroup - The operator name MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) exceeded the 80 characters length limit and was truncated.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) switched from RUNNING to FINISHED.
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30).
[GroupReduce (GroupReduce at CoGBK) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at CoGBK) 34e7f658a6877bef290002d351031b30.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce (GroupReduce at CoGBK) (1/1) (34e7f658a6877bef290002d351031b30) switched from RUNNING to FINISHED.
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583431743593695589_bc7d8aed-d443-473c-ae0a-7bdb180cb102/MANIFEST
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetManifest for /tmp/beam-artifact-staging/go-job-7-1583431743593695589_bc7d8aed-d443-473c-ae0a-7bdb180cb102/MANIFEST -> 1 artifacts
[grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected.
[grpc-default-executor-3] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 18-1
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:46363 ...
[grpc-default-executor-4] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:32993 ...
[grpc-default-executor-3] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:331 - Connecting via grpc @ localhost:34517 ...
[grpc-default-executor-3] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
[grpc-default-executor-3] INFO <https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:246 - DataSource: 1 elements in 3078136 ns
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing environment urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-180340"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment - Closing Docker container fc0ad17b33010ced6a624525cd8b6da10583398132d8ed473f6d227bd23df024. Logs:
2020/03/05 18:09:16 Provision info:
pipeline_options:<fields:<key:"beam:option:app_name:v1" value:<string_value:"go-job-7-1583431743593695589" > > fields:<key:"beam:option:experiments:v1" value:<list_value:<values:<string_value:"beam_fn_api" > > > > fields:<key:"beam:option:flink_master:v1" value:<string_value:"[local]" > > fields:<key:"beam:option:go_options:v1" value:<struct_value:<fields:<key:"options" value:<struct_value:<fields:<key:"hooks" value:<string_value:"{}" > > > > > > > > fields:<key:"beam:option:job_name:v1" value:<string_value:"go0job0701583431743593695589-jenkins-0305180904-615dc07b" > > fields:<key:"beam:option:options_id:v1" value:<number_value:7 > > fields:<key:"beam:option:output_executable_path:v1" value:<null_value:NULL_VALUE > > fields:<key:"beam:option:runner:v1" value:<null_value:NULL_VALUE > > > retrieval_token:"/tmp/beam-artifact-staging/go-job-7-1583431743593695589_bc7d8aed-d443-473c-ae0a-7bdb180cb102/MANIFEST" logging_endpoint:<url:"localhost:32993" > artifact_endpoint:<url:"localhost:38829" > control_endpoint:<url:"localhost:46363" >
2020/03/05 18:09:16 Initializing Go harness: /opt/apache/beam/boot --id=18-1 --provision_endpoint=localhost:35701
Worker exited successfully!
Failed to send message: rpc error: code = Unavailable desc = transport is closing
severity:WARN timestamp:<seconds:1583431756 nanos:596937044 > message:"forcing DataChannel[localhost:34517] reconnection on port {localhost:34517} due to rpc error: code = Canceled desc = Multiplexer hanging up" instruction_id:"2" log_location:"<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/.gogradle/project_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/datamgr.go>:119" Remote logging failed: rpc error: code = Unavailable desc = transport is closing. Retrying in 5 sec ...
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] WARN org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-180340"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
java.io.IOException: Received exit code 1 for command 'docker rm fc0ad17b33010ced6a624525cd8b6da10583398132d8ed473f6d227bd23df024'. stderr: Error: No such container: fc0ad17b33010ced6a624525cd8b6da10583398132d8ed473f6d227bd23df024
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:234)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:168)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.removeContainer(DockerCommand.java:163)
at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:95)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:479)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:494)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$1600(DefaultJobBundleFactory.java:432)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:169)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:259)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:184)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:173)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:132)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:44)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:204)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:291)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:43)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:508)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:369)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530)
at java.lang.Thread.run(Thread.java:748)
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) switched from RUNNING to FINISHED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) switched from CREATED to SCHEDULED.
[MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) [FINISHED]
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) a6507bdbc999a616e9826d3edb3519de.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink (DiscardingOutput) (1/1) (attempt #0) to a9527357-ba60-4a47-84e8-ff2c67f3d765 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSink (DiscardingOutput) (1/1).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - MapPartition (MapPartition at [1]github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/testing/passert.sumFn) (1/1) (a6507bdbc999a616e9826d3edb3519de) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) switched from CREATED to DEPLOYING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) [DEPLOYING]
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) [DEPLOYING].
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) switched from DEPLOYING to RUNNING.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) switched from RUNNING to FINISHED.
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846).
[DataSink (DiscardingOutput) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) [FINISHED]
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) cfbc436c06ed39540361d2721aef5846.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (DiscardingOutput) (1/1) (cfbc436c06ed39540361d2721aef5846) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job go0job0701583431743593695589-jenkins-0305180904-615dc07b (31eb946fc3d264800979be3d020f3ca5) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 31eb946fc3d264800979be3d020f3ca5 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job go0job0701583431743593695589-jenkins-0305180904-615dc07b(31eb946fc3d264800979be3d020f3ca5).
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection b0d7c070bb0f914c1019d86b54a8af46: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{cpuCores=1.7976931348623157E308, heapMemoryInMB=2147483647, directMemoryInMB=2147483647, nativeMemoryInMB=2147483647, networkMemoryInMB=2147483647, managedMemoryInMB=16273}, allocationId: 3ead9bb42f94bbd1fc8e9be6f3e77d28, jobId: 31eb946fc3d264800979be3d020f3ca5).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager a586eba23d01d9426cfeb9aa3ecf4a8b@akka://flink/user/jobmanager_13 for job 31eb946fc3d264800979be3d020f3ca5 from the resource manager.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 31eb946fc3d264800979be3d020f3ca5 from job leader monitoring.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 31eb946fc3d264800979be3d020f3ca5.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 31eb946fc3d264800979be3d020f3ca5.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Cannot reconnect to job 31eb946fc3d264800979be3d020f3ca5 because it is not registered.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_12.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close ResourceManager connection b0d7c070bb0f914c1019d86b54a8af46.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Closing TaskExecutor connection a9527357-ba60-4a47-84e8-ff2c67f3d765 because: The TaskExecutor is shutting down.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-io-5011beaf-da7f-4625-85f5-d1ee93412c5d
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.io.network.NettyShuffleEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.io.disk.FileChannelManagerImpl - FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-798850d0-f324-49ed-af92-6507e96cb34b
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.KvStateService - Shutting down the kvState service and its components.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.filecache.FileCache - removed file cache directory /tmp/flink-dist-cache-f9f7e8fe-bb8c-4081-a034-d7451c80065f
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_12.
[ForkJoinPool.commonPool-worker-4] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-4] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher.
[flink-akka.actor.default-dispatcher-7] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.
[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:44145
[flink-akka.actor.default-dispatcher-6] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Execution finished in 11456 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkPipelineRunner - __metricscontainers : MetricQueryResults(Counters(n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:0}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n5}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n3}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n4}: 3, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n2}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n7}: 3, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n6}: 3, n1/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n1}: 1, n3/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:1}: 3, n9/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n9}: 1, n5/beam:env:docker:v1:0:beam:metric:element_count:v1 {PCOLLECTION=n8:2}: 3)Distributions(n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n2}: DistributionResult{sum=4, count=2, min=2, max=2}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=2, count=1, min=2, max=2}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n6}: DistributionResult{sum=4, count=2, min=2, max=2}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n7}: DistributionResult{sum=4, count=2, min=2, max=2}, n1/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n1}: DistributionResult{sum=1, count=1, min=1, max=1}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:1}: DistributionResult{sum=12, count=3, min=4, max=4}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n5}: DistributionResult{sum=1, count=1, min=1, max=1}, n9/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n9}: DistributionResult{sum=20, count=1, min=20, max=20}, n5/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n8:2}: DistributionResult{sum=8, count=2, min=4, max=4}, n3/beam:env:docker:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=n3}: DistributionResult{sum=1, count=1, min=1, max=1}))
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - Manifest at /tmp/beam-artifact-staging/go-job-7-1583431743593695589_bc7d8aed-d443-473c-ae0a-7bdb180cb102/MANIFEST has 1 artifact locations
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/beam-artifact-staging/go-job-7-1583431743593695589_bc7d8aed-d443-473c-ae0a-7bdb180cb102/
2020/03/05 18:09:17 Job state: DONE
2020/03/05 18:09:17 Test flatten:flatten completed
2020/03/05 18:09:17 Result: 1 tests failed
if [[ ! -z "$JOB_PORT" ]]; then
# Shut down the job server
kill %1 || echo "Failed to shut down job server"
fi
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
Error response from daemon: conflict: unable to remove repository reference "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-180340" (must force) - container fee12a2867a6 is using its referenced image 3b882c6c55a8
Failed to remove container
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container"
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:fa93964c117817ecb151bd4fc6b440b5691287c2e3be975d664b31f0335c033b
Associated tags:
- 20200305-180340
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-180340
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20200305-180340].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:fa93964c117817ecb151bd4fc6b440b5691287c2e3be975d664b31f0335c033b].
# Clean up tempdir
rm -rf $TMPDIR
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
>>> FAILURE
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
> Task :sdks:go:test:flinkValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/ws/src/sdks/go/test/build.gradle'> line: 59
* What went wrong:
Execution failed for task ':sdks:go:test:flinkValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 7m 32s
67 actionable tasks: 49 executed, 18 from cache
Publishing build scan...
https://gradle.com/s/jdbupn6wak2yy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org