You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/05/20 18:12:46 UTC
Build failed in Jenkins: beam_PreCommit_Python_PVR_Flink_Cron #559
See <https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/559/display/redirect?page=changes>
Changes:
[jozsi] Add various Jet Runner fixes & improvements
[jozsi] Add Jet-Runner to maven archetypes to facilitate easier running of
[markliu] Update README for beam_PerformanceTests_WordCountIT Jenkins job
[daniel.o.programmer] [BEAM-7154] Fixing small error bug.
[mxm] [BEAM-7367] Add Kafka clients jar as a Docker dependency
[github] [BEAM-6988] Implement a Python 3 version of getcallargs_forhints (#8590)
------------------------------------------
[...truncated 19.81 MB...]
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:186)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:49)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:38071.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:38391.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
INFO:root:Creating channel for localhost:33049
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (deadfa362df484d48377f8ec988b713e) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (deadfa362df484d48377f8ec988b713e).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (deadfa362df484d48377f8ec988b713e) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) deadfa362df484d48377f8ec988b713e.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (deadfa362df484d48377f8ec988b713e) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (8f8ea8ba6eae44033f55415b8863e2ce) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (8f8ea8ba6eae44033f55415b8863e2ce).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (8f8ea8ba6eae44033f55415b8863e2ce) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 8f8ea8ba6eae44033f55415b8863e2ce.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (8f8ea8ba6eae44033f55415b8863e2ce) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (89ff07682d5232c2e9e9c699e07c5501) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (89ff07682d5232c2e9e9c699e07c5501).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (89ff07682d5232c2e9e9c699e07c5501) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 89ff07682d5232c2e9e9c699e07c5501.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (89ff07682d5232c2e9e9c699e07c5501) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (11c1c5d2fcbe8e509b5760108c5c58c8) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (11c1c5d2fcbe8e509b5760108c5c58c8).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (11c1c5d2fcbe8e509b5760108c5c58c8) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} 11c1c5d2fcbe8e509b5760108c5c58c8.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (cd6ac5159310411e80fc5c4ee2849165) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (cd6ac5159310411e80fc5c4ee2849165).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (cd6ac5159310411e80fc5c4ee2849165) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem cd6ac5159310411e80fc5c4ee2849165.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (11c1c5d2fcbe8e509b5760108c5c58c8) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (cd6ac5159310411e80fc5c4ee2849165) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, e40b3050-0249-4eb8-b3a2-566fa1a5af41, test_windowing_1558375961.99, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (b9fefd0a4f7f60489aeece84870e31d2) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (b9fefd0a4f7f60489aeece84870e31d2).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (b9fefd0a4f7f60489aeece84870e31d2) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} b9fefd0a4f7f60489aeece84870e31d2.
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 271, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1558375963.527519643","description":"Error received from peer ipv4:127.0.0.1:33049","file":"src/core/lib/surface/call.cc","file_line":1041,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (b9fefd0a4f7f60489aeece84870e31d2) switched from RUNNING to FINISHED.
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1558375961.99 (8f49e26db34063e1f2101eb4b6228e9e) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 8f49e26db34063e1f2101eb4b6228e9e.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Done consuming work.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 285, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 271, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1558375963.527519643","description":"Error received from peer ipv4:127.0.0.1:33049","file":"src/core/lib/surface/call.cc","file_line":1041,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 8f49e26db34063e1f2101eb4b6228e9e reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1558375961.99(8f49e26db34063e1f2101eb4b6228e9e).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 8f49e26db34063e1f2101eb4b6228e9e.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection c8334be8e885032e1e11818847f110f0: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{03f29ccbd23678f91b04d0efa6733cd9}, jobId: 8f49e26db34063e1f2101eb4b6228e9e).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 8f49e26db34063e1f2101eb4b6228e9e from job leader monitoring.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 83cda5c3434984f409cf1e660f83415c@akka://flink/user/jobmanager_55 for job 8f49e26db34063e1f2101eb4b6228e9e from the resource manager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 8f49e26db34063e1f2101eb4b6228e9e.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_54.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatchera8c2278d-8105-46cb-ab15-35bf878ec8f6.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatchera8c2278d-8105-46cb-ab15-35bf878ec8f6.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-8db27d9d-de71-474e-a2c0-04def1762813
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatchera8c2278d-8105-46cb-ab15-35bf878ec8f6.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_54.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confGWRDXg/test-metrics.txt
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:45441
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 333 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : MetricQueryResults(Counters(26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_10}: 5, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_11}: 5, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_12}: 5, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_22}: 1, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_30}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_9}: 5, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_18}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_17}: 1, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_19}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_24:1}: 1, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_29}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_27}: 1, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_28}: 1, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_1}: 1, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_15}: 2, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_2}: 5, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_16}: 2, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_24:0}: 2, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_20}: 2, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_23}: 2, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_21}: 2, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0)Distributions(14Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13, count=1, min=13, max=13}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=70, count=5, min=14, max=14}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_11}: DistributionResult{sum=100, count=5, min=20, max=20}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_24:0}: DistributionResult{sum=60, count=2, min=29, max=31}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=140, count=5, min=28, max=28}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=80, count=5, min=16, max=16}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_24:1}: DistributionResult{sum=19, count=1, min=19, max=19}, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=75, count=5, min=15, max=15}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_19}: DistributionResult{sum=15, count=1, min=15, max=15}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_15}: DistributionResult{sum=75, count=2, min=36, max=39}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_18}: DistributionResult{sum=16, count=1, min=16, max=16}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_16}: DistributionResult{sum=66, count=2, min=32, max=34}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=13, count=1, min=13, max=13}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_30}: DistributionResult{sum=14, count=1, min=14, max=14}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_28}: DistributionResult{sum=47, count=1, min=47, max=47}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_29}: DistributionResult{sum=39, count=1, min=39, max=39}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_22}: DistributionResult{sum=17, count=1, min=17, max=17}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=46, count=2, min=22, max=24}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_21}: DistributionResult{sum=48, count=2, min=23, max=25}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_23}: DistributionResult{sum=52, count=2, min=25, max=27}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_27}: DistributionResult{sum=59, count=1, min=59, max=59}))
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/flinktestArbMiT/job_dceba185-c0ef-451b-91b2-0fbebd3bb16c/MANIFEST has 0 artifact locations
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/flinktestArbMiT/job_dceba185-c0ef-451b-91b2-0fbebd3bb16c/
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confGWRDXg
======================================================================
FAIL: test_external_transforms (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 196, in test_external_transforms
'failed due to:\n%s' % str(ctx.exception))
AssertionError: Expected to fail due to invalid bootstrap.servers, but failed due to:
<_Rendezvous of RPC that terminated with:
status = StatusCode.UNKNOWN
details = ""
debug_error_string = "{"created":"@1558375876.957105386","description":"Error received from peer ipv4:127.0.0.1:60901","file":"src/core/lib/surface/call.cc","file_line":1041,"grpc_message":"","grpc_status":2}"
>
----------------------------------------------------------------------
Ran 68 tests in 105.655s
FAILED (failures=1, skipped=14)
> Task :sdks:python:flinkCompatibilityMatrixStreamingPreOptimizeLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/build.gradle'> line: 320
* What went wrong:
Execution failed for task ':sdks:python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/build.gradle'> line: 320
* What went wrong:
Execution failed for task ':sdks:python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/build.gradle'> line: 320
* What went wrong:
Execution failed for task ':sdks:python:flinkCompatibilityMatrixStreamingPreOptimizeLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 28s
51 actionable tasks: 36 executed, 15 from cache
Publishing build scan...
https://gradle.com/s/n46mfeobrcxxc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PreCommit_Python_PVR_Flink_Cron #562
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/562/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_PVR_Flink_Cron #561
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/561/display/redirect?page=changes>
Changes:
[ehudm] [BEAM-7376] Update tox version used by gradle
[daniel.o.programmer] [BEAM-7373] Migrating vet runner
------------------------------------------
[...truncated 19.85 MB...]
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:186)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:49)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:37121.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:36965.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating channel for localhost:44881
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (125aee510502403b2feb75ae5d738c08) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (125aee510502403b2feb75ae5d738c08).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (125aee510502403b2feb75ae5d738c08) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) 125aee510502403b2feb75ae5d738c08.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (125aee510502403b2feb75ae5d738c08) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (2fd075021679307d285ccf15ecc4f4b3) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (2fd075021679307d285ccf15ecc4f4b3).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (2fd075021679307d285ccf15ecc4f4b3) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 2fd075021679307d285ccf15ecc4f4b3.WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (2fd075021679307d285ccf15ecc4f4b3) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4a36f47b863b793460566336554d19d6) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4a36f47b863b793460566336554d19d6).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4a36f47b863b793460566336554d19d6) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 4a36f47b863b793460566336554d19d6.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4a36f47b863b793460566336554d19d6) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (a9ab3d4eab79caeaccbb68d5ed65ce8d) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (a9ab3d4eab79caeaccbb68d5ed65ce8d).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (a9ab3d4eab79caeaccbb68d5ed65ce8d) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} a9ab3d4eab79caeaccbb68d5ed65ce8d.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (c747f50f9e8a20df165d9d5e4c1f91c7) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (c747f50f9e8a20df165d9d5e4c1f91c7).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (c747f50f9e8a20df165d9d5e4c1f91c7) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem c747f50f9e8a20df165d9d5e4c1f91c7.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (a9ab3d4eab79caeaccbb68d5ed65ce8d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (c747f50f9e8a20df165d9d5e4c1f91c7) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, b82a4c92-26f4-4b36-b825-73d713cb5854, test_windowing_1558419240.82, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (d31e9e370a28f11c1a94cf3693dda091) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (d31e9e370a28f11c1a94cf3693dda091).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (d31e9e370a28f11c1a94cf3693dda091) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} d31e9e370a28f11c1a94cf3693dda091.
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 271, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1558419241.888472030","description":"Error received from peer ipv4:127.0.0.1:44881","file":"src/core/lib/surface/call.cc","file_line":1041,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (d31e9e370a28f11c1a94cf3693dda091) switched from RUNNING to FINISHED.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 285, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 271, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1558419241.888472030","description":"Error received from peer ipv4:127.0.0.1:44881","file":"src/core/lib/surface/call.cc","file_line":1041,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1558419240.82 (1ab6d8158c6f867d0d8a582a226159c7) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 1ab6d8158c6f867d0d8a582a226159c7.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 1ab6d8158c6f867d0d8a582a226159c7 reached globally terminal state FINISHED.
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1558419240.82(1ab6d8158c6f867d0d8a582a226159c7).
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 1ab6d8158c6f867d0d8a582a226159c7.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection b8cd771544a7fd72ef080625b1a647cf: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 86531f593edfd4b68267d212e7ce43fa@akka://flink/user/jobmanager_55 for job 1ab6d8158c6f867d0d8a582a226159c7 from the resource manager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{288f9bba0a32ce09a5b543a3570032aa}, jobId: 1ab6d8158c6f867d0d8a582a226159c7).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 1ab6d8158c6f867d0d8a582a226159c7 from job leader monitoring.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 1ab6d8158c6f867d0d8a582a226159c7.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_54.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher18a31be8-8a7a-4819-866c-14c17fba88fb.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher18a31be8-8a7a-4819-866c-14c17fba88fb.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-95646d26-3a70-4b53-8875-0d30a8c5972e
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_54.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher18a31be8-8a7a-4819-866c-14c17fba88fb.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-conf7zpML3/test-metrics.txt
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:33899
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 260 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : MetricQueryResults(Counters(26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_10}: 5, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_11}: 5, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_12}: 5, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_22}: 1, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_30}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_9}: 5, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_18}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_17}: 1, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_19}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_24:0}: 1, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_29}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_27}: 1, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_28}: 1, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_1}: 1, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_15}: 2, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_2}: 5, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_16}: 2, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_24:1}: 2, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_20}: 2, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_23}: 2, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_21}: 2, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0)Distributions(14Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13, count=1, min=13, max=13}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=70, count=5, min=14, max=14}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_11}: DistributionResult{sum=100, count=5, min=20, max=20}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=140, count=5, min=28, max=28}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_24:1}: DistributionResult{sum=60, count=2, min=29, max=31}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=80, count=5, min=16, max=16}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_24:0}: DistributionResult{sum=19, count=1, min=19, max=19}, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=75, count=5, min=15, max=15}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_19}: DistributionResult{sum=15, count=1, min=15, max=15}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_15}: DistributionResult{sum=75, count=2, min=36, max=39}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_18}: DistributionResult{sum=16, count=1, min=16, max=16}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_16}: DistributionResult{sum=66, count=2, min=32, max=34}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=13, count=1, min=13, max=13}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_30}: DistributionResult{sum=14, count=1, min=14, max=14}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_28}: DistributionResult{sum=47, count=1, min=47, max=47}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_29}: DistributionResult{sum=39, count=1, min=39, max=39}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_22}: DistributionResult{sum=17, count=1, min=17, max=17}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=46, count=2, min=22, max=24}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_21}: DistributionResult{sum=48, count=2, min=23, max=25}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_23}: DistributionResult{sum=52, count=2, min=25, max=27}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_27}: DistributionResult{sum=59, count=1, min=59, max=59}))
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/flinktestDxSL_2/job_2267a6a4-39b1-4f8f-b688-866f8a56ca67/MANIFEST has 0 artifact locations
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/flinktestDxSL_2/job_2267a6a4-39b1-4f8f-b688-866f8a56ca67/
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-conf7zpML3
======================================================================
FAIL: test_external_transforms (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 196, in test_external_transforms
'failed due to:\n%s' % str(ctx.exception))
AssertionError: Expected to fail due to invalid bootstrap.servers, but failed due to:
<_Rendezvous of RPC that terminated with:
status = StatusCode.UNKNOWN
details = ""
debug_error_string = "{"created":"@1558419167.540083434","description":"Error received from peer ipv4:127.0.0.1:36283","file":"src/core/lib/surface/call.cc","file_line":1041,"grpc_message":"","grpc_status":2}"
>
----------------------------------------------------------------------
Ran 68 tests in 93.363s
FAILED (failures=1, skipped=14)
> Task :sdks:python:flinkCompatibilityMatrixStreamingPreOptimizeLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/build.gradle'> line: 320
* What went wrong:
Execution failed for task ':sdks:python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/build.gradle'> line: 320
* What went wrong:
Execution failed for task ':sdks:python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/build.gradle'> line: 320
* What went wrong:
Execution failed for task ':sdks:python:flinkCompatibilityMatrixStreamingPreOptimizeLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 15s
51 actionable tasks: 39 executed, 12 from cache
Publishing build scan...
https://gradle.com/s/7ohes67okyrdw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_PVR_Flink_Cron #560
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/560/display/redirect?page=changes>
Changes:
[rtnguyen] Reorg Beam SQL docs and added Calcite section
[pabloem] [BEAM-6880] Remove deprecated Reference Runner code. (#8380)
------------------------------------------
[...truncated 19.80 MB...]
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:186)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:49)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:43743.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:33679.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating channel for localhost:45309
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [1]Create/FlatMap(<lambda at core.py:2254>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (f92c7bb1333b4284f4b52e7274e2bec3) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (f92c7bb1333b4284f4b52e7274e2bec3).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (f92c7bb1333b4284f4b52e7274e2bec3) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) f92c7bb1333b4284f4b52e7274e2bec3.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2254>) (1/1) (f92c7bb1333b4284f4b52e7274e2bec3) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (f4b733cf8c673f35802466d6132e0e5b) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (f4b733cf8c673f35802466d6132e0e5b).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (f4b733cf8c673f35802466d6132e0e5b) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} f4b733cf8c673f35802466d6132e0e5b.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (f4b733cf8c673f35802466d6132e0e5b) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (e843e98e7b18a84f4bba41a92540daef) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (e843e98e7b18a84f4bba41a92540daef).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (e843e98e7b18a84f4bba41a92540daef) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem e843e98e7b18a84f4bba41a92540daef.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:531>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (e843e98e7b18a84f4bba41a92540daef) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (e0b08de48ea5511486345ac2c3eb45d6) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (e0b08de48ea5511486345ac2c3eb45d6).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (e0b08de48ea5511486345ac2c3eb45d6) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} e0b08de48ea5511486345ac2c3eb45d6.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (8d4b2af49be419151cc605c043e6c6de) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (8d4b2af49be419151cc605c043e6c6de).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (8d4b2af49be419151cc605c043e6c6de) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 8d4b2af49be419151cc605c043e6c6de.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:534>), assert_that} (1/1) (e0b08de48ea5511486345ac2c3eb45d6) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (8d4b2af49be419151cc605c043e6c6de) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:sampled_byte_size:v1'. Metric will not be reported.[localhost, taskmanager, 933f098e-d899-47b4-b28d-ebc4a75c9bc1, test_windowing_1558398129.51, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (70fd227696ce631050b4aeaa019e0f04) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (70fd227696ce631050b4aeaa019e0f04).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (70fd227696ce631050b4aeaa019e0f04) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 70fd227696ce631050b4aeaa019e0f04.
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 271, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1558398130.913033849","description":"Error received from peer ipv4:127.0.0.1:45309","file":"src/core/lib/surface/call.cc","file_line":1041,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (70fd227696ce631050b4aeaa019e0f04) switched from RUNNING to FINISHED.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 285, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 271, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 366, in next
return self._next()
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/grpc/_channel.py",> line 357, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1558398130.913033849","description":"Error received from peer ipv4:127.0.0.1:45309","file":"src/core/lib/surface/call.cc","file_line":1041,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1558398129.51 (cbb1e5da8d782dd0d1945e9e32a3b63c) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job cbb1e5da8d782dd0d1945e9e32a3b63c.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Closing all cached grpc data channels.
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job cbb1e5da8d782dd0d1945e9e32a3b63c reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1558398129.51(cbb1e5da8d782dd0d1945e9e32a3b63c).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job cbb1e5da8d782dd0d1945e9e32a3b63c.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 9327ab1d89716807007d017201515265: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 9f9a9f34d438f76cae90666228654ad7@akka://flink/user/jobmanager_55 for job cbb1e5da8d782dd0d1945e9e32a3b63c from the resource manager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{54b174b71b4f98cc7c4889998e6f1592}, jobId: cbb1e5da8d782dd0d1945e9e32a3b63c).
[flink-runner-job-invoker] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job cbb1e5da8d782dd0d1945e9e32a3b63c from job leader monitoring.
[flink-runner-job-invoker] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job cbb1e5da8d782dd0d1945e9e32a3b63c.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher93a0d47d-174f-492d-b1ce-0134449931fc.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher93a0d47d-174f-492d-b1ce-0134449931fc.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_54.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-76ca3499-7aea-47d0-b274-1e5b069856d9
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher93a0d47d-174f-492d-b1ce-0134449931fc.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_54.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confPmkq4r/test-metrics.txt
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:38723
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 316 msecs
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-invoker] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : MetricQueryResults(Counters(26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_10}: 5, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_11}: 5, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_12}: 5, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_22}: 1, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_30}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:531>)_17}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_9}: 5, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_18}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_27:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_17}: 1, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_19}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_24:0}: 1, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/ToVoidKey_31}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_29}: 1, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_27}: 1, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_28}: 1, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_1:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/Map(decode)_29}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2254>)_27}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_1}: 1, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_WindowInto(WindowIntoFn)_18}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_15}: 2, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_2}: 5, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_16}: 2, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_2:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Unkey_41}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_40}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_24:1}: 2, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_17:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:1:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_30}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/Map(decode)_16}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_1_34}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2254>)_4}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_20}: 2, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_23}: 2, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:ptransform_execution_time:total_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Match_42}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:element_count:v1 {PCOLLECTION=ref_PCollection_PCollection_21}: 2, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_24:0:0}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:start_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/Flatten_35}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_15:0}: 0, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_Map(<lambda at fn_api_runner_test.py:534>)_23}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:finish_bundle_msecs:v1 {PTRANSFORM=fn/write/ref_PCollection_PCollection_12:0}: 0, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=ref_AppliedPTransform_assert_that/Group/pair_with_0_33}: 0, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:pardo_execution_time:process_bundle_msecs:v1 {PTRANSFORM=fn/read/ref_PCollection_PCollection_9:0}: 0)Distributions(14Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_1}: DistributionResult{sum=13, count=1, min=13, max=13}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_10}: DistributionResult{sum=70, count=5, min=14, max=14}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_11}: DistributionResult{sum=100, count=5, min=20, max=20}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_12}: DistributionResult{sum=140, count=5, min=28, max=28}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_24:1}: DistributionResult{sum=60, count=2, min=29, max=31}, 48Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_9}: DistributionResult{sum=80, count=5, min=16, max=16}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_24:0}: DistributionResult{sum=19, count=1, min=19, max=19}, 14Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_2}: DistributionResult{sum=75, count=5, min=15, max=15}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_19}: DistributionResult{sum=15, count=1, min=15, max=15}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_15}: DistributionResult{sum=75, count=2, min=36, max=39}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_18}: DistributionResult{sum=16, count=1, min=16, max=16}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_16}: DistributionResult{sum=66, count=2, min=32, max=34}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_17}: DistributionResult{sum=13, count=1, min=13, max=13}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_30}: DistributionResult{sum=14, count=1, min=14, max=14}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_28}: DistributionResult{sum=47, count=1, min=47, max=47}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_29}: DistributionResult{sum=39, count=1, min=39, max=39}, 26assert_that/Create/Impulse.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_22}: DistributionResult{sum=17, count=1, min=17, max=17}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_20}: DistributionResult{sum=46, count=2, min=22, max=24}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_21}: DistributionResult{sum=48, count=2, min=23, max=25}, 24GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_23}: DistributionResult{sum=52, count=2, min=25, max=27}, 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1 {PCOLLECTION=ref_PCollection_PCollection_27}: DistributionResult{sum=59, count=1, min=59, max=59}))
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService - Manifest at /tmp/flinktest6GEXJU/job_ebd0814a-6891-4864-a7f4-277d9d684bcd/MANIFEST has 0 artifact locations
[flink-runner-job-invoker] INFO org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService - Removed dir /tmp/flinktest6GEXJU/job_ebd0814a-6891-4864-a7f4-277d9d684bcd/
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confPmkq4r
======================================================================
FAIL: test_external_transforms (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 196, in test_external_transforms
'failed due to:\n%s' % str(ctx.exception))
AssertionError: Expected to fail due to invalid bootstrap.servers, but failed due to:
<_Rendezvous of RPC that terminated with:
status = StatusCode.UNKNOWN
details = ""
debug_error_string = "{"created":"@1558398039.931658395","description":"Error received from peer ipv4:127.0.0.1:51659","file":"src/core/lib/surface/call.cc","file_line":1041,"grpc_message":"","grpc_status":2}"
>
----------------------------------------------------------------------
Ran 68 tests in 112.527s
FAILED (failures=1, skipped=14)
> Task :sdks:python:flinkCompatibilityMatrixStreamingPreOptimizeLOOPBACK FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/build.gradle'> line: 320
* What went wrong:
Execution failed for task ':sdks:python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/build.gradle'> line: 320
* What went wrong:
Execution failed for task ':sdks:python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/build.gradle'> line: 320
* What went wrong:
Execution failed for task ':sdks:python:flinkCompatibilityMatrixStreamingPreOptimizeLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 42s
51 actionable tasks: 36 executed, 15 from cache
Publishing build scan...
https://gradle.com/s/ewlwojdnnjd7u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org