You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/11/17 06:20:10 UTC
Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #4344
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4344/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15997: [BEAM-8688] Upgrading gcsio library to latest
------------------------------------------
[...truncated 464.78 KB...]
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (a2d35154fa0cef0edcd25d9160df0e86).
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 a2d35154fa0cef0edcd25d9160df0e86.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (4f24b2809e18cc1665a01ba22e60496e) switched from RUNNING to FINISHED.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (4f24b2809e18cc1665a01ba22e60496e).
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 4f24b2809e18cc1665a01ba22e60496e.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (65aafba16478541e0c22145fef9b1604) switched from RUNNING to FINISHED.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (65aafba16478541e0c22145fef9b1604).
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 65aafba16478541e0c22145fef9b1604.
Nov 17, 2021 6:19:50 AM org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory createBuilder
INFO: The AWS S3 Beam extension was included in this build, but the awsRegion flag was not specified. If you don't plan to use S3, then ignore this message.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1)#0 (06482aa14b6a0f8c6a816d459eaa6ad6) switched from RUNNING to FINISHED.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1)#0 (06482aa14b6a0f8c6a816d459eaa6ad6).
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1)#0 06482aa14b6a0f8c6a816d459eaa6ad6.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:3224>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (8d2cc425d3367397867757a7268a0a49) switched from RUNNING to FINISHED.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (a2d35154fa0cef0edcd25d9160df0e86) switched from RUNNING to FINISHED.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (4f24b2809e18cc1665a01ba22e60496e) switched from RUNNING to FINISHED.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1) (65aafba16478541e0c22145fef9b1604) switched from RUNNING to FINISHED.
Nov 17, 2021 6:19:50 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1) (06482aa14b6a0f8c6a816d459eaa6ad6) switched from RUNNING to FINISHED.
Nov 17, 2021 6:19:50 AM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.7_sdk:2.35.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.35.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:sibling_workers:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-f6b949d2-d4eb-4c93-bd07-bcca16f51204/0d31ca92812049639c896f76e4a0dfa90fb89b6f5af3d2c03845eef3f095086e-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
Nov 17, 2021 6:19:50 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Nov 17, 2021 6:19:50 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Nov 17, 2021 6:19:50 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Nov 17, 2021 6:19:51 AM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container d11f6a1f65bde134931fa63ce02630dfa310618c1f9c2819a2171688dc0ea7d3. Logs:
2021/11/17 06:19:47 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:allow_unsafe_triggers:v1" value:{bool_value:false}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_options:v1" value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.7_sdk:2.35.0.dev"}}}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"DOCKER"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.35.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:true}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.13"}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-1117061855-fc41641b"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:options_id:v1" value:{number_value:1}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:true}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:spark_version:v1" value:{string_value:"2"}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}}} retrieval_token:"__no_artifacts_staged__" logging_endpoint:{url:"localhost:40035"} artifact_endpoint:{url:"localhost:35353"} control_endpoint:{url:"localhost:38239"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-f6b949d2-d4eb-4c93-bd07-bcca16f51204/0d31ca92812049639c896f76e4a0dfa90fb89b6f5af3d2c03845eef3f095086e-pickled_main_session" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x14pickled_main_session"}
2021/11/17 06:19:47 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:36239
2021/11/17 06:19:47 Downloaded: /tmp/staged/pickled_main_session (sha256: 713cbc265017c83caad285f72b00a95200628075dc3425d3412661b39b1a68bf, size: 2760)
2021/11/17 06:19:47 Found artifact: pickled_main_session
2021/11/17 06:19:47 Installing setup packages ...
2021/11/17 06:19:47 Executing: python -m apache_beam.runners.worker.sdk_worker_main
2021/11/17 06:19:51 Python exited: <nil>
Nov 17, 2021 6:20:02 AM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient close
WARNING: Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.7_sdk:2.35.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.35.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:sibling_workers:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-f6b949d2-d4eb-4c93-bd07-bcca16f51204/0d31ca92812049639c896f76e4a0dfa90fb89b6f5af3d2c03845eef3f095086e-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
java.io.IOException: Received exit code 1 for command 'docker kill d11f6a1f65bde134931fa63ce02630dfa310618c1f9c2819a2171688dc0ea7d3'. stderr: Error response from daemon: Cannot kill container: d11f6a1f65bde134931fa63ce02630dfa310618c1f9c2819a2171688dc0ea7d3: Container d11f6a1f65bde134931fa63ce02630dfa310618c1f9c2819a2171688dc0ea7d3 is not running
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:237)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:171)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.killContainer(DockerCommand.java:151)
at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:93)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:642)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:642)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:658)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:589)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:212)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:319)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:212)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:188)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:177)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:268)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:373)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:524)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:360)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
at java.lang.Thread.run(Thread.java:748)
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (20b569e8cb8e404609e621a5c71bc970) switched from RUNNING to FINISHED.
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (20b569e8cb8e404609e621a5c71bc970).
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 20b569e8cb8e404609e621a5c71bc970.
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (d1338f49250a003b2f2778447ee1abaa) switched from RUNNING to FINISHED.
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (d1338f49250a003b2f2778447ee1abaa).
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 d1338f49250a003b2f2778447ee1abaa.
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1) (20b569e8cb8e404609e621a5c71bc970) switched from RUNNING to FINISHED.
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (d1338f49250a003b2f2778447ee1abaa) switched from RUNNING to FINISHED.
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 8faaa73a1f603638c72e426326b662d6
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job BeamApp-jenkins-1117061855-fc41641b (8faaa73a1f603638c72e426326b662d6) switched from state RUNNING to FINISHED.
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job 8faaa73a1f603638c72e426326b662d6 reached terminal state FINISHED.
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-1117061855-fc41641b(8faaa73a1f603638c72e426326b662d6).
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [3db3bd89b0ae502514471455977f3d7c].
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: 3db3bd89b0ae502514471455977f3d7c, jobId: 8faaa73a1f603638c72e426326b662d6).
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 8faaa73a1f603638c72e426326b662d6
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection ca170c92f9d0ec8077f2a74ff7aa92cf: Stopping JobMaster for job BeamApp-jenkins-1117061855-fc41641b(8faaa73a1f603638c72e426326b662d6)..
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager 889f536e60db51da31cdbf8ec0c142cb@akka://flink/user/rpc/jobmanager_3 for job 8faaa73a1f603638c72e426326b662d6 from the resource manager.
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job 8faaa73a1f603638c72e426326b662d6 from job leader monitoring.
Nov 17, 2021 6:20:02 AM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 8faaa73a1f603638c72e426326b662d6.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
Nov 17, 2021 6:20:06 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Nov 17, 2021 6:20:06 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 19m 38s
150 actionable tasks: 106 executed, 41 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/u5lwj5avcqyf2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_PortableJar_Flink #4346
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4346/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #4345
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4345/display/redirect>
Changes:
------------------------------------------
[...truncated 632.17 KB...]
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 8b1161a4bb0cf3eba006c5661ab1c0a3.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:3224>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (9bff45e5f967b8c8028452b354f95748) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:3224>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (9bff45e5f967b8c8028452b354f95748).
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: Partition (1/1)#0 (bbbb565bf1ea0f62e9f62fe7695c737b) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for Partition (1/1)#0 (bbbb565bf1ea0f62e9f62fe7695c737b).
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (f4d2c09411c1f04a71dda158ee703104) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (f4d2c09411c1f04a71dda158ee703104).
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:3224>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 9bff45e5f967b8c8028452b354f95748.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task Partition (1/1)#0 bbbb565bf1ea0f62e9f62fe7695c737b.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 f4d2c09411c1f04a71dda158ee703104.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (c496bbb19bad13fb8036dc8394cf210c) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (c496bbb19bad13fb8036dc8394cf210c).
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 c496bbb19bad13fb8036dc8394cf210c.
Nov 17, 2021 12:21:00 PM org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory createBuilder
INFO: The AWS S3 Beam extension was included in this build, but the awsRegion flag was not specified. If you don't plan to use S3, then ignore this message.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1)#0 (71fe735e462c4ddc2d2e45dd42dca1ea) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1)#0 (71fe735e462c4ddc2d2e45dd42dca1ea).
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1)#0 71fe735e462c4ddc2d2e45dd42dca1ea.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (8b1161a4bb0cf3eba006c5661ab1c0a3) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:3224>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (9bff45e5f967b8c8028452b354f95748) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (bbbb565bf1ea0f62e9f62fe7695c737b) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (f4d2c09411c1f04a71dda158ee703104) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1) (c496bbb19bad13fb8036dc8394cf210c) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1) (71fe735e462c4ddc2d2e45dd42dca1ea) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:00 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.6_sdk:2.35.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.6_sdk:2.35.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:sibling_workers:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-d44efdcd-7330-4add-a81c-f505f485aa4e/687413607bc08a657cd9088d133c2bec3ed74b58524607d11f6c6b4a9c45c852-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
Nov 17, 2021 12:21:00 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Nov 17, 2021 12:21:00 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Nov 17, 2021 12:21:00 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Nov 17, 2021 12:21:01 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container ddc288dc68b87de3e1be05d69f3584e45334aa95cddf4e5c4ee2e48cef471728. Logs:
2021/11/17 12:20:58 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:allow_unsafe_triggers:v1" value:{bool_value:false}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_options:v1" value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.6_sdk:2.35.0.dev"}}}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"DOCKER"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.35.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:true}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.13"}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-1117122043-bbc7322b"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:options_id:v1" value:{number_value:1}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:true}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:spark_version:v1" value:{string_value:"2"}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}}} retrieval_token:"__no_artifacts_staged__" logging_endpoint:{url:"localhost:36539"} artifact_endpoint:{url:"localhost:35951"} control_endpoint:{url:"localhost:37973"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-d44efdcd-7330-4add-a81c-f505f485aa4e/687413607bc08a657cd9088d133c2bec3ed74b58524607d11f6c6b4a9c45c852-pickled_main_session" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x14pickled_main_session"}
2021/11/17 12:20:58 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:46197
2021/11/17 12:20:58 Downloaded: /tmp/staged/pickled_main_session (sha256: 909c475ddbc2fe3d430d95e6a12ed5d0a10ce77077f798d9379e459d83862dcd, size: 2760)
2021/11/17 12:20:58 Found artifact: pickled_main_session
2021/11/17 12:20:58 Installing setup packages ...
2021/11/17 12:20:58 Executing: python -m apache_beam.runners.worker.sdk_worker_main
2021/11/17 12:21:01 Python exited: <nil>
Nov 17, 2021 12:21:01 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient close
WARNING: Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.6_sdk:2.35.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.6_sdk:2.35.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:sibling_workers:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-d44efdcd-7330-4add-a81c-f505f485aa4e/687413607bc08a657cd9088d133c2bec3ed74b58524607d11f6c6b4a9c45c852-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
java.io.IOException: Received exit code 1 for command 'docker kill ddc288dc68b87de3e1be05d69f3584e45334aa95cddf4e5c4ee2e48cef471728'. stderr: Error response from daemon: Cannot kill container: ddc288dc68b87de3e1be05d69f3584e45334aa95cddf4e5c4ee2e48cef471728: Container ddc288dc68b87de3e1be05d69f3584e45334aa95cddf4e5c4ee2e48cef471728 is not running
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:237)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:171)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.killContainer(DockerCommand.java:151)
at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:93)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:642)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:642)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:658)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:589)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:212)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:319)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:212)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:188)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:177)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:268)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:373)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:524)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:360)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
at java.lang.Thread.run(Thread.java:748)
Nov 17, 2021 12:21:01 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (7b8eb07e374d87455bf5312149311326) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:01 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (7b8eb07e374d87455bf5312149311326).
Nov 17, 2021 12:21:01 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (c21f560f81b499212e611998683f2468) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:01 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (c21f560f81b499212e611998683f2468).
Nov 17, 2021 12:21:01 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 c21f560f81b499212e611998683f2468.
Nov 17, 2021 12:21:01 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 7b8eb07e374d87455bf5312149311326.
Nov 17, 2021 12:21:01 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (c21f560f81b499212e611998683f2468) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:01 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1) (7b8eb07e374d87455bf5312149311326) switched from RUNNING to FINISHED.
Nov 17, 2021 12:21:01 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job e452d8b274d8bd8a1e78d456a4560e73
Nov 17, 2021 12:21:01 PM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job BeamApp-jenkins-1117122043-bbc7322b (e452d8b274d8bd8a1e78d456a4560e73) switched from state RUNNING to FINISHED.
Nov 17, 2021 12:21:02 PM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job e452d8b274d8bd8a1e78d456a4560e73 reached terminal state FINISHED.
Nov 17, 2021 12:21:02 PM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-1117122043-bbc7322b(e452d8b274d8bd8a1e78d456a4560e73).
Nov 17, 2021 12:21:02 PM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [b79704ae44a05a7dc4bd7a5db5139760].
Nov 17, 2021 12:21:02 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: b79704ae44a05a7dc4bd7a5db5139760, jobId: e452d8b274d8bd8a1e78d456a4560e73).
Nov 17, 2021 12:21:02 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job e452d8b274d8bd8a1e78d456a4560e73 from job leader monitoring.
Nov 17, 2021 12:21:02 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job e452d8b274d8bd8a1e78d456a4560e73
Nov 17, 2021 12:21:02 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 24b73f5733ec00abe7cf4e347a898468: Stopping JobMaster for job BeamApp-jenkins-1117122043-bbc7322b(e452d8b274d8bd8a1e78d456a4560e73)..
Nov 17, 2021 12:21:02 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager a1fdfaf0427e4c22da4f236d998746fa@akka://flink/user/rpc/jobmanager_3 for job e452d8b274d8bd8a1e78d456a4560e73 from the resource manager.
Nov 17, 2021 12:21:02 PM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job e452d8b274d8bd8a1e78d456a4560e73.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
Nov 17, 2021 12:21:04 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Nov 17, 2021 12:21:04 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
>>> SUCCESS
> Task :sdks:python:test-suites:portable:py36:testPipelineJarFlinkRunner
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 20m 34s
150 actionable tasks: 106 executed, 41 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/wpoww5dnvsntq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org