You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/07/06 06:21:34 UTC
Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #3808
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3808/display/redirect>
Changes:
------------------------------------------
[...truncated 408.88 KB...]
INFO: DataSource (Impulse) (1/1)#0 (aa6bcbe76d5645362eca0ab288f9554f) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSource (Impulse) (1/1)#0 (20604914dc4000e04d0489c0b1d1500e) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSource (Impulse) (1/1)#0 (aa6bcbe76d5645362eca0ab288f9554f).
Jul 06, 2021 6:21:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSource (Impulse) (1/1)#0 (20604914dc4000e04d0489c0b1d1500e).
Jul 06, 2021 6:21:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSource (Impulse) (1/1)#0 aa6bcbe76d5645362eca0ab288f9554f.
Jul 06, 2021 6:21:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSource (Impulse) (1/1)#0 20604914dc4000e04d0489c0b1d1500e.
Jul 06, 2021 6:21:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSource (Impulse) (1/1) (aa6bcbe76d5645362eca0ab288f9554f) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSource (Impulse) (1/1) (20604914dc4000e04d0489c0b1d1500e) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:20 AM org.apache.beam.runners.fnexecution.environment.DockerCommand runImage
WARNING: Unable to pull docker image apache/beam_python3.6_sdk:2.32.0.dev, cause: Received exit code 1 for command 'docker pull apache/beam_python3.6_sdk:2.32.0.dev'. stderr: Error response from daemon: manifest for apache/beam_python3.6_sdk:2.32.0.dev not found
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService logging
INFO: Beam Fn Logging client connected.
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Logging handler created.
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: semi_persistent_directory: /tmp
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
WARNING: Discarding unparseable args: ['--app_name=None', '--direct_runner_use_stacked_bundle', '--job_server_timeout=60', '--options_id=1', '--parallelism=1', '--pipeline_type_check']
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Pipeline_options: {'job_name': 'BeamApp-jenkins-0706062112-4864b721', 'experiments': ['beam_fn_api'], 'save_main_session': True, 'sdk_location': 'container', 'environment_type': 'DOCKER', 'environment_options': ['docker_container_image=apache/beam_python3.6_sdk:2.32.0.dev'], 'sdk_worker_parallelism': '1', 'environment_cache_millis': '0', 'flink_job_server_jar': '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.32.0-SNAPSHOT.jar',> 'flink_submit_uber_jar': True}
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating state cache with size 0
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure control channel for localhost:44961.
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Control channel established.
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Initializing SDKHarness with unbounded number of workers.
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Python sdk harness starting.
Jul 06, 2021 6:21:24 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService control
INFO: Beam Fn Control client connected with id 1-1
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-2
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-5
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-4
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-3
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure state channel for localhost:44921.
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: State channel established.
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating client data channel for localhost:34263
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO: Beam Fn Data client connected.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2972>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (2a487d58e79d50c459f6343e5208598a) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2972>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (2a487d58e79d50c459f6343e5208598a).
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: Partition (1/1)#0 (3979ad1c415696ac96e7ae9f17113ea6) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (fb8d2abf62468c0378d5b6ea70c1537e) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for Partition (1/1)#0 (3979ad1c415696ac96e7ae9f17113ea6).
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2972>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 2a487d58e79d50c459f6343e5208598a.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (fb8d2abf62468c0378d5b6ea70c1537e).
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (fc1da046704605ca97069869d1d9fe05) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (fc1da046704605ca97069869d1d9fe05).
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task Partition (1/1)#0 3979ad1c415696ac96e7ae9f17113ea6.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 fb8d2abf62468c0378d5b6ea70c1537e.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 fc1da046704605ca97069869d1d9fe05.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (75a664688f01366babfd9bfd94a68ae5) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (75a664688f01366babfd9bfd94a68ae5).
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 75a664688f01366babfd9bfd94a68ae5.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 (b3430c156098cebcb268928ea49660cf) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 (b3430c156098cebcb268928ea49660cf).
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 b3430c156098cebcb268928ea49660cf.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2972>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (2a487d58e79d50c459f6343e5208598a) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (3979ad1c415696ac96e7ae9f17113ea6) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (fb8d2abf62468c0378d5b6ea70c1537e) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (fc1da046704605ca97069869d1d9fe05) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1) (75a664688f01366babfd9bfd94a68ae5) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1) (b3430c156098cebcb268928ea49660cf) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.6_sdk:2.32.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.6_sdk:2.32.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-be1034c4-81a5-49ca-8eeb-1015abe467f4/31d521c5cfd085025926357feb1c692a85d9edbf6ab2d4ae232fef615a451733-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Jul 06, 2021 6:21:25 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Jul 06, 2021 6:21:25 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Jul 06, 2021 6:21:25 AM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container 8237c0063800daf3aa75c996c517d2838a4df2fa11935bbc815ebcdcd3d8af47. Logs:
2021/07/06 06:21:22 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:allow_unsafe_triggers:v1" value:{bool_value:true}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_options:v1" value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.6_sdk:2.32.0.dev"}}}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"DOCKER"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.32.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:true}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.13"}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-0706062112-4864b721"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:options_id:v1" value:{number_value:1}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:true}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:spark_version:v1" value:{string_value:"2"}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}}} retrieval_token:"__no_artifacts_staged__" logging_endpoint:{url:"localhost:34845"} artifact_endpoint:{url:"localhost:34097"} control_endpoint:{url:"localhost:44961"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-be1034c4-81a5-49ca-8eeb-1015abe467f4/31d521c5cfd085025926357feb1c692a85d9edbf6ab2d4ae232fef615a451733-pickled_main_session" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x14pickled_main_session"}
2021/07/06 06:21:22 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:37171
2021/07/06 06:21:23 Downloaded: /tmp/staged/pickled_main_session (sha256: 9a2e8f98f45b496bad4387afdaec97f805e3fb7e7bb5baff5dd53cf2e1cff70d, size: 2760)
2021/07/06 06:21:23 Found artifact: pickled_main_session
2021/07/06 06:21:23 Installing setup packages ...
2021/07/06 06:21:23 Executing: python -m apache_beam.runners.worker.sdk_worker_main
2021/07/06 06:21:25 Python exited: <nil>
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (abdb33d5d11356b42eaf9438bdcc541c) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (bc0962607966e63091fa7557932466bb) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (abdb33d5d11356b42eaf9438bdcc541c).
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (bc0962607966e63091fa7557932466bb).
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 bc0962607966e63091fa7557932466bb.
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 abdb33d5d11356b42eaf9438bdcc541c.
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (bc0962607966e63091fa7557932466bb) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1) (abdb33d5d11356b42eaf9438bdcc541c) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 098dbc252b6d9c6dfe3b053560684a40
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0706062112-4864b721 (098dbc252b6d9c6dfe3b053560684a40) switched from state RUNNING to FINISHED.
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job 098dbc252b6d9c6dfe3b053560684a40 reached terminal state FINISHED.
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0706062112-4864b721(098dbc252b6d9c6dfe3b053560684a40).
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [f06659c0bf0f44161b8f72672cde1cab].
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection bdb2ef2b8ccecf3e7b937a560bfbf683: Stopping JobMaster for job BeamApp-jenkins-0706062112-4864b721(098dbc252b6d9c6dfe3b053560684a40)..
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: f06659c0bf0f44161b8f72672cde1cab, jobId: 098dbc252b6d9c6dfe3b053560684a40).
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 098dbc252b6d9c6dfe3b053560684a40
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager b5b059c335b2341ba6207f89f77e4c7f@akka://flink/user/rpc/jobmanager_3 for job 098dbc252b6d9c6dfe3b053560684a40 from the resource manager.
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job 098dbc252b6d9c6dfe3b053560684a40 from job leader monitoring.
Jul 06, 2021 6:21:28 AM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 098dbc252b6d9c6dfe3b053560684a40.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
Jul 06, 2021 6:21:32 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jul 06, 2021 6:21:32 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 213
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 213
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 21m 2s
151 actionable tasks: 109 executed, 39 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/h5rrmioyv3vdg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_PortableJar_Flink
#3811
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3811/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #3810
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3810/display/redirect>
Changes:
------------------------------------------
[...truncated 394.92 KB...]
rm -rf "$ENV_DIR"
Jul 06, 2021 6:21:46 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jul 06, 2021 6:21:46 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Jul 06, 2021 6:21:46 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
> Task :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService logging
INFO: Beam Fn Logging client connected.
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Logging handler created.
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: semi_persistent_directory: /tmp
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
WARNING: Discarding unparseable args: ['--app_name=None', '--direct_runner_use_stacked_bundle', '--job_server_timeout=60', '--options_id=1', '--parallelism=1', '--pipeline_type_check']
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Pipeline_options: {'job_name': 'BeamApp-jenkins-0706182117-91e3e8a8', 'experiments': ['beam_fn_api'], 'save_main_session': True, 'sdk_location': 'container', 'environment_type': 'DOCKER', 'environment_options': ['docker_container_image=apache/beam_python3.6_sdk:2.32.0.dev'], 'sdk_worker_parallelism': '1', 'environment_cache_millis': '0', 'flink_job_server_jar': '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.32.0-SNAPSHOT.jar',> 'flink_submit_uber_jar': True}
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating state cache with size 0
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure control channel for localhost:38553.
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Control channel established.
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Initializing SDKHarness with unbounded number of workers.
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Python sdk harness starting.
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService control
INFO: Beam Fn Control client connected with id 1-1
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-4
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-2
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-5
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-3
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure state channel for localhost:39101.
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: State channel established.
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating client data channel for localhost:35681
Jul 06, 2021 6:21:36 PM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO: Beam Fn Data client connected.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2972>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (eb9f73fa4b7c713a1ff22c2ed417972e) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2972>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (eb9f73fa4b7c713a1ff22c2ed417972e).
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: Partition (1/1)#0 (1164f72ec9d43858ff4512f29b0f9bcb) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for Partition (1/1)#0 (1164f72ec9d43858ff4512f29b0f9bcb).
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2972>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 eb9f73fa4b7c713a1ff22c2ed417972e.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (270f01ca743ed5c2d3b6e7eb53880b61) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (270f01ca743ed5c2d3b6e7eb53880b61).
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (6567566afa6f95c775ef7ca77b01148b) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (6567566afa6f95c775ef7ca77b01148b).
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task Partition (1/1)#0 1164f72ec9d43858ff4512f29b0f9bcb.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 270f01ca743ed5c2d3b6e7eb53880b61.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 6567566afa6f95c775ef7ca77b01148b.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (3a89898acedc3c36914f2b58dd868756) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (3a89898acedc3c36914f2b58dd868756).
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 3a89898acedc3c36914f2b58dd868756.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2972>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (eb9f73fa4b7c713a1ff22c2ed417972e) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (1164f72ec9d43858ff4512f29b0f9bcb) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 (8ef82197f9d3be13c1e57922048eec15) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 (8ef82197f9d3be13c1e57922048eec15).
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 8ef82197f9d3be13c1e57922048eec15.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (270f01ca743ed5c2d3b6e7eb53880b61) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (6567566afa6f95c775ef7ca77b01148b) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1) (3a89898acedc3c36914f2b58dd868756) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1) (8ef82197f9d3be13c1e57922048eec15) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:37 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.6_sdk:2.32.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.6_sdk:2.32.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-4a24ccc2-d959-49eb-8cab-5003551ddb3d/a7ff90432286cd5d9dc3d1d7762837b3837d01b390038e9a2694159d01e7bf81-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
Jul 06, 2021 6:21:37 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Jul 06, 2021 6:21:37 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Jul 06, 2021 6:21:37 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container 3bb09c61082a68aa25a371d4df6c33f30e30a549c2d9fa6008f1b638ebd8a94d. Logs:
2021/07/06 18:21:34 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:allow_unsafe_triggers:v1" value:{bool_value:true}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_options:v1" value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.6_sdk:2.32.0.dev"}}}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"DOCKER"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.32.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:true}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.13"}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-0706182117-91e3e8a8"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:options_id:v1" value:{number_value:1}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:true}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:spark_version:v1" value:{string_value:"2"}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}}} retrieval_token:"__no_artifacts_staged__" logging_endpoint:{url:"localhost:46645"} artifact_endpoint:{url:"localhost:37763"} control_endpoint:{url:"localhost:38553"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-4a24ccc2-d959-49eb-8cab-5003551ddb3d/a7ff90432286cd5d9dc3d1d7762837b3837d01b390038e9a2694159d01e7bf81-pickled_main_session" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x14pickled_main_session"}
2021/07/06 18:21:34 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:44143
2021/07/06 18:21:34 Downloaded: /tmp/staged/pickled_main_session (sha256: 9a2e8f98f45b496bad4387afdaec97f805e3fb7e7bb5baff5dd53cf2e1cff70d, size: 2760)
2021/07/06 18:21:34 Found artifact: pickled_main_session
2021/07/06 18:21:34 Installing setup packages ...
2021/07/06 18:21:34 Executing: python -m apache_beam.runners.worker.sdk_worker_main
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (2d21a65bb97e5d993c5d81e36d652653) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (2d21a65bb97e5d993c5d81e36d652653).
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 2d21a65bb97e5d993c5d81e36d652653.
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (e85eb937adc4590c8b5eb4314e82f520) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (e85eb937adc4590c8b5eb4314e82f520).
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 e85eb937adc4590c8b5eb4314e82f520.
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1) (2d21a65bb97e5d993c5d81e36d652653) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (e85eb937adc4590c8b5eb4314e82f520) switched from RUNNING to FINISHED.
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job c7d72af7bdeee9c79f1e360ad689b4e1
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0706182117-91e3e8a8 (c7d72af7bdeee9c79f1e360ad689b4e1) switched from state RUNNING to FINISHED.
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job c7d72af7bdeee9c79f1e360ad689b4e1 reached terminal state FINISHED.
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0706182117-91e3e8a8(c7d72af7bdeee9c79f1e360ad689b4e1).
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [2b3292f72dfe5aea5844825efae0a199].
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 855ba851f872226957a6ae8bcfd19a7d: Stopping JobMaster for job BeamApp-jenkins-0706182117-91e3e8a8(c7d72af7bdeee9c79f1e360ad689b4e1)..
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: 2b3292f72dfe5aea5844825efae0a199, jobId: c7d72af7bdeee9c79f1e360ad689b4e1).
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job c7d72af7bdeee9c79f1e360ad689b4e1
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager b4e3bd61d588fe912b6a3f2e67914fee@akka://flink/user/rpc/jobmanager_3 for job c7d72af7bdeee9c79f1e360ad689b4e1 from the resource manager.
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job c7d72af7bdeee9c79f1e360ad689b4e1 from job leader monitoring.
Jul 06, 2021 6:21:41 PM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job c7d72af7bdeee9c79f1e360ad689b4e1.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
Jul 06, 2021 6:21:46 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jul 06, 2021 6:21:46 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jul 06, 2021 6:21:46 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
>>> SUCCESS
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 213
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 213
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 21m 20s
151 actionable tasks: 109 executed, 39 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/ncskeq7v5dvby
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #3809
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3809/display/redirect>
Changes:
------------------------------------------
[...truncated 416.25 KB...]
Jul 06, 2021 12:25:08 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 1bd5afb4b215a4b3f42ea9bdbde358b4.
Jul 06, 2021 12:25:08 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 (5e2c384d1cfa49c6090da70a018cffa4) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:08 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 (5e2c384d1cfa49c6090da70a018cffa4).
Jul 06, 2021 12:25:08 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 5e2c384d1cfa49c6090da70a018cffa4.
Jul 06, 2021 12:25:08 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (c029384627e305d07915cae9a4643664) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:08 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (b2b5df3f836baef308cf4d576e8909b1) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:08 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2972>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (175d1d5bb4d2d76e72a2bd9a4f959e5d) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:08 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (21b7637b1f27eb456095fdfc492c66f3) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:08 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1) (1bd5afb4b215a4b3f42ea9bdbde358b4) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:08 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1) (5e2c384d1cfa49c6090da70a018cffa4) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:08 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.6_sdk:2.32.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.6_sdk:2.32.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-189adae0-a7c3-4b75-9128-a83c92e9a362/10aac7d81306a37a31b5664c2d1b0af49a88d53544de627578b192e7cbe958ba-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
Jul 06, 2021 12:25:08 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Jul 06, 2021 12:25:08 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Jul 06, 2021 12:25:08 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Jul 06, 2021 12:25:09 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container 2cc7146795b1fe918718d3d9f28aa78094daa28d49820eb9fcdf8141b71c8fa5. Logs:
2021/07/06 12:25:06 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:allow_unsafe_triggers:v1" value:{bool_value:true}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_options:v1" value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.6_sdk:2.32.0.dev"}}}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"DOCKER"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.32.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:true}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.13"}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-0706122449-4bf047af"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:options_id:v1" value:{number_value:1}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:true}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:spark_version:v1" value:{string_value:"2"}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}}} retrieval_token:"__no_artifacts_staged__" logging_endpoint:{url:"localhost:39975"} artifact_endpoint:{url:"localhost:45461"} control_endpoint:{url:"localhost:46803"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-189adae0-a7c3-4b75-9128-a83c92e9a362/10aac7d81306a37a31b5664c2d1b0af49a88d53544de627578b192e7cbe958ba-pickled_main_session" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x14pickled_main_session"}
2021/07/06 12:25:06 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:44199
2021/07/06 12:25:06 Downloaded: /tmp/staged/pickled_main_session (sha256: 9a2e8f98f45b496bad4387afdaec97f805e3fb7e7bb5baff5dd53cf2e1cff70d, size: 2760)
2021/07/06 12:25:06 Found artifact: pickled_main_session
2021/07/06 12:25:06 Installing setup packages ...
2021/07/06 12:25:06 Executing: python -m apache_beam.runners.worker.sdk_worker_main
2021/07/06 12:25:09 Python exited: <nil>
Jul 06, 2021 12:25:09 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient close
WARNING: Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.6_sdk:2.32.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.6_sdk:2.32.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-189adae0-a7c3-4b75-9128-a83c92e9a362/10aac7d81306a37a31b5664c2d1b0af49a88d53544de627578b192e7cbe958ba-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
java.io.IOException: Received exit code 1 for command 'docker kill 2cc7146795b1fe918718d3d9f28aa78094daa28d49820eb9fcdf8141b71c8fa5'. stderr: Error response from daemon: Cannot kill container: 2cc7146795b1fe918718d3d9f28aa78094daa28d49820eb9fcdf8141b71c8fa5: Container 2cc7146795b1fe918718d3d9f28aa78094daa28d49820eb9fcdf8141b71c8fa5 is not running
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:237)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:171)
at org.apache.beam.runners.fnexecution.environment.DockerCommand.killContainer(DockerCommand.java:151)
at org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:93)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:642)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:642)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:658)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:589)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:212)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:319)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:212)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:188)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:177)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:268)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:373)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:524)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:360)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
at java.lang.Thread.run(Thread.java:748)
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (94582ad8d89f6dde39119a47057284ec) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (94582ad8d89f6dde39119a47057284ec).
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (db96217c90e98c4f8bb2a50a639d4b5e) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (db96217c90e98c4f8bb2a50a639d4b5e).
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 94582ad8d89f6dde39119a47057284ec.
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 db96217c90e98c4f8bb2a50a639d4b5e.
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1) (94582ad8d89f6dde39119a47057284ec) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (db96217c90e98c4f8bb2a50a639d4b5e) switched from RUNNING to FINISHED.
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 3d05eb596532c4e0d1da1811702aa3cf
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0706122449-4bf047af (3d05eb596532c4e0d1da1811702aa3cf) switched from state RUNNING to FINISHED.
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job 3d05eb596532c4e0d1da1811702aa3cf reached terminal state FINISHED.
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0706122449-4bf047af(3d05eb596532c4e0d1da1811702aa3cf).
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [b4d43ffaa535c4fd689a3819c1713b91].
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 79033c96dcde092074b9ab601e4280aa: Stopping JobMaster for job BeamApp-jenkins-0706122449-4bf047af(3d05eb596532c4e0d1da1811702aa3cf)..
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: b4d43ffaa535c4fd689a3819c1713b91, jobId: 3d05eb596532c4e0d1da1811702aa3cf).
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 3d05eb596532c4e0d1da1811702aa3cf
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager a65d4ccf13ccb9de3f8bef098de64762@akka://flink/user/rpc/jobmanager_3 for job 3d05eb596532c4e0d1da1811702aa3cf from the resource manager.
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job 3d05eb596532c4e0d1da1811702aa3cf from job leader monitoring.
Jul 06, 2021 12:25:09 PM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 3d05eb596532c4e0d1da1811702aa3cf.
Jul 06, 2021 12:25:10 PM org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.DefaultPromise safeExecute
SEVERE: Failed to submit a listener notification task. Event loop shut down?
java.lang.IllegalAccessError: tried to access class org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.GlobalEventExecutor$2 from class org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.GlobalEventExecutor
at org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.GlobalEventExecutor.startThread(GlobalEventExecutor.java:220)
at org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.GlobalEventExecutor.execute(GlobalEventExecutor.java:208)
at org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.DefaultPromise.safeExecute(DefaultPromise.java:841)
at org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:498)
at org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:615)
at org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:604)
at org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.DefaultPromise.setSuccess(DefaultPromise.java:96)
at org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:1051)
at org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.beam.vendor.grpc.v1p36p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
Jul 06, 2021 12:25:13 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jul 06, 2021 12:25:13 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Jul 06, 2021 12:25:13 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 213
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 213
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 24m 45s
151 actionable tasks: 109 executed, 39 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/ie6glxemydhmg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org