You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/01/25 00:16:22 UTC
Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #4618
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4618/display/redirect?page=changes>
Changes:
[mmack] [BEAM-13653] Make SnsIO.write topicArn optional. If provided, validate
[noreply] [BEAM-10897] Update the fastavro lower bound due to an issue on Windows
[noreply] [BEAM-13605] Update pandas_doctests_test denylists in preparation for
[noreply] Merge pull request #16538 from [BEAM-13676][Playground][Bugfix]Build Of
[noreply] Merge pull request #16582 from [BEAM-13711] [Playground] [Bugfix] Add
[noreply] Merge pull request #16515 from [BEAM-13636] [Playground] Checking the
[ningkang0957] [BEAM-13275] Removed the explicit selenium dependency from setup
[noreply] [BEAM-10206] Deprecate unused shallow cloning functions (#16600)
------------------------------------------
[...truncated 522.08 KB...]
WARNING: Discarding unparseable args: ['--app_name=None', '--direct_runner_use_stacked_bundle', '--job_server_timeout=60', '--options_id=1', '--parallelism=1', '--pipeline_type_check']
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Pipeline_options: {'job_name': 'BeamApp-jenkins-0125001548-da531429', 'experiments': ['beam_fn_api'], 'save_main_session': True, 'sdk_location': 'container', 'environment_type': 'DOCKER', 'environment_options': ['docker_container_image=apache/beam_python3.6_sdk:2.37.0.dev'], 'sdk_worker_parallelism': '1', 'environment_cache_millis': '0', 'flink_job_server_jar': '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.37.0-SNAPSHOT.jar',> 'flink_submit_uber_jar': True}
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating state cache with size 0
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure control channel for localhost:33015.
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Control channel established.
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Initializing SDKHarness with unbounded number of workers.
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService control
INFO: Beam Fn Control client connected with id 1-1
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Python sdk harness starting.
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-3
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-2
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-4
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-5
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure state channel for localhost:35141.
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: State channel established.
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating client data channel for localhost:41105
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO: Beam Fn Data client connected.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:3228>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (8c160651a4cc363e8c7917039a4d8e32) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (ddeb83ed2bf3ea19a76df380db7799d3) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:3228>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (8c160651a4cc363e8c7917039a4d8e32).
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (ddeb83ed2bf3ea19a76df380db7799d3).
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: Partition (1/1)#0 (d516c3bfab40ea916b581d8a15dfa611) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for Partition (1/1)#0 (d516c3bfab40ea916b581d8a15dfa611).
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 ddeb83ed2bf3ea19a76df380db7799d3.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (5aec67bfb3588d006480aa35a44b57d7) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (5aec67bfb3588d006480aa35a44b57d7).
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:3228>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 8c160651a4cc363e8c7917039a4d8e32.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task Partition (1/1)#0 d516c3bfab40ea916b581d8a15dfa611.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 5aec67bfb3588d006480aa35a44b57d7.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (5d05a58302de9e6e5a0ac6582192c9bf) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (5d05a58302de9e6e5a0ac6582192c9bf).
Jan 25, 2022 12:16:14 AM org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory createBuilder
INFO: The AWS S3 Beam extension was included in this build, but the awsRegion flag was not specified. If you don't plan to use S3, then ignore this message.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 5d05a58302de9e6e5a0ac6582192c9bf.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1)#0 (23c9a45542cfec748567703209454f48) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1)#0 (23c9a45542cfec748567703209454f48).
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1)#0 23c9a45542cfec748567703209454f48.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (ddeb83ed2bf3ea19a76df380db7799d3) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:3228>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (8c160651a4cc363e8c7917039a4d8e32) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (d516c3bfab40ea916b581d8a15dfa611) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (5aec67bfb3588d006480aa35a44b57d7) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1) (5d05a58302de9e6e5a0ac6582192c9bf) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1) (23c9a45542cfec748567703209454f48) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.6_sdk:2.37.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.6_sdk:2.37.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:sibling_workers:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-cb0b67f6-e985-4abe-bcdf-34608e2c2e38/325083ea805520e65d3cc8dc64ddc00abda13bc391104b2f2cb843e6c303ea1d-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Jan 25, 2022 12:16:14 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Jan 25, 2022 12:16:14 AM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container 53a41b658ac445b09ac28f3ca6cce6454cc701dced75085cd9a6aca3d2bffc8f. Logs:
2022/01/25 00:16:12 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:allow_unsafe_triggers:v1" value:{bool_value:false}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_artifact_caching:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_options:v1" value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.6_sdk:2.37.0.dev"}}}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"DOCKER"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.37.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:true}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.13"}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-0125001548-da531429"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:options_id:v1" value:{number_value:1}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pickle_library:v1" value:{string_value:"default"}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:true}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:spark_version:v1" value:{string_value:"2"}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}}} retrieval_token:"__no_artifacts_staged__" logging_endpoint:{url:"localhost:45403"} artifact_endpoint:{url:"localhost:34961"} control_endpoint:{url:"localhost:33015"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-cb0b67f6-e985-4abe-bcdf-34608e2c2e38/325083ea805520e65d3cc8dc64ddc00abda13bc391104b2f2cb843e6c303ea1d-pickled_main_session" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x14pickled_main_session"}
2022/01/25 00:16:12 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:39977
2022/01/25 00:16:12 Downloaded: /tmp/staged/pickled_main_session (sha256: ca736bfe4c207a2aa08bb11fafe796c1708effaf4ea1b86fe26efbb35e151a4a, size: 2814)
2022/01/25 00:16:12 Found artifact: pickled_main_session
2022/01/25 00:16:12 Installing setup packages ...
2022/01/25 00:16:12 Executing: python -m apache_beam.runners.worker.sdk_worker_main
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (d3a56d03a0088cadd71bb663860d62cd) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (d3a56d03a0088cadd71bb663860d62cd).
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (583dba6ce13adc0962006eb2bac9fc67) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (583dba6ce13adc0962006eb2bac9fc67).
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 d3a56d03a0088cadd71bb663860d62cd.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 583dba6ce13adc0962006eb2bac9fc67.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1) (d3a56d03a0088cadd71bb663860d62cd) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (583dba6ce13adc0962006eb2bac9fc67) switched from RUNNING to FINISHED.
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job c6161d0a3a6825796e6d28ca8e667212
Jan 25, 2022 12:16:14 AM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0125001548-da531429 (c6161d0a3a6825796e6d28ca8e667212) switched from state RUNNING to FINISHED.
Jan 25, 2022 12:16:15 AM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job c6161d0a3a6825796e6d28ca8e667212 reached terminal state FINISHED.
Jan 25, 2022 12:16:15 AM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0125001548-da531429(c6161d0a3a6825796e6d28ca8e667212).
Jan 25, 2022 12:16:15 AM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [463d810165be8559b26b035bf829d79a].
Jan 25, 2022 12:16:15 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 577886b117f0468c44b2cec76f60bc85: Stopping JobMaster for job BeamApp-jenkins-0125001548-da531429(c6161d0a3a6825796e6d28ca8e667212)..
Jan 25, 2022 12:16:15 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: 463d810165be8559b26b035bf829d79a, jobId: c6161d0a3a6825796e6d28ca8e667212).
Jan 25, 2022 12:16:15 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager b3fd3c0a3ba82095f4df44fbae7b4fee@akka://flink/user/rpc/jobmanager_3 for job c6161d0a3a6825796e6d28ca8e667212 from the resource manager.
Jan 25, 2022 12:16:15 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job c6161d0a3a6825796e6d28ca8e667212 from job leader monitoring.
Jan 25, 2022 12:16:15 AM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job c6161d0a3a6825796e6d28ca8e667212.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
Jan 25, 2022 12:16:18 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jan 25, 2022 12:16:18 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
> Task :sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
Jan 25, 2022 12:16:19 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jan 25, 2022 12:16:19 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
>>> SUCCESS
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 335
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 335
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 15m 48s
156 actionable tasks: 109 executed, 42 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/3q5lhd6vv3w42
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_PortableJar_Flink #4620
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4620/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #4619
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4619/display/redirect?page=changes>
Changes:
[Heejong Lee] [BEAM-13716] Clear before creating a new virtual environment in
[noreply] Bump Dataflow container versions (#16602)
[noreply] Improved multi-language pipelines section of the programming guide
------------------------------------------
[...truncated 481.28 KB...]
Jan 25, 2022 6:21:54 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:3228>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (47c6d3d499c70aebfc8e2d50bb87166f) switched from RUNNING to FINISHED.
Jan 25, 2022 6:21:54 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (79fe3e879cb1b7330d5d2522d0791212) switched from RUNNING to FINISHED.
Jan 25, 2022 6:21:54 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (867c1ccee5f8cd46e7c6574935aafb05) switched from RUNNING to FINISHED.
Jan 25, 2022 6:21:54 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (1577a6cb0cb1f43fab0edf1c2c2745c6) switched from RUNNING to FINISHED.
Jan 25, 2022 6:21:54 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (1/1) (47a2edf306fbb48ca13984ff5b6a2f68) switched from RUNNING to FINISHED.
Jan 25, 2022 6:21:54 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/CoGroupByKeyImpl/GroupByKey) (1/1) (81755f8a67a720d239a49d404c80b139) switched from RUNNING to FINISHED.
Jan 25, 2022 6:21:54 AM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.7_sdk:2.37.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.37.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:sibling_workers:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-0321b8b9-32b2-4432-9a54-cb0d281c1e0f/9e6195f753d1ffee4cdd1dd22456ec950f5d2d9fad03ae4d81ccf468713a8277-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
Jan 25, 2022 6:21:54 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Jan 25, 2022 6:21:54 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Jan 25, 2022 6:21:54 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Jan 25, 2022 6:21:54 AM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container dc70d8ad63ae86e740cfe9f5f8a2a1482a7aa7890f5f720c87810a197102cc08. Logs:
2022/01/25 06:21:52 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:allow_unsafe_triggers:v1" value:{bool_value:false}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_artifact_caching:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_options:v1" value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.7_sdk:2.37.0.dev"}}}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"DOCKER"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.37.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:true}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.13"}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-0125062126-52a8bc4a"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:options_id:v1" value:{number_value:1}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pickle_library:v1" value:{string_value:"default"}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:true}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:spark_version:v1" value:{string_value:"2"}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}}} retrieval_token:"__no_artifacts_staged__" logging_endpoint:{url:"localhost:41331"} artifact_endpoint:{url:"localhost:38511"} control_endpoint:{url:"localhost:45679"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-0321b8b9-32b2-4432-9a54-cb0d281c1e0f/9e6195f753d1ffee4cdd1dd22456ec950f5d2d9fad03ae4d81ccf468713a8277-pickled_main_session" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x14pickled_main_session"}
2022/01/25 06:21:52 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:38701
2022/01/25 06:21:52 Downloaded: /tmp/staged/pickled_main_session (sha256: d08637bbc9e4a9e7aa9f331b48e57e33fd7078d16aea619a033bebc832d974b0, size: 2814)
2022/01/25 06:21:52 Found artifact: pickled_main_session
2022/01/25 06:21:52 Installing setup packages ...
2022/01/25 06:21:52 Executing: python -m apache_beam.runners.worker.sdk_worker_main
Jan 25, 2022 6:21:55 AM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient close
WARNING: Error cleaning up servers urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.7_sdk:2.37.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.37.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
capabilities: "beam:protocol:sibling_workers:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-0321b8b9-32b2-4432-9a54-cb0d281c1e0f/9e6195f753d1ffee4cdd1dd22456ec950f5d2d9fad03ae4d81ccf468713a8277-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
java.lang.IllegalStateException: call already closed
at org.apache.beam.vendor.grpc.v1p43p2.com.google.common.base.Preconditions.checkState(Preconditions.java:510)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerCallImpl.closeInternal(ServerCallImpl.java:214)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerCallImpl.close(ServerCallImpl.java:207)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.stub.ServerCalls$ServerCallStreamObserverImpl.onCompleted(ServerCalls.java:395)
at org.apache.beam.runners.fnexecution.state.GrpcStateService.close(GrpcStateService.java:63)
at org.apache.beam.sdk.fn.server.GrpcFnServer.close(GrpcFnServer.java:156)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:642)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:642)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:658)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:589)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:212)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:319)
at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:212)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:188)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:177)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48)
at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:208)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:268)
at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:373)
at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:524)
at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:360)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
at java.lang.Thread.run(Thread.java:748)
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (9c4cd1e088190e0e0ac497627fc5f146) switched from RUNNING to FINISHED.
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (9c4cd1e088190e0e0ac497627fc5f146).
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (3fc18f7ecbb6555f07e2d7f1f07d9df7) switched from RUNNING to FINISHED.
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (3fc18f7ecbb6555f07e2d7f1f07d9df7).
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 9c4cd1e088190e0e0ac497627fc5f146.
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 3fc18f7ecbb6555f07e2d7f1f07d9df7.
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1) (9c4cd1e088190e0e0ac497627fc5f146) switched from RUNNING to FINISHED.
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (3fc18f7ecbb6555f07e2d7f1f07d9df7) switched from RUNNING to FINISHED.
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job bdc86783788dde6844e6503969780578
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0125062126-52a8bc4a (bdc86783788dde6844e6503969780578) switched from state RUNNING to FINISHED.
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job bdc86783788dde6844e6503969780578 reached terminal state FINISHED.
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0125062126-52a8bc4a(bdc86783788dde6844e6503969780578).
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [40bcbe0f07c977c204145564d73231c0].
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 7374ba26f73cb05ef9f1b7aa612db55d: Stopping JobMaster for job BeamApp-jenkins-0125062126-52a8bc4a(bdc86783788dde6844e6503969780578)..
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: 40bcbe0f07c977c204145564d73231c0, jobId: bdc86783788dde6844e6503969780578).
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager 9894476c08cd869ddd99116a94354266@akka://flink/user/rpc/jobmanager_3 for job bdc86783788dde6844e6503969780578 from the resource manager.
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job bdc86783788dde6844e6503969780578 from job leader monitoring.
Jan 25, 2022 6:21:55 AM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job bdc86783788dde6844e6503969780578.
Jan 25, 2022 6:21:55 AM org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.DefaultPromise safeExecute
SEVERE: Failed to submit a listener notification task. Event loop shut down?
java.lang.IllegalAccessError: tried to access class org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.GlobalEventExecutor$2 from class org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.GlobalEventExecutor
at org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.GlobalEventExecutor.startThread(GlobalEventExecutor.java:220)
at org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.GlobalEventExecutor.execute(GlobalEventExecutor.java:208)
at org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.DefaultPromise.safeExecute(DefaultPromise.java:842)
at org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:499)
at org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:616)
at org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:605)
at org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.DefaultPromise.setSuccess(DefaultPromise.java:96)
at org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:1051)
at org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.beam.vendor.grpc.v1p43p2.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
Jan 25, 2022 6:21:57 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jan 25, 2022 6:21:57 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
>>> SUCCESS
exit $TEST_EXIT_CODE
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 335
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 335
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 21m 26s
156 actionable tasks: 109 executed, 42 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/lzvsaqn266oaa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org