You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/05/13 12:19:14 UTC
Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #3614
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3614/display/redirect>
Changes:
------------------------------------------
[...truncated 381.58 KB...]
WARNING: Discarding unparseable args: ['--app_name=None', '--direct_runner_use_stacked_bundle', '--job_server_timeout=60', '--options_id=1', '--parallelism=1', '--pipeline_type_check']
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Pipeline_options: {'job_name': 'BeamApp-jenkins-0513121844-602d8ee6', 'experiments': ['beam_fn_api'], 'save_main_session': True, 'sdk_location': 'container', 'environment_type': 'DOCKER', 'environment_options': ['docker_container_image=apache/beam_python3.7_sdk:2.31.0.dev'], 'sdk_worker_parallelism': '1', 'environment_cache_millis': '0', 'flink_job_server_jar': '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.12/job-server/build/libs/beam-runners-flink-1.12-job-server-2.31.0-SNAPSHOT.jar',> 'flink_submit_uber_jar': True}
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating state cache with size 0
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure control channel for localhost:39117.
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Control channel established.
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Initializing SDKHarness with unbounded number of workers.
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Python sdk harness starting.
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService control
INFO: Beam Fn Control client connected with id 1-1
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Status HTTP server running at localhost:45427
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-5
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-4
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-2
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-3
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure state channel for localhost:36931.
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: State channel established.
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating client data channel for localhost:45127
May 13, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO: Beam Fn Data client connected.
May 13, 2021 12:19:02 PM org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate convertRecoveredInputChannels
INFO: Converting recovered input channels (1 channels)
May 13, 2021 12:19:02 PM org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate convertRecoveredInputChannels
INFO: Converting recovered input channels (1 channels)
May 13, 2021 12:19:02 PM org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate convertRecoveredInputChannels
INFO: Converting recovered input channels (1 channels)
May 13, 2021 12:19:02 PM org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate convertRecoveredInputChannels
INFO: Converting recovered input channels (1 channels)
May 13, 2021 12:19:02 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (565d0763b9105c97db07771a6e5cc3ce) switched from RUNNING to FINISHED.
May 13, 2021 12:19:02 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2930>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (35b3165d0645a9c4636118c9181391d4) switched from RUNNING to FINISHED.
May 13, 2021 12:19:02 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: Partition (1/1)#0 (d68a9735d0778ab7b3a0b1088b84be73) switched from RUNNING to FINISHED.
May 13, 2021 12:19:02 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (565d0763b9105c97db07771a6e5cc3ce).
May 13, 2021 12:19:02 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2930>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (35b3165d0645a9c4636118c9181391d4).
May 13, 2021 12:19:02 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for Partition (1/1)#0 (d68a9735d0778ab7b3a0b1088b84be73).
May 13, 2021 12:19:02 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 565d0763b9105c97db07771a6e5cc3ce.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (7005dd7a14c09cc1637f6cefd7a99a51) switched from RUNNING to FINISHED.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (7005dd7a14c09cc1637f6cefd7a99a51).
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task Partition (1/1)#0 d68a9735d0778ab7b3a0b1088b84be73.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2930>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 35b3165d0645a9c4636118c9181391d4.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 7005dd7a14c09cc1637f6cefd7a99a51.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)#0 (81c9143b779f010f8561cd0ef52a9ca9) switched from RUNNING to FINISHED.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)#0 (81c9143b779f010f8561cd0ef52a9ca9).
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)#0 81c9143b779f010f8561cd0ef52a9ca9.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)#0 (b91cdfe6b8879127aae936fa9be079a1) switched from RUNNING to FINISHED.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)#0 (b91cdfe6b8879127aae936fa9be079a1).
May 13, 2021 12:19:03 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)#0 b91cdfe6b8879127aae936fa9be079a1.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (565d0763b9105c97db07771a6e5cc3ce) switched from RUNNING to FINISHED.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (d68a9735d0778ab7b3a0b1088b84be73) switched from RUNNING to FINISHED.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2930>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (35b3165d0645a9c4636118c9181391d4) switched from RUNNING to FINISHED.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (7005dd7a14c09cc1637f6cefd7a99a51) switched from RUNNING to FINISHED.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1) (81c9143b779f010f8561cd0ef52a9ca9) switched from RUNNING to FINISHED.
May 13, 2021 12:19:03 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1) (b91cdfe6b8879127aae936fa9be079a1) switched from RUNNING to FINISHED.
May 13, 2021 12:19:03 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.7_sdk:2.31.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.31.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-9c8599aa-ec18-47a3-8f61-3a983079e174/733c320d9570ac8e4b228d4a8eab0437b7f096edd9c19928788455927ac6e748-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
May 13, 2021 12:19:03 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
May 13, 2021 12:19:03 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
May 13, 2021 12:19:03 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
May 13, 2021 12:19:03 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container 6660c99e2ea1e092def0dc7238c8e1c6708684d05635c434cc2cd1a32178b76f. Logs:
2021/05/13 12:19:01 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_options:v1" value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.7_sdk:2.31.0.dev"}}}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"DOCKER"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.12/job-server/build/libs/beam-runners-flink-1.12-job-server-2.31.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:true}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.12"}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-0513121844-602d8ee6"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:options_id:v1" value:{number_value:1}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:true}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}}} retrieval_token:"__no_artifacts_staged__" logging_endpoint:{url:"localhost:43531"} artifact_endpoint:{url:"localhost:32813"} control_endpoint:{url:"localhost:39117"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-9c8599aa-ec18-47a3-8f61-3a983079e174/733c320d9570ac8e4b228d4a8eab0437b7f096edd9c19928788455927ac6e748-pickled_main_session" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x14pickled_main_session"}
2021/05/13 12:19:01 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:39701
2021/05/13 12:19:01 Downloaded: /tmp/staged/pickled_main_session (sha256: 646aa5c451d3a02da32f3d3a12b7e249f1f6dac08d7b6d1c4fe3a02b62be3ed7, size: 2731)
2021/05/13 12:19:01 Found artifact: pickled_main_session
2021/05/13 12:19:01 Installing setup packages ...
2021/05/13 12:19:01 Executing: python -m apache_beam.runners.worker.sdk_worker_main
2021/05/13 12:19:03 Python exited: <nil>
May 13, 2021 12:19:06 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 (34b9c3c5d7ded64b354886a46aeca85f) switched from RUNNING to FINISHED.
May 13, 2021 12:19:06 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 (34b9c3c5d7ded64b354886a46aeca85f).
May 13, 2021 12:19:06 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (68ecf0bf90d0aed72cc95197191e6f92) switched from RUNNING to FINISHED.
May 13, 2021 12:19:06 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (68ecf0bf90d0aed72cc95197191e6f92).
May 13, 2021 12:19:06 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 34b9c3c5d7ded64b354886a46aeca85f.
May 13, 2021 12:19:06 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 68ecf0bf90d0aed72cc95197191e6f92.
May 13, 2021 12:19:06 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1) (34b9c3c5d7ded64b354886a46aeca85f) switched from RUNNING to FINISHED.
May 13, 2021 12:19:06 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (68ecf0bf90d0aed72cc95197191e6f92) switched from RUNNING to FINISHED.
May 13, 2021 12:19:06 PM org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0513121844-602d8ee6 (9024830cb3d84fd653c10bc1d61f0a3b) switched from state RUNNING to FINISHED.
May 13, 2021 12:19:06 PM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedGloballyTerminalState
INFO: Job 9024830cb3d84fd653c10bc1d61f0a3b reached globally terminal state FINISHED.
May 13, 2021 12:19:07 PM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0513121844-602d8ee6(9024830cb3d84fd653c10bc1d61f0a3b).
May 13, 2021 12:19:07 PM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl suspend
INFO: Suspending SlotPool.
May 13, 2021 12:19:07 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 91de511042ea2c922fd340df19590f3b: Stopping JobMaster for job BeamApp-jenkins-0513121844-602d8ee6(9024830cb3d84fd653c10bc1d61f0a3b)..
May 13, 2021 12:19:07 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: b0d37d1e1eb85050bf2a3d8043a3cdc0, jobId: 9024830cb3d84fd653c10bc1d61f0a3b).
May 13, 2021 12:19:07 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager 84641df798cd7a86a90ecc1d39f24258@akka://flink/user/rpc/jobmanager_3 for job 9024830cb3d84fd653c10bc1d61f0a3b from the resource manager.
May 13, 2021 12:19:07 PM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl close
INFO: Stopping SlotPool.
May 13, 2021 12:19:07 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job 9024830cb3d84fd653c10bc1d61f0a3b from job leader monitoring.
May 13, 2021 12:19:07 PM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 9024830cb3d84fd653c10bc1d61f0a3b.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
May 13, 2021 12:19:08 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
> Task :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
May 13, 2021 12:19:11 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
May 13, 2021 12:19:11 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 211
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 211
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 18m 42s
151 actionable tasks: 109 executed, 39 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/djq5f6mvo4w36
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_PortableJar_Flink
#3617
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3617/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #3616
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3616/display/redirect?page=changes>
Changes:
[randomstep] [BEAM-8644] Bump freemarker to 2.3.31
[Kyle Weaver] [BEAM-12332] [zetasql] Support NUMERIC type in Java UDF.
------------------------------------------
[...truncated 395.12 KB...]
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.31.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-53f83127-0eb7-42b4-a754-4bae5f1fb5c1/f1d2f271cb92a52d67254acd509878a27403e3e96ac39ab04f1e90564979d184-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
May 14, 2021 12:20:21 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
May 14, 2021 12:20:21 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
May 14, 2021 12:20:21 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
May 14, 2021 12:20:21 AM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container dcd5eb687d0f8659a15f4caa9579e2d6e331f67ba536fa823fac6ca3f687328b. Logs:
2021/05/14 00:20:20 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_options:v1" value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.7_sdk:2.31.0.dev"}}}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"DOCKER"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.12/job-server/build/libs/beam-runners-flink-1.12-job-server-2.31.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:true}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.12"}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-0514002000-a03bccc4"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:options_id:v1" value:{number_value:1}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:true}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}}} retrieval_token:"__no_artifacts_staged__" logging_endpoint:{url:"localhost:34823"} artifact_endpoint:{url:"localhost:46805"} control_endpoint:{url:"localhost:40267"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-53f83127-0eb7-42b4-a754-4bae5f1fb5c1/f1d2f271cb92a52d67254acd509878a27403e3e96ac39ab04f1e90564979d184-pickled_main_session" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x14pickled_main_session"}
2021/05/14 00:20:20 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:42789
2021/05/14 00:20:20 Downloaded: /tmp/staged/pickled_main_session (sha256: 646aa5c451d3a02da32f3d3a12b7e249f1f6dac08d7b6d1c4fe3a02b62be3ed7, size: 2731)
2021/05/14 00:20:20 Found artifact: pickled_main_session
2021/05/14 00:20:20 Installing setup packages ...
2021/05/14 00:20:20 Executing: python -m apache_beam.runners.worker.sdk_worker_main
2021/05/14 00:20:21 Python exited: <nil>
May 14, 2021 12:20:21 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 (3ffaffa7e4c152036b7c03f3204620a8) switched from RUNNING to FINISHED.
May 14, 2021 12:20:21 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 (3ffaffa7e4c152036b7c03f3204620a8).
May 14, 2021 12:20:21 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (a4e0a402d120eb238a6da0107a0633b5) switched from RUNNING to FINISHED.
May 14, 2021 12:20:21 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (a4e0a402d120eb238a6da0107a0633b5).
May 14, 2021 12:20:21 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 3ffaffa7e4c152036b7c03f3204620a8.
May 14, 2021 12:20:21 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 a4e0a402d120eb238a6da0107a0633b5.
May 14, 2021 12:20:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1) (3ffaffa7e4c152036b7c03f3204620a8) switched from RUNNING to FINISHED.
May 14, 2021 12:20:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (a4e0a402d120eb238a6da0107a0633b5) switched from RUNNING to FINISHED.
May 14, 2021 12:20:21 AM org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0514002000-a03bccc4 (a70a877edcf93c148dd17da1c6311815) switched from state RUNNING to FINISHED.
May 14, 2021 12:20:22 AM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedGloballyTerminalState
INFO: Job a70a877edcf93c148dd17da1c6311815 reached globally terminal state FINISHED.
May 14, 2021 12:20:22 AM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0514002000-a03bccc4(a70a877edcf93c148dd17da1c6311815).
May 14, 2021 12:20:22 AM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl suspend
INFO: Suspending SlotPool.
May 14, 2021 12:20:22 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 5b9233de9e1891a3e82821b680cea2e5: Stopping JobMaster for job BeamApp-jenkins-0514002000-a03bccc4(a70a877edcf93c148dd17da1c6311815)..
May 14, 2021 12:20:22 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: d04147b61f29e5a93f9de35939ed4874, jobId: a70a877edcf93c148dd17da1c6311815).
May 14, 2021 12:20:22 AM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl close
INFO: Stopping SlotPool.
May 14, 2021 12:20:22 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job a70a877edcf93c148dd17da1c6311815 from job leader monitoring.
May 14, 2021 12:20:22 AM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job a70a877edcf93c148dd17da1c6311815.
May 14, 2021 12:20:22 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager 8b618c63405ae5aa05687b2aa8a04c89@akka://flink/user/rpc/jobmanager_3 for job a70a877edcf93c148dd17da1c6311815 from the resource manager.
Exception in thread "grpc-nio-worker-ELG-3-6" java.lang.IllegalAccessError: tried to access class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena$1 from class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena.freeChunk(PoolArena.java:296)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.freeEntry(PoolThreadCache.java:464)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:430)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:422)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:279)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:270)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:241)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:477)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:444)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.remove(FastThreadLocal.java:256)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.removeAll(FastThreadLocal.java:67)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1081)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Exception in thread "grpc-nio-worker-ELG-3-2" java.lang.IllegalAccessError: tried to access class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena$1 from class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena.freeChunk(PoolArena.java:296)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.freeEntry(PoolThreadCache.java:464)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:430)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:422)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:279)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:270)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:241)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:477)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:444)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.remove(FastThreadLocal.java:256)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.removeAll(FastThreadLocal.java:67)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1081)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Exception in thread "grpc-nio-worker-ELG-3-3" Exception in thread "grpc-nio-worker-ELG-3-1" java.lang.IllegalAccessError: tried to access class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena$1 from class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena.freeChunk(PoolArena.java:296)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.freeEntry(PoolThreadCache.java:464)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:430)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:422)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:279)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:270)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:241)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:477)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:444)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.remove(FastThreadLocal.java:256)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.removeAll(FastThreadLocal.java:67)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1081)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Exception in thread "grpc-nio-worker-ELG-3-5" java.lang.IllegalAccessError: tried to access class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena$1 from class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena.freeChunk(PoolArena.java:296)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.freeEntry(PoolThreadCache.java:464)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:430)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:422)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:279)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:270)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:241)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:477)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:444)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.remove(FastThreadLocal.java:256)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.removeAll(FastThreadLocal.java:67)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1081)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Exception in thread "grpc-nio-worker-ELG-3-4" java.lang.IllegalAccessError: tried to access class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena$1 from class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena.freeChunk(PoolArena.java:296)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.freeEntry(PoolThreadCache.java:464)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:430)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:422)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:279)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:270)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:241)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:477)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:444)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.remove(FastThreadLocal.java:256)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.removeAll(FastThreadLocal.java:67)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1081)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
java.lang.IllegalAccessError: tried to access class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena$1 from class org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolArena.freeChunk(PoolArena.java:296)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.freeEntry(PoolThreadCache.java:464)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:430)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache$MemoryRegionCache.free(PoolThreadCache.java:422)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:279)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:270)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PoolThreadCache.free(PoolThreadCache.java:241)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:477)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.buffer.PooledByteBufAllocator$PoolThreadLocalCache.onRemoval(PooledByteBufAllocator.java:444)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.remove(FastThreadLocal.java:256)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocal.removeAll(FastThreadLocal.java:67)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1081)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
May 14, 2021 12:20:22 AM org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise safeExecute
SEVERE: Failed to submit a listener notification task. Event loop shut down?
java.lang.IllegalAccessError: tried to access class org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.GlobalEventExecutor$2 from class org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.GlobalEventExecutor
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.GlobalEventExecutor.startThread(GlobalEventExecutor.java:227)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.GlobalEventExecutor.execute(GlobalEventExecutor.java:215)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise.safeExecute(DefaultPromise.java:841)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:498)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:615)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:604)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise.setSuccess(DefaultPromise.java:96)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1089)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
May 14, 2021 12:20:23 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 211
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 211
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 19m 58s
151 actionable tasks: 112 executed, 36 from cache, 3 up-to-date
Publishing build scan...
https://gradle.com/s/y377diw27jcxa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #3615
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3615/display/redirect>
Changes:
------------------------------------------
[...truncated 397.23 KB...]
INFO: Python sdk harness starting.
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService control
INFO: Beam Fn Control client connected with id 1-1
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Status HTTP server running at localhost:37855
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-3
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-2
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-5
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-4
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure state channel for localhost:38861.
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: State channel established.
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating client data channel for localhost:37319
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO: Beam Fn Data client connected.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate convertRecoveredInputChannels
INFO: Converting recovered input channels (1 channels)
May 13, 2021 6:25:54 PM org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate convertRecoveredInputChannels
INFO: Converting recovered input channels (1 channels)
May 13, 2021 6:25:54 PM org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate convertRecoveredInputChannels
INFO: Converting recovered input channels (1 channels)
May 13, 2021 6:25:54 PM org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate convertRecoveredInputChannels
INFO: Converting recovered input channels (1 channels)
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2930>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (2d2c2be365e95bd66c574427487ad61c) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (3cd6dc8c7ed29b79f133f7d23fc41261) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: Partition (1/1)#0 (4d5da97322264613dfe794483ff1122a) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (3cd6dc8c7ed29b79f133f7d23fc41261).
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2930>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (2d2c2be365e95bd66c574427487ad61c).
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for Partition (1/1)#0 (4d5da97322264613dfe794483ff1122a).
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 3cd6dc8c7ed29b79f133f7d23fc41261.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (f698c39541254852d824b03244383534) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (f698c39541254852d824b03244383534).
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2930>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 2d2c2be365e95bd66c574427487ad61c.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task Partition (1/1)#0 4d5da97322264613dfe794483ff1122a.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 f698c39541254852d824b03244383534.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)#0 (cf6d1e5315d2d83cf084fcfa885dcc86) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)#0 (cf6d1e5315d2d83cf084fcfa885dcc86).
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)#0 cf6d1e5315d2d83cf084fcfa885dcc86.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)#0 (65aa1405b69d1eb04ef3556925e9d9dc) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)#0 (65aa1405b69d1eb04ef3556925e9d9dc).
May 13, 2021 6:25:54 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)#0 65aa1405b69d1eb04ef3556925e9d9dc.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (3cd6dc8c7ed29b79f133f7d23fc41261) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2930>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (2d2c2be365e95bd66c574427487ad61c) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (4d5da97322264613dfe794483ff1122a) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (f698c39541254852d824b03244383534) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1) (cf6d1e5315d2d83cf084fcfa885dcc86) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1) (65aa1405b69d1eb04ef3556925e9d9dc) switched from RUNNING to FINISHED.
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.7_sdk:2.31.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.31.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-2148a855-6cc0-45a6-a4ff-22fe2b3d5767/eb7c6ad0e6ac294ac0133aedea0453e10bc2abff6c12919b5a592e1fc55358b5-pickled_main_session"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\024pickled_main_session"
}
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
May 13, 2021 6:25:54 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
May 13, 2021 6:25:54 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container 0e57670b54c0266a821daf8e52135355cc5ca9ac5b1e10b0661de96c32e930b1. Logs:
2021/05/13 18:25:53 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_options:v1" value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.7_sdk:2.31.0.dev"}}}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"DOCKER"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.12/job-server/build/libs/beam-runners-flink-1.12-job-server-2.31.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:true}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.12"}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-0513182534-c448754e"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:options_id:v1" value:{number_value:1}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:true}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}}} retrieval_token:"__no_artifacts_staged__" logging_endpoint:{url:"localhost:34629"} artifact_endpoint:{url:"localhost:35597"} control_endpoint:{url:"localhost:46391"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-2148a855-6cc0-45a6-a4ff-22fe2b3d5767/eb7c6ad0e6ac294ac0133aedea0453e10bc2abff6c12919b5a592e1fc55358b5-pickled_main_session" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x14pickled_main_session"}
2021/05/13 18:25:53 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:35499
2021/05/13 18:25:53 Downloaded: /tmp/staged/pickled_main_session (sha256: 646aa5c451d3a02da32f3d3a12b7e249f1f6dac08d7b6d1c4fe3a02b62be3ed7, size: 2731)
2021/05/13 18:25:53 Found artifact: pickled_main_session
2021/05/13 18:25:53 Installing setup packages ...
2021/05/13 18:25:53 Executing: python -m apache_beam.runners.worker.sdk_worker_main
May 13, 2021 6:25:55 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 (4a68f5813e57a31de6a509024fde0ef2) switched from RUNNING to FINISHED.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (861b8946742fb417996b205ede18e4e5) switched from RUNNING to FINISHED.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 (4a68f5813e57a31de6a509024fde0ef2).
May 13, 2021 6:25:55 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (861b8946742fb417996b205ede18e4e5).
May 13, 2021 6:25:55 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1)#0 4a68f5813e57a31de6a509024fde0ef2.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 861b8946742fb417996b205ede18e4e5.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [3]assert_that/{Group, Unkey, Match}) (1/1) (4a68f5813e57a31de6a509024fde0ef2) switched from RUNNING to FINISHED.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (861b8946742fb417996b205ede18e4e5) switched from RUNNING to FINISHED.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.executiongraph.ExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0513182534-c448754e (2f0b1479cb8d99964b7746073a7f2564) switched from state RUNNING to FINISHED.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedGloballyTerminalState
INFO: Job 2f0b1479cb8d99964b7746073a7f2564 reached globally terminal state FINISHED.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0513182534-c448754e(2f0b1479cb8d99964b7746073a7f2564).
May 13, 2021 6:25:55 PM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl suspend
INFO: Suspending SlotPool.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection a8a15a2a71366e1e11cd18374333427e: Stopping JobMaster for job BeamApp-jenkins-0513182534-c448754e(2f0b1479cb8d99964b7746073a7f2564)..
May 13, 2021 6:25:55 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: e3305019d4d557c4cced03ac087971a6, jobId: 2f0b1479cb8d99964b7746073a7f2564).
May 13, 2021 6:25:55 PM org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl close
INFO: Stopping SlotPool.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager 97d6fb2b228589d711c25c704ec14956@akka://flink/user/rpc/jobmanager_3 for job 2f0b1479cb8d99964b7746073a7f2564 from the resource manager.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job 2f0b1479cb8d99964b7746073a7f2564 from job leader monitoring.
May 13, 2021 6:25:55 PM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 2f0b1479cb8d99964b7746073a7f2564.
May 13, 2021 6:25:55 PM org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise safeExecute
SEVERE: Failed to submit a listener notification task. Event loop shut down?
java.lang.IllegalAccessError: tried to access class org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.GlobalEventExecutor$2 from class org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.GlobalEventExecutor
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.GlobalEventExecutor.startThread(GlobalEventExecutor.java:227)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.GlobalEventExecutor.execute(GlobalEventExecutor.java:215)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise.safeExecute(DefaultPromise.java:841)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:498)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:615)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:604)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.DefaultPromise.setSuccess(DefaultPromise.java:96)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.SingleThreadEventExecutor$6.run(SingleThreadEventExecutor.java:1089)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.beam.vendor.grpc.v1p26p0.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
May 13, 2021 6:25:57 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
> Task :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession
kill %1 || echo "Failed to shut down Flink mini cluster"
rm -rf "$ENV_DIR"
May 13, 2021 6:25:58 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
May 13, 2021 6:25:58 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 211
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 211
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 25m 6s
151 actionable tasks: 109 executed, 39 from cache, 3 up-to-date
Publishing build scan...
Publishing build scan failed due to network error 'java.net.SocketTimeoutException: Read timed out' (2 retries remaining)...
https://gradle.com/s/u7q3dj3rvxe7q
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org