You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/08/29 06:19:26 UTC

Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #4024

See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4024/display/redirect>

Changes:


------------------------------------------
[...truncated 479.00 KB...]
Aug 29, 2021 6:19:21 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Aug 29, 2021 6:19:21 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Aug 29, 2021 6:19:21 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache

>>> SUCCESS
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession
Aug 29, 2021 6:19:15 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService logging
INFO: Beam Fn Logging client connected.
Aug 29, 2021 6:19:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Logging handler created.
Aug 29, 2021 6:19:15 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: semi_persistent_directory: /tmp
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
WARNING: Discarding unparseable args: ['--app_name=None', '--direct_runner_use_stacked_bundle', '--job_server_timeout=60', '--options_id=1', '--parallelism=1', '--pipeline_type_check'] 
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Pipeline_options: {'job_name': 'BeamApp-jenkins-0829061846-b2e5c97c', 'experiments': ['beam_fn_api'], 'save_main_session': True, 'sdk_location': 'container', 'environment_type': 'DOCKER', 'environment_options': ['docker_container_image=apache/beam_python3.6_sdk:2.34.0.dev'], 'sdk_worker_parallelism': '1', 'environment_cache_millis': '0', 'flink_job_server_jar': '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.34.0-SNAPSHOT.jar',> 'flink_submit_uber_jar': True}
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating state cache with size 0
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure control channel for localhost:34011.
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Control channel established.
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Initializing SDKHarness with unbounded number of workers.
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Python sdk harness starting.
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService control
INFO: Beam Fn Control client connected with id 1-1
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-2
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-5
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-4
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-3
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure state channel for localhost:40883.
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: State channel established.
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating client data channel for localhost:43315
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO: Beam Fn Data client connected.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2965>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (6c88f1527f47460ab9542d79460b9b0e) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2965>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (6c88f1527f47460ab9542d79460b9b0e).
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (62274e0d109d570ebfa1510113a6a999) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (62274e0d109d570ebfa1510113a6a999).
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: Partition (1/1)#0 (15b262d1f720268d19ee337e10a3ac9b) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for Partition (1/1)#0 (15b262d1f720268d19ee337e10a3ac9b).
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2965>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 6c88f1527f47460ab9542d79460b9b0e.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (ad9a11127168595602fe9c26c9b7d44b) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (ad9a11127168595602fe9c26c9b7d44b).
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 62274e0d109d570ebfa1510113a6a999.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task Partition (1/1)#0 15b262d1f720268d19ee337e10a3ac9b.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 ad9a11127168595602fe9c26c9b7d44b.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (84fff851a8c38b6b5e8fb954683eee85) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (84fff851a8c38b6b5e8fb954683eee85).
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 84fff851a8c38b6b5e8fb954683eee85.
Aug 29, 2021 6:19:16 AM org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory createBuilder
INFO: The AWS S3 Beam extension was included in this build, but the awsRegion flag was not specified. If you don't plan to use S3, then ignore this message.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 (c803a71b23e211b2e7de964ea65d09bb) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 (c803a71b23e211b2e7de964ea65d09bb).
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 c803a71b23e211b2e7de964ea65d09bb.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2965>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (6c88f1527f47460ab9542d79460b9b0e) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (62274e0d109d570ebfa1510113a6a999) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (15b262d1f720268d19ee337e10a3ac9b) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (ad9a11127168595602fe9c26c9b7d44b) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1) (84fff851a8c38b6b5e8fb954683eee85) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1) (c803a71b23e211b2e7de964ea65d09bb) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.6_sdk:2.34.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.6_sdk:2.34.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies {
  type_urn: "beam:artifact:type:file:v1"
  type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-1e7c0d79-c040-41a2-9b45-548e0871d003/2129628ae66a09c0e9e600dbc4c16f9248c68076447f4d78216afc6b78d96b8a-pickled_main_session"
  role_urn: "beam:artifact:role:staging_to:v1"
  role_payload: "\n\024pickled_main_session"
}

Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Aug 29, 2021 6:19:16 AM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Aug 29, 2021 6:19:16 AM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container e1cb2f0d8b1c1fe51a3aad06e3ddebc0b5fd4d3bcc8d66644961c92f1131cf03. Logs:
2021/08/29 06:19:14 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1"  value:{bool_value:false}}  fields:{key:"beam:option:allow_unsafe_triggers:v1"  value:{bool_value:false}}  fields:{key:"beam:option:app_name:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:artifact_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:beam_services:v1"  value:{struct_value:{}}}  fields:{key:"beam:option:dataflow_endpoint:v1"  value:{string_value:"https://dataflow.googleapis.com"}}  fields:{key:"beam:option:direct_num_workers:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:direct_runner_bundle_repeat:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1"  value:{bool_value:true}}  fields:{key:"beam:option:direct_running_mode:v1"  value:{string_value:"in_memory"}}  fields:{key:"beam:option:dry_run:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_hot_key_logging:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_streaming_engine:v1"  value:{bool_value:false}}  fields:{key:"beam:option:environment_cache_millis:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:environment_options:v1"  value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.6_sdk:2.34.0.dev"}}}}  fields:{key:"beam:option:environment_type:v1"  value:{string_value:"DOCKER"}}  fields:{key:"beam:option:expansion_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:experiments:v1"  value:{list_value:{values:{string_value:"beam_fn_api"}}}}  fields:{key:"beam:option:flink_job_server_jar:v1"  value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.34.0-SNAPSHOT.jar"}}>  fields:{key:"beam:option:flink_master:v1"  value:{string_value:"[auto]"}}  fields:{key:"beam:option:flink_submit_uber_jar:v1"  value:{bool_value:true}}  fields:{key:"beam:option:flink_version:v1"  value:{string_value:"1.13"}}  fields:{key:"beam:option:hdfs_full_urls:v1"  value:{bool_value:false}}  fields:{key:"beam:option:job_name:v1"  value:{string_value:"BeamApp-jenkins-0829061846-b2e5c97c"}}  fields:{key:"beam:option:job_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:job_server_java_launcher:v1"  value:{string_value:"java"}}  fields:{key:"beam:option:job_server_jvm_properties:v1"  value:{list_value:{}}}  fields:{key:"beam:option:job_server_timeout:v1"  value:{string_value:"60"}}  fields:{key:"beam:option:no_auth:v1"  value:{bool_value:false}}  fields:{key:"beam:option:options_id:v1"  value:{number_value:1}}  fields:{key:"beam:option:parallelism:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:performance_runtime_type_check:v1"  value:{bool_value:false}}  fields:{key:"beam:option:pipeline_type_check:v1"  value:{bool_value:true}}  fields:{key:"beam:option:profile_cpu:v1"  value:{bool_value:false}}  fields:{key:"beam:option:profile_memory:v1"  value:{bool_value:false}}  fields:{key:"beam:option:profile_sample_rate:v1"  value:{number_value:1}}  fields:{key:"beam:option:resource_hints:v1"  value:{list_value:{}}}  fields:{key:"beam:option:runtime_type_check:v1"  value:{bool_value:false}}  fields:{key:"beam:option:s3_disable_ssl:v1"  value:{bool_value:false}}  fields:{key:"beam:option:save_main_session:v1"  value:{bool_value:true}}  fields:{key:"beam:option:sdk_location:v1"  value:{string_value:"container"}}  fields:{key:"beam:option:sdk_worker_parallelism:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:spark_master_url:v1"  value:{string_value:"local[4]"}}  fields:{key:"beam:option:spark_submit_uber_jar:v1"  value:{bool_value:false}}  fields:{key:"beam:option:spark_version:v1"  value:{string_value:"2"}}  fields:{key:"beam:option:streaming:v1"  value:{bool_value:false}}  fields:{key:"beam:option:type_check_additional:v1"  value:{string_value:""}}  fields:{key:"beam:option:type_check_strictness:v1"  value:{string_value:"DEFAULT_TO_ANY"}}  fields:{key:"beam:option:update:v1"  value:{bool_value:false}}}  retrieval_token:"__no_artifacts_staged__"  logging_endpoint:{url:"localhost:38239"}  artifact_endpoint:{url:"localhost:35327"}  control_endpoint:{url:"localhost:34011"}  dependencies:{type_urn:"beam:artifact:type:file:v1"  type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-1e7c0d79-c040-41a2-9b45-548e0871d003/2129628ae66a09c0e9e600dbc4c16f9248c68076447f4d78216afc6b78d96b8a-pickled_main_session"  role_urn:"beam:artifact:role:staging_to:v1"  role_payload:"\n\x14pickled_main_session"}
2021/08/29 06:19:14 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:42457
2021/08/29 06:19:14 Downloaded: /tmp/staged/pickled_main_session (sha256: d2372e35845b59e580c91c2c8a78f0bc871cb9751745ff11b31f79e57a91b6ef, size: 2760)
2021/08/29 06:19:14 Found artifact: pickled_main_session
2021/08/29 06:19:14 Installing setup packages ...
2021/08/29 06:19:14 Executing: python -m apache_beam.runners.worker.sdk_worker_main
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (d645039cdbdf357d6840ee84a3e37ef5) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (6b2ee3a0a39dbbbee9c9bc984118099d) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (d645039cdbdf357d6840ee84a3e37ef5).
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (6b2ee3a0a39dbbbee9c9bc984118099d).
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 d645039cdbdf357d6840ee84a3e37ef5.
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 6b2ee3a0a39dbbbee9c9bc984118099d.
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1) (d645039cdbdf357d6840ee84a3e37ef5) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (6b2ee3a0a39dbbbee9c9bc984118099d) switched from RUNNING to FINISHED.
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 0d18a99f6a4b68f484d2049ec0617a69
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0829061846-b2e5c97c (0d18a99f6a4b68f484d2049ec0617a69) switched from state RUNNING to FINISHED.
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job 0d18a99f6a4b68f484d2049ec0617a69 reached terminal state FINISHED.
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0829061846-b2e5c97c(0d18a99f6a4b68f484d2049ec0617a69).
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [51e2baba244a7ca0842dd79584609bf8].
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: 51e2baba244a7ca0842dd79584609bf8, jobId: 0d18a99f6a4b68f484d2049ec0617a69).
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection bd478205293a1622aefdf75fe9459150: Stopping JobMaster for job BeamApp-jenkins-0829061846-b2e5c97c(0d18a99f6a4b68f484d2049ec0617a69)..
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 0d18a99f6a4b68f484d2049ec0617a69
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager 91010d503229147e2a8111a0eb9a428f@akka://flink/user/rpc/jobmanager_3 for job 0d18a99f6a4b68f484d2049ec0617a69 from the resource manager.
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job 0d18a99f6a4b68f484d2049ec0617a69 from job leader monitoring.
Aug 29, 2021 6:19:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 0d18a99f6a4b68f484d2049ec0617a69.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

kill %1 || echo "Failed to shut down Flink mini cluster"

rm -rf "$ENV_DIR"
Aug 29, 2021 6:19:23 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Aug 29, 2021 6:19:23 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
>>> SUCCESS
fi
exit $TEST_EXIT_CODE

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 18m 54s
150 actionable tasks: 106 executed, 41 from cache, 3 up-to-date

Publishing build scan...
https://gradle.com/s/gzi7y2aitnnug

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_PortableJar_Flink #4026

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4026/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #4025

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4025/display/redirect>

Changes:


------------------------------------------
[...truncated 1.18 MB...]
WARNING: Discarding unparseable args: ['--app_name=None', '--direct_runner_use_stacked_bundle', '--job_server_timeout=60', '--options_id=1', '--parallelism=1', '--pipeline_type_check'] 
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Pipeline_options: {'job_name': 'BeamApp-jenkins-0829121845-13ee9ed1', 'experiments': ['beam_fn_api'], 'save_main_session': True, 'sdk_location': 'container', 'environment_type': 'DOCKER', 'environment_options': ['docker_container_image=apache/beam_python3.7_sdk:2.34.0.dev'], 'sdk_worker_parallelism': '1', 'environment_cache_millis': '0', 'flink_job_server_jar': '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.34.0-SNAPSHOT.jar',> 'flink_submit_uber_jar': True}
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating state cache with size 0
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure control channel for localhost:33525.
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Control channel established.
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Initializing SDKHarness with unbounded number of workers.
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Python sdk harness starting.
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService control
INFO: Beam Fn Control client connected with id 1-1
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-4
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-2
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-3
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO: getProcessBundleDescriptor request with id 1-5
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating insecure state channel for localhost:35897.
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: State channel established.
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.logging.Slf4jLogWriter log
INFO: Creating client data channel for localhost:43189
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO: Beam Fn Data client connected.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (2d2fca003f95a7dd06c4e468b05340cb) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2965>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (838ae77476687cd9f2536c34277fbbed) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: Partition (1/1)#0 (382a1b7a0712d1868aa422fc53eb59b9) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (2d2fca003f95a7dd06c4e468b05340cb).
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for Partition (1/1)#0 (382a1b7a0712d1868aa422fc53eb59b9).
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2965>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (838ae77476687cd9f2536c34277fbbed).
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 2d2fca003f95a7dd06c4e468b05340cb.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (c336765165d39cb4342ca2e83922ef28) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 (c336765165d39cb4342ca2e83922ef28).
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task Partition (1/1)#0 382a1b7a0712d1868aa422fc53eb59b9.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2965>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 838ae77476687cd9f2536c34277fbbed.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (ab19292a4791684411318a60e7055a2d) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 (ab19292a4791684411318a60e7055a2d).
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)#0 c336765165d39cb4342ca2e83922ef28.
Aug 29, 2021 12:19:01 PM org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory createBuilder
INFO: The AWS S3 Beam extension was included in this build, but the awsRegion flag was not specified. If you don't plan to use S3, then ignore this message.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1)#0 ab19292a4791684411318a60e7055a2d.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 (b146da1e5eca480e5df3732d3d54ad3d) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 (b146da1e5eca480e5df3732d3d54ad3d).
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1)#0 b146da1e5eca480e5df3732d3d54ad3d.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (2d2fca003f95a7dd06c4e468b05340cb) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: Partition (1/1) (382a1b7a0712d1868aa422fc53eb59b9) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2965>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (838ae77476687cd9f2536c34277fbbed) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:23>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (c336765165d39cb4342ca2e83922ef28) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: assert_that/Group/_CoGBKImpl/GroupByKey) -> Map (Key Extractor) (1/1) (ab19292a4791684411318a60e7055a2d) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: GroupReduce (GroupReduce at assert_that/Group/_CoGBKImpl/GroupByKey) (1/1) (b146da1e5eca480e5df3732d3d54ad3d) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO: Closing environment urn: "beam:env:docker:v1"
payload: "\n$apache/beam_python3.7_sdk:2.34.0.dev"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:timer:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:param_windowed_value:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:custom_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:sharded_key:v1"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:harness_monitoring_infos:v1"
capabilities: "beam:protocol:worker_status:v1"
capabilities: "beam:combinefn:packed_python:v1"
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.34.0.dev"
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
capabilities: "beam:transform:to_string:v1"
dependencies {
  type_urn: "beam:artifact:type:file:v1"
  type_payload: "\n\253\001classpath://BEAM-PIPELINE/pipeline/artifacts/job-9b4dc227-9741-443b-bf0d-bf53010d1a88/299878b13f2067ecdcb654d9a85b699317ca8bc163503e95d1b5aab91144f937-pickled_main_session"
  role_urn: "beam:artifact:role:staging_to:v1"
  role_payload: "\n\024pickled_main_session"
}

Aug 29, 2021 12:19:01 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO: 1 Beam Fn Logging clients still connected during shutdown.
Aug 29, 2021 12:19:01 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Aug 29, 2021 12:19:01 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
WARNING: Hanged up for unknown endpoint.
Aug 29, 2021 12:19:02 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO: Closing Docker container 65a6cde82b81bfc4a75a3c87634958fc90b0ac5a26d761724b1f5fdb9553e4a8. Logs:
2021/08/29 12:18:59 Provision info:
pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1"  value:{bool_value:false}}  fields:{key:"beam:option:allow_unsafe_triggers:v1"  value:{bool_value:false}}  fields:{key:"beam:option:app_name:v1"  value:{null_value:NULL_VALUE}}  fields:{key:"beam:option:artifact_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:beam_services:v1"  value:{struct_value:{}}}  fields:{key:"beam:option:dataflow_endpoint:v1"  value:{string_value:"https://dataflow.googleapis.com"}}  fields:{key:"beam:option:direct_num_workers:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:direct_runner_bundle_repeat:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1"  value:{bool_value:true}}  fields:{key:"beam:option:direct_running_mode:v1"  value:{string_value:"in_memory"}}  fields:{key:"beam:option:dry_run:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_hot_key_logging:v1"  value:{bool_value:false}}  fields:{key:"beam:option:enable_streaming_engine:v1"  value:{bool_value:false}}  fields:{key:"beam:option:environment_cache_millis:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:environment_options:v1"  value:{list_value:{values:{string_value:"docker_container_image=apache/beam_python3.7_sdk:2.34.0.dev"}}}}  fields:{key:"beam:option:environment_type:v1"  value:{string_value:"DOCKER"}}  fields:{key:"beam:option:expansion_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:experiments:v1"  value:{list_value:{values:{string_value:"beam_fn_api"}}}}  fields:{key:"beam:option:flink_job_server_jar:v1"  value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.34.0-SNAPSHOT.jar"}}>  fields:{key:"beam:option:flink_master:v1"  value:{string_value:"[auto]"}}  fields:{key:"beam:option:flink_submit_uber_jar:v1"  value:{bool_value:true}}  fields:{key:"beam:option:flink_version:v1"  value:{string_value:"1.13"}}  fields:{key:"beam:option:hdfs_full_urls:v1"  value:{bool_value:false}}  fields:{key:"beam:option:job_name:v1"  value:{string_value:"BeamApp-jenkins-0829121845-13ee9ed1"}}  fields:{key:"beam:option:job_port:v1"  value:{string_value:"0"}}  fields:{key:"beam:option:job_server_java_launcher:v1"  value:{string_value:"java"}}  fields:{key:"beam:option:job_server_jvm_properties:v1"  value:{list_value:{}}}  fields:{key:"beam:option:job_server_timeout:v1"  value:{string_value:"60"}}  fields:{key:"beam:option:no_auth:v1"  value:{bool_value:false}}  fields:{key:"beam:option:options_id:v1"  value:{number_value:1}}  fields:{key:"beam:option:parallelism:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:performance_runtime_type_check:v1"  value:{bool_value:false}}  fields:{key:"beam:option:pipeline_type_check:v1"  value:{bool_value:true}}  fields:{key:"beam:option:profile_cpu:v1"  value:{bool_value:false}}  fields:{key:"beam:option:profile_memory:v1"  value:{bool_value:false}}  fields:{key:"beam:option:profile_sample_rate:v1"  value:{number_value:1}}  fields:{key:"beam:option:resource_hints:v1"  value:{list_value:{}}}  fields:{key:"beam:option:runtime_type_check:v1"  value:{bool_value:false}}  fields:{key:"beam:option:s3_disable_ssl:v1"  value:{bool_value:false}}  fields:{key:"beam:option:save_main_session:v1"  value:{bool_value:true}}  fields:{key:"beam:option:sdk_location:v1"  value:{string_value:"container"}}  fields:{key:"beam:option:sdk_worker_parallelism:v1"  value:{string_value:"1"}}  fields:{key:"beam:option:spark_master_url:v1"  value:{string_value:"local[4]"}}  fields:{key:"beam:option:spark_submit_uber_jar:v1"  value:{bool_value:false}}  fields:{key:"beam:option:spark_version:v1"  value:{string_value:"2"}}  fields:{key:"beam:option:streaming:v1"  value:{bool_value:false}}  fields:{key:"beam:option:type_check_additional:v1"  value:{string_value:""}}  fields:{key:"beam:option:type_check_strictness:v1"  value:{string_value:"DEFAULT_TO_ANY"}}  fields:{key:"beam:option:update:v1"  value:{bool_value:false}}}  retrieval_token:"__no_artifacts_staged__"  logging_endpoint:{url:"localhost:40277"}  artifact_endpoint:{url:"localhost:36777"}  control_endpoint:{url:"localhost:33525"}  dependencies:{type_urn:"beam:artifact:type:file:v1"  type_payload:"\n\xab\x01classpath://BEAM-PIPELINE/pipeline/artifacts/job-9b4dc227-9741-443b-bf0d-bf53010d1a88/299878b13f2067ecdcb654d9a85b699317ca8bc163503e95d1b5aab91144f937-pickled_main_session"  role_urn:"beam:artifact:role:staging_to:v1"  role_payload:"\n\x14pickled_main_session"}
2021/08/29 12:18:59 Initializing python harness: /opt/apache/beam/boot --id=1-1 --provision_endpoint=localhost:46595
2021/08/29 12:19:00 Downloaded: /tmp/staged/pickled_main_session (sha256: 691be633b17fd60562bfc62908696a3f2fa9095917ff9c958134d7b10eb020a4, size: 2760)
2021/08/29 12:19:00 Found artifact: pickled_main_session
2021/08/29 12:19:00 Installing setup packages ...
2021/08/29 12:19:00 Executing: python -m apache_beam.runners.worker.sdk_worker_main
2021/08/29 12:19:02 Python exited: <nil>
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (19d7c3625f51db0402cbc6bb9e300f11) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 (19d7c3625f51db0402cbc6bb9e300f11).
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.taskmanager.Task transitionState
INFO: DataSink (DiscardingOutput) (1/1)#0 (692611b7ae8bba97855203c193e552a9) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.taskmanager.Task doRun
INFO: Freeing task resources for DataSink (DiscardingOutput) (1/1)#0 (692611b7ae8bba97855203c193e552a9).
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1)#0 19d7c3625f51db0402cbc6bb9e300f11.
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (DiscardingOutput) (1/1)#0 692611b7ae8bba97855203c193e552a9.
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (1/1) (19d7c3625f51db0402cbc6bb9e300f11) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO: DataSink (DiscardingOutput) (1/1) (692611b7ae8bba97855203c193e552a9) switched from RUNNING to FINISHED.
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 6895f3f5b25251ad4e66bf9fafbbfb57
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO: Job BeamApp-jenkins-0829121845-13ee9ed1 (6895f3f5b25251ad4e66bf9fafbbfb57) switched from state RUNNING to FINISHED.
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.dispatcher.Dispatcher jobReachedTerminalState
INFO: Job 6895f3f5b25251ad4e66bf9fafbbfb57 reached terminal state FINISHED.
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job BeamApp-jenkins-0829121845-13ee9ed1(6895f3f5b25251ad4e66bf9fafbbfb57).
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [f5439e7dfc479c64e82b580fc4b1c4ba].
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ACTIVE, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=128.000mb (134217728 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: f5439e7dfc479c64e82b580fc4b1c4ba, jobId: 6895f3f5b25251ad4e66bf9fafbbfb57).
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection e65277034959be333aed15cc2dafffa3: Stopping JobMaster for job BeamApp-jenkins-0829121845-13ee9ed1(6895f3f5b25251ad4e66bf9fafbbfb57)..
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 6895f3f5b25251ad4e66bf9fafbbfb57
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager a3011542bc5ffab4963a810e5dd84560@akka://flink/user/rpc/jobmanager_3 for job 6895f3f5b25251ad4e66bf9fafbbfb57 from the resource manager.
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService removeJob
INFO: Remove job 6895f3f5b25251ad4e66bf9fafbbfb57 from job leader monitoring.
Aug 29, 2021 12:19:03 PM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 6895f3f5b25251ad4e66bf9fafbbfb57.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

kill %1 || echo "Failed to shut down Flink mini cluster"

rm -rf "$ENV_DIR"
Aug 29, 2021 12:19:04 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Aug 29, 2021 12:19:04 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Aug 29, 2021 12:19:04 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
>>> SUCCESS
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE

kill %1 || echo "Failed to shut down Flink mini cluster"

rm -rf "$ENV_DIR"
Aug 29, 2021 12:19:06 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Aug 29, 2021 12:19:06 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 18m 37s
150 actionable tasks: 106 executed, 41 from cache, 3 up-to-date

Publishing build scan...
https://gradle.com/s/47ba5ar3lejai

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org