You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/06/21 19:55:14 UTC
Build failed in Jenkins: beam_PostCommit_Python37 #6834
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/6834/display/redirect>
Changes:
------------------------------------------
[...truncated 16.67 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:sharded_key:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:nullable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:progress_reporting:v0"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:worker_status:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:combinefn:packed_python:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.49.0.dev"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:data_sampling:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jun 21, 2023 7:55:03 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Hanged up for unknown endpoint.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jun 21, 2023 7:55:03 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing environment urn: "beam:env:docker:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 payload: "\n apache/beam_java8_sdk:2.49.0.dev"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bytes:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bool:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:varint:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:string_utf8:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:timer:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:kv:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:length_prefix:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:global_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:interval_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:custom_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:windowed_value:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:double:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:row:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:param_windowed_value:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:state_backed_iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:sharded_key:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:nullable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:multi_core_bundle_processing:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:progress_reporting:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:control_request_elements_embedding:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:state_caching:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_java8_sdk:2.49.0.dev"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:data_sampling:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 dependencies {
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 type_urn: "beam:artifact:type:file:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 type_payload: "\n\316\001/tmp/beam-tempv3hugjw4/artifacts5dclkk1_/8116f3f2ccaa137c0c9e991a5166d96d46b0d6ffef024a5c9df3816d9ab8914e/1-external_7beam:env:docker-beam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHO"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 role_urn: "beam:artifact:role:staging_to:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 role_payload: "\nybeam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHOT-NVp1edMlLgFFsIVCsu7nBTK23d5v8JyqwuK6ZqRWUso.jar"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 }
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jun 21, 2023 7:55:03 PM org.apache.beam.runners.fnexecution.logging.GrpcLoggingService close
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: 2 Beam Fn Logging clients still connected during shutdown.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jun 21, 2023 7:55:03 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Hanged up for unknown endpoint.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jun 21, 2023 7:55:03 PM org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment close
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing Docker container 1736f477325d398d8bb6e273c14b832f438b1b29c7de64e55cd7c9984d529e36. Logs:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/06/21 19:54:57 Provision info:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 pipeline_options:{fields:{key:"beam:option:allow_non_deterministic_key_coders:v1" value:{bool_value:false}} fields:{key:"beam:option:allow_non_restored_state:v1" value:{bool_value:false}} fields:{key:"beam:option:allow_unsafe_triggers:v1" value:{bool_value:false}} fields:{key:"beam:option:app_name:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:artifact_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:auto_balance_write_files_sharding_enabled:v1" value:{bool_value:false}} fields:{key:"beam:option:beam_services:v1" value:{struct_value:{}}} fields:{key:"beam:option:block_on_run:v1" value:{bool_value:true}} fields:{key:"beam:option:dataflow_endpoint:v1" value:{string_value:"https://dataflow.googleapis.com"}} fields:{key:"beam:option:direct_embed_docker_python:v1" value:{bool_value:false}} fields:{key:"beam:option:direct_num_workers:v1" value:{string_value:"1"}} fields:{key:"beam:option:direct_runner_bundle_repeat:v1" value:{string_value:"0"}} fields:{key:"beam:option:direct_runner_use_stacked_bundle:v1" value:{bool_value:true}} fields:{key:"beam:option:direct_running_mode:v1" value:{string_value:"in_memory"}} fields:{key:"beam:option:direct_test_splits:v1" value:{struct_value:{}}} fields:{key:"beam:option:disable_metrics:v1" value:{bool_value:false}} fields:{key:"beam:option:dry_run:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_artifact_caching:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_bundling:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_hot_key_logging:v1" value:{bool_value:false}} fields:{key:"beam:option:enable_streaming_engine:v1" value:{bool_value:false}} fields:{key:"beam:option:enforce_encodability:v1" value:{bool_value:true}} fields:{key:"beam:option:enforce_immutability:v1" value:{bool_value:true}} fields:{key:"beam:option:environment_cache_millis:v1" value:{string_value:"0"}} fields:{key:"beam:option:environment_config:v1" value:{string_value:"localhost:32869"}} fields:{key:"beam:option:environment_type:v1" value:{string_value:"LOOPBACK"}} fields:{key:"beam:option:expansion_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:externalized_checkpoints_enabled:v1" value:{bool_value:false}} fields:{key:"beam:option:fail_on_checkpointing_errors:v1" value:{bool_value:true}} fields:{key:"beam:option:faster_copy:v1" value:{bool_value:false}} fields:{key:"beam:option:finish_bundle_before_checkpointing:v1" value:{bool_value:false}} fields:{key:"beam:option:flink_conf_dir:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:flink_job_server_jar:v1" value:{string_value:"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.49.0-SNAPSHOT.jar"}}> fields:{key:"beam:option:flink_master:v1" value:{string_value:"[auto]"}} fields:{key:"beam:option:flink_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:flink_version:v1" value:{string_value:"1.16"}} fields:{key:"beam:option:gcp_oauth_scopes:v1" value:{list_value:{values:{string_value:"https://www.googleapis.com/auth/bigquery"} values:{string_value:"https://www.googleapis.com/auth/cloud-platform"} values:{string_value:"https://www.googleapis.com/auth/devstorage.full_control"} values:{string_value:"https://www.googleapis.com/auth/userinfo.email"} values:{string_value:"https://www.googleapis.com/auth/datastore"} values:{string_value:"https://www.googleapis.com/auth/spanner.admin"} values:{string_value:"https://www.googleapis.com/auth/spanner.data"}}}} fields:{key:"beam:option:gcs_performance_metrics:v1" value:{bool_value:false}} fields:{key:"beam:option:hdfs_full_urls:v1" value:{bool_value:false}} fields:{key:"beam:option:job_name:v1" value:{string_value:"BeamApp-jenkins-0621195440-9d632e66"}} fields:{key:"beam:option:job_port:v1" value:{string_value:"0"}} fields:{key:"beam:option:job_server_java_launcher:v1" value:{string_value:"java"}} fields:{key:"beam:option:job_server_jvm_properties:v1" value:{list_value:{}}} fields:{key:"beam:option:job_server_timeout:v1" value:{string_value:"60"}} fields:{key:"beam:option:load_balance_bundles:v1" value:{bool_value:false}} fields:{key:"beam:option:log_mdc:v1" value:{bool_value:true}} fields:{key:"beam:option:max_parallelism:v1" value:{string_value:"-1"}} fields:{key:"beam:option:no_auth:v1" value:{bool_value:false}} fields:{key:"beam:option:object_reuse:v1" value:{bool_value:false}} fields:{key:"beam:option:operator_chaining:v1" value:{bool_value:true}} fields:{key:"beam:option:options_id:v1" value:{number_value:2}} fields:{key:"beam:option:output_executable_path:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:parallelism:v1" value:{string_value:"-1"}} fields:{key:"beam:option:performance_runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:pickle_library:v1" value:{string_value:"default"}} fields:{key:"beam:option:pipeline_type_check:v1" value:{bool_value:true}} fields:{key:"beam:option:profile_cpu:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_memory:v1" value:{bool_value:false}} fields:{key:"beam:option:profile_sample_rate:v1" value:{number_value:1}} fields:{key:"beam:option:project:v1" value:{string_value:"apache-beam-testing"}} fields:{key:"beam:option:re_iterable_group_by_key_result:v1" value:{bool_value:false}} fields:{key:"beam:option:requirements_cache_only_sources:v1" value:{bool_value:false}} fields:{key:"beam:option:resource_hints:v1" value:{list_value:{}}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:retain_externalized_checkpoints_on_cancellation:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{null_value:NULL_VALUE}} fields:{key:"beam:option:runner_determined_sharding:v1" value:{bool_value:true}} fields:{key:"beam:option:runtime_type_check:v1" value:{bool_value:false}} fields:{key:"beam:option:s3_disable_ssl:v1" value:{bool_value:false}} fields:{key:"beam:option:save_main_session:v1" value:{bool_value:false}} fields:{key:"beam:option:sdk_harness_log_level_overrides:v1" value:{struct_value:{fields:{key:"org.apache.beam.runners.flink.FlinkPipelineRunner" value:{string_value:"WARN"}} fields:{key:"org.apache.flink.runtime" value:{string_value:"WARN"}} fields:{key:"org.apache.flink.runtime.metrics.groups" value:{string_value:"ERROR"}}}}} fields:{key:"beam:option:sdk_location:v1" value:{string_value:"container"}} fields:{key:"beam:option:sdk_worker_parallelism:v1" value:{string_value:"1"}} fields:{key:"beam:option:spark_master_url:v1" value:{string_value:"local[4]"}} fields:{key:"beam:option:spark_submit_uber_jar:v1" value:{bool_value:false}} fields:{key:"beam:option:spark_version:v1" value:{string_value:"3"}} fields:{key:"beam:option:streaming:v1" value:{bool_value:false}} fields:{key:"beam:option:temp_location:v1" value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-it"}} fields:{key:"beam:option:type_check_additional:v1" value:{string_value:""}} fields:{key:"beam:option:type_check_strictness:v1" value:{string_value:"DEFAULT_TO_ANY"}} fields:{key:"beam:option:update:v1" value:{bool_value:false}} fields:{key:"beam:option:use_storage_api_connection_pool:v1" value:{bool_value:false}} fields:{key:"beam:option:use_storage_write_api:v1" value:{bool_value:false}} fields:{key:"beam:option:use_storage_write_api_at_least_once:v1" value:{bool_value:false}} fields:{key:"beam:option:verify_row_values:v1" value:{bool_value:false}}} logging_endpoint:{url:"localhost:37013"} artifact_endpoint:{url:"localhost:34663"} control_endpoint:{url:"localhost:38251"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\n\xce\x01/tmp/beam-tempv3hugjw4/artifacts5dclkk1_/8116f3f2ccaa137c0c9e991a5166d96d46b0d6ffef024a5c9df3816d9ab8914e/1-external_7beam:env:docker-beam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHO" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\nybeam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHOT-NVp1edMlLgFFsIVCsu7nBTK23d5v8JyqwuK6ZqRWUso.jar"} runner_capabilities:"beam:protocol:control_response_elements_embedding:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 2023/06/21 19:54:57 Downloaded: /tmp/2-1/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHOT-NVp1edMlLgFFsIVCsu7nBTK23d5v8JyqwuK6ZqRWUso.jar (sha256: 355a7579d3252e0145b08542b2eee70532b6ddde6ff09caac2e2ba66a45652ca, size: 117284436)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Class path contains multiple SLF4J bindings.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Found binding in [jar:file:/opt/apache/beam/jars/slf4j-jdk14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Found binding in [jar:file:/tmp/2-1/staged/beam-sdks-java-io-google-cloud-platform-expansion-service-2.49.0-SNAPSHOT-NVp1edMlLgFFsIVCsu7nBTK23d5v8JyqwuK6ZqRWUso.jar!/org/slf4j/impl/StaticLoggerBinder.class]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SDK Fn Harness started
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Harness ID 2-1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Logging location url: "localhost:37013"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Control location url: "localhost:38251"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Status location null
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Pipeline options {"beam:option:allow_non_deterministic_key_coders:v1":false,"beam:option:allow_non_restored_state:v1":false,"beam:option:allow_unsafe_triggers:v1":false,"beam:option:app_name:v1":null,"beam:option:artifact_port:v1":"0","beam:option:auto_balance_write_files_sharding_enabled:v1":false,"beam:option:beam_services:v1":{},"beam:option:block_on_run:v1":true,"beam:option:dataflow_endpoint:v1":"https://dataflow.googleapis.com","beam:option:direct_embed_docker_python:v1":false,"beam:option:direct_num_workers:v1":"1","beam:option:direct_runner_bundle_repeat:v1":"0","beam:option:direct_runner_use_stacked_bundle:v1":true,"beam:option:direct_running_mode:v1":"in_memory","beam:option:direct_test_splits:v1":{},"beam:option:disable_metrics:v1":false,"beam:option:dry_run:v1":false,"beam:option:enable_artifact_caching:v1":false,"beam:option:enable_bundling:v1":false,"beam:option:enable_hot_key_logging:v1":false,"beam:option:enable_streaming_engine:v1":false,"beam:option:enforce_encodability:v1":true,"beam:option:enforce_immutability:v1":true,"beam:option:environment_cache_millis:v1":"0","beam:option:environment_config:v1":"localhost:32869","beam:option:environment_type:v1":"LOOPBACK","beam:option:expansion_port:v1":"0","beam:option:experiments:v1":["beam_fn_api"],"beam:option:externalized_checkpoints_enabled:v1":false,"beam:option:fail_on_checkpointing_errors:v1":true,"beam:option:faster_copy:v1":false,"beam:option:finish_bundle_before_checkpointing:v1":false,"beam:option:flink_conf_dir:v1":null,"beam:option:flink_job_server_jar:v1":"<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/runners/flink/1.16/job-server/build/libs/beam-runners-flink-1.16-job-server-2.49.0-SNAPSHOT.jar","beam>:option:flink_master:v1":"[auto]","beam:option:flink_submit_uber_jar:v1":false,"beam:option:flink_version:v1":"1.16","beam:option:gcp_oauth_scopes:v1":["https://www.googleapis.com/auth/bigquery","https://www.googleapis.com/auth/cloud-platform","https://www.googleapis.com/auth/devstorage.full_control","https://www.googleapis.com/auth/userinfo.email","https://www.googleapis.com/auth/datastore","https://www.googleapis.com/auth/spanner.admin","https://www.googleapis.com/auth/spanner.data"],"beam:option:gcs_performance_metrics:v1":false,"beam:option:hdfs_full_urls:v1":false,"beam:option:job_name:v1":"BeamApp-jenkins-0621195440-9d632e66","beam:option:job_port:v1":"0","beam:option:job_server_java_launcher:v1":"java","beam:option:job_server_jvm_properties:v1":[],"beam:option:job_server_timeout:v1":"60","beam:option:load_balance_bundles:v1":false,"beam:option:log_mdc:v1":true,"beam:option:max_parallelism:v1":"-1","beam:option:no_auth:v1":false,"beam:option:object_reuse:v1":false,"beam:option:operator_chaining:v1":true,"beam:option:options_id:v1":2,"beam:option:output_executable_path:v1":null,"beam:option:parallelism:v1":"-1","beam:option:performance_runtime_type_check:v1":false,"beam:option:pickle_library:v1":"default","beam:option:pipeline_type_check:v1":true,"beam:option:profile_cpu:v1":false,"beam:option:profile_memory:v1":false,"beam:option:profile_sample_rate:v1":1,"beam:option:project:v1":"apache-beam-testing","beam:option:re_iterable_group_by_key_result:v1":false,"beam:option:requirements_cache_only_sources:v1":false,"beam:option:resource_hints:v1":[],"beam:option:retain_docker_containers:v1":false,"beam:option:retain_externalized_checkpoints_on_cancellation:v1":false,"beam:option:runner:v1":null,"beam:option:runner_determined_sharding:v1":true,"beam:option:runtime_type_check:v1":false,"beam:option:s3_disable_ssl:v1":false,"beam:option:save_main_session:v1":false,"beam:option:sdk_harness_log_level_overrides:v1":{"org.apache.beam.runners.flink.FlinkPipelineRunner":"WARN","org.apache.flink.runtime":"WARN","org.apache.flink.runtime.metrics.groups":"ERROR"},"beam:option:sdk_location:v1":"container","beam:option:sdk_worker_parallelism:v1":"1","beam:option:spark_master_url:v1":"local[4]","beam:option:spark_submit_uber_jar:v1":false,"beam:option:spark_version:v1":"3","beam:option:streaming:v1":false,"beam:option:temp_location:v1":"gs://temp-storage-for-end-to-end-tests/temp-it","beam:option:type_check_additional:v1":"","beam:option:type_check_strictness:v1":"DEFAULT_TO_ANY","beam:option:update:v1":false,"beam:option:use_storage_api_connection_pool:v1":false,"beam:option:use_storage_write_api:v1":false,"beam:option:use_storage_write_api_at_least_once:v1":false,"beam:option:verify_row_values:v1":false}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jun 21, 2023 7:55:03 PM java.util.logging.LogManager$RootLogger log
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Failed to handle for url: "localhost:34517"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.Throwable: org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException: CANCELLED: Multiplexer hanging up
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.Status.asRuntimeException(Status.java:539)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:487)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.DelayedClientCall$DelayedListener$3.run(DelayedClientCall.java:489)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.DelayedClientCall$DelayedListener.delayOrExecute(DelayedClientCall.java:453)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.DelayedClientCall$DelayedListener.onClose(DelayedClientCall.java:486)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:576)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:70)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:757)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:736)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.lang.Thread.run(Thread.java:750)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.logging.BeamFnLoggingClient.flushFinalLogs(BeamFnLoggingClient.java:385)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.logging.BeamFnLoggingClient.lambda$new$0(BeamFnLoggingClient.java:168)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.lang.Thread.run(Thread.java:750)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Jun 21, 2023 7:55:03 PM java.util.logging.LogManager$RootLogger log
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: *~*~*~ Previous channel ManagedChannelImpl{logId=13, target=localhost:34517} was not shutdown properly!!! ~*~*~*
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.Throwable: java.lang.RuntimeException: ManagedChannel allocation site
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:102)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:60)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:51)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.ManagedChannelImplBuilder.build(ManagedChannelImplBuilder.java:631)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.vendor.grpc.v1p54p0.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:297)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:101)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.data.BeamFnDataGrpcClient.lambda$getClientFor$0(BeamFnDataGrpcClient.java:105)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.data.BeamFnDataGrpcClient.getClientFor(BeamFnDataGrpcClient.java:99)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.data.BeamFnDataGrpcClient.createOutboundAggregator(BeamFnDataGrpcClient.java:93)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler$1.lambda$addOutgoingDataEndpoint$0(ProcessBundleHandler.java:394)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.HashMap.computeIfAbsent(HashMap.java:1128)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler$1.addOutgoingDataEndpoint(ProcessBundleHandler.java:391)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.BeamFnDataWriteRunner$Factory.createRunnerForPTransform(BeamFnDataWriteRunner.java:94)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.BeamFnDataWriteRunner$Factory.createRunnerForPTransform(BeamFnDataWriteRunner.java:62)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler.createRunnerAndConsumersForPTransformRecursively(ProcessBundleHandler.java:307)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler.createRunnerAndConsumersForPTransformRecursively(ProcessBundleHandler.java:261)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler.createRunnerAndConsumersForPTransformRecursively(ProcessBundleHandler.java:261)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler.createRunnerAndConsumersForPTransformRecursively(ProcessBundleHandler.java:261)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler.createRunnerAndConsumersForPTransformRecursively(ProcessBundleHandler.java:261)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler.createBundleProcessor(ProcessBundleHandler.java:858)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler.lambda$processBundle$0(ProcessBundleHandler.java:511)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler$BundleProcessorCache.get(ProcessBundleHandler.java:969)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:507)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.lang.Thread.run(Thread.java:750)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.logging.BeamFnLoggingClient.flushFinalLogs(BeamFnLoggingClient.java:385)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.fn.harness.logging.BeamFnLoggingClient.lambda$new$0(BeamFnLoggingClient.java:168)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at java.lang.Thread.run(Thread.java:750)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:590 Job state changed to DONE
PASSED [100%]
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/usr/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 669, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 652, in _read_inputs
for elements in elements_iterator:
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 475, in __next__
return self._next()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 881, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43451 {created_time:"2023-06-21T19:54:28.611875188+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/2022703441/lib/python3.7/site-packages/google/rpc/__init__.py:18
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
import pkg_resources
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2871: 18 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2871: 13 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2350
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2350
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2871
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_postCommitIT-flink-py37.xml> -
================== 7 passed, 40 warnings in 267.78s (0:04:27) ==================
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build.gradle'> line: 96
* What went wrong:
Execution failed for task ':sdks:python:bdistPy37linux'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 28m 40s
211 actionable tasks: 156 executed, 49 from cache, 6 up-to-date
Publishing build scan...
https://ge.apache.org/s/djeulj3viehbc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python37 #6835
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/6835/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org