You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/10/09 11:46:44 UTC

Build failed in Jenkins: beam_PostCommit_XVR_Direct #4697

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4697/display/redirect>

Changes:


------------------------------------------
[...truncated 1.57 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:47 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:47 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:47 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:49 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:49 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:49 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:317 No image given, using default Python SDK image
INFO     root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc6a0940e50> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc6a0940ee0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc6a093e670> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO     root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7fdf2244da60> ====================
INFO     root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7fdf2244db80> ====================
INFO     root:portable_runner.py:542 ==================== <function pack_combiners at 0x7fdf224520d0> ====================
INFO     root:portable_runner.py:542 ==================== <function lift_combiners at 0x7fdf22452160> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_sdf at 0x7fdf22452310> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_gbk at 0x7fdf224523a0> ====================
INFO     root:portable_runner.py:542 ==================== <function sink_flattens at 0x7fdf224524c0> ====================
INFO     root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7fdf22452550> ====================
INFO     root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7fdf224525e0> ====================
INFO     root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7fdf22452670> ====================
INFO     root:portable_runner.py:542 ==================== <function sort_stages at 0x7fdf224528b0> ====================
INFO     root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7fdf224529d0> ====================
INFO     root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7fdf22452820> ====================
INFO     root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7fdf22452940> ====================
INFO     root:portable_runner.py:542 starting control server on port 40275
INFO     root:portable_runner.py:542 starting data server on port 33241
INFO     root:portable_runner.py:542 starting state server on port 33329
INFO     root:portable_runner.py:542 starting logging server on port 43943
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdf20b479a0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'cb1a463480a349fe340aac7fac8a1b9a843c7a9174e39d4540defd796e7f8c92', worker_id = worker_85
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdf57b67c70> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'86f0bc9a2c70cee3356fed0d0b27eb77ce811cafd5a4241e223e36c8b551ed4b', worker_id = worker_86
INFO     root:portable_runner.py:542 Completed job in 13.38246202468872 seconds with state DONE.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED                                                                   [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data 
-------------------------------- live log call ---------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO     root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '55853' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:55853
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:11 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:13 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:15 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:16 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:317 No image given, using default Python SDK image
INFO     root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc6a0940e50> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc6a0940ee0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc6a093e670> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO     root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7fdf2244da60> ====================
INFO     root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7fdf2244db80> ====================
INFO     root:portable_runner.py:542 ==================== <function pack_combiners at 0x7fdf224520d0> ====================
INFO     root:portable_runner.py:542 ==================== <function lift_combiners at 0x7fdf22452160> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_sdf at 0x7fdf22452310> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_gbk at 0x7fdf224523a0> ====================
INFO     root:portable_runner.py:542 ==================== <function sink_flattens at 0x7fdf224524c0> ====================
INFO     root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7fdf22452550> ====================
INFO     root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7fdf224525e0> ====================
INFO     root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7fdf22452670> ====================
INFO     root:portable_runner.py:542 ==================== <function sort_stages at 0x7fdf224528b0> ====================
INFO     root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7fdf224529d0> ====================
INFO     root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7fdf22452820> ====================
INFO     root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7fdf22452940> ====================
INFO     root:portable_runner.py:542 starting control server on port 38213
INFO     root:portable_runner.py:542 starting data server on port 43889
INFO     root:portable_runner.py:542 starting state server on port 43803
INFO     root:portable_runner.py:542 starting logging server on port 44903
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdf56fa3850> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'8a6038cdda7c7775200a48894865f4bfdc53765adaf84d3373f7d778c9d9dab1', worker_id = worker_87
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdf56f82b50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'd1e7e488f6843faf07375ac6b1d64a937f8a8ed7012b4ca15c4b41f7d8e2bb52', worker_id = worker_88
INFO     root:portable_runner.py:542 Completed job in 15.16543459892273 seconds with state DONE.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED                                                                   [100%]

=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 18 skipped, 7190 deselected, 1 warning in 252.55s (0:04:12) =====

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3106141

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3108708.
Stopping expansion service pid: 3108709.

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 36m 17s
253 actionable tasks: 167 executed, 76 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/dv5ud6ymbahpo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_XVR_Direct #4703

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4703/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #4702

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4702/display/redirect>

Changes:


------------------------------------------
[...truncated 1.58 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:53 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:317 No image given, using default Python SDK image
INFO     root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa6685ade50> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa6685adee0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa6685af670> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO     root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f94e0d1ea60> ====================
INFO     root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f94e0d1eb80> ====================
INFO     root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f94e0d200d0> ====================
INFO     root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f94e0d20160> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f94e0d20310> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f94e0d203a0> ====================
INFO     root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f94e0d204c0> ====================
INFO     root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f94e0d20550> ====================
INFO     root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f94e0d205e0> ====================
INFO     root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f94e0d20670> ====================
INFO     root:portable_runner.py:542 ==================== <function sort_stages at 0x7f94e0d208b0> ====================
INFO     root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f94e0d209d0> ====================
INFO     root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f94e0d20820> ====================
INFO     root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f94e0d20940> ====================
INFO     root:portable_runner.py:542 starting control server on port 35513
INFO     root:portable_runner.py:542 starting data server on port 45623
INFO     root:portable_runner.py:542 starting state server on port 42207
INFO     root:portable_runner.py:542 starting logging server on port 33431
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9515d65cd0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'e2d449f2527d5f0a4321f077e3cf932d1e9d7b37de5e478c748deedbe3fb8ccc', worker_id = worker_85
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9515d22a00> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'e4a4b145a86d43d8ec097e76a2c4325567b7a834371d784d431571e4927512ba', worker_id = worker_86
INFO     root:portable_runner.py:542 Completed job in 15.82540512084961 seconds with state DONE.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED                                                                   [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data 
-------------------------------- live log call ---------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO     root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '40337' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:40337
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:22 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:25 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:25 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:25 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:27 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:29 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:317 No image given, using default Python SDK image
INFO     root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa6685ade50> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa6685adee0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa6685af670> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO     root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f94e0d1ea60> ====================
INFO     root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f94e0d1eb80> ====================
INFO     root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f94e0d200d0> ====================
INFO     root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f94e0d20160> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f94e0d20310> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f94e0d203a0> ====================
INFO     root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f94e0d204c0> ====================
INFO     root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f94e0d20550> ====================
INFO     root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f94e0d205e0> ====================
INFO     root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f94e0d20670> ====================
INFO     root:portable_runner.py:542 ==================== <function sort_stages at 0x7f94e0d208b0> ====================
INFO     root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f94e0d209d0> ====================
INFO     root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f94e0d20820> ====================
INFO     root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f94e0d20940> ====================
INFO     root:portable_runner.py:542 starting control server on port 43859
INFO     root:portable_runner.py:542 starting data server on port 39413
INFO     root:portable_runner.py:542 starting state server on port 46631
INFO     root:portable_runner.py:542 starting logging server on port 36493
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f94e0c16040> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'31e91c9a02363b1b1d50c6cfb45df7d3311082b49ad0beb7c9289c8e7e143e12', worker_id = worker_87
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9515d49ee0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'ecc0d1bbcde342c333e9f0ababa3ab0461f34c305499f80731f5d4524969dc23', worker_id = worker_88
INFO     root:portable_runner.py:542 Completed job in 17.50827693939209 seconds with state DONE.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED                                                                   [100%]

=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 18 skipped, 7190 deselected, 1 warning in 294.73s (0:04:54) =====

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 430597

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 431456.
Stopping expansion service pid: 431457.

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 31m 16s
259 actionable tasks: 175 executed, 74 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/fxp3fh4etu2b6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #4701

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4701/display/redirect>

Changes:


------------------------------------------
[...truncated 675.03 KB...]
#9 365.0 Js2Py==0.74
#9 365.0 mmh3==4.0.1
#9 365.0 mock==5.1.0
#9 365.0 nltk==3.8.1
#9 365.0 nose==1.3.7
#9 365.0 numpy==1.24.4
#9 365.0 oauth2client==4.1.3
#9 365.0 objsize==0.6.1
#9 365.0 orjson==3.9.7
#9 365.0 overrides==6.5.0
#9 365.0 packaging==23.1
#9 365.0 pandas==1.5.3
#9 365.0 parameterized==0.9.0
#9 365.0 pip==23.0.1
#9 365.0 pluggy==1.3.0
#9 365.0 proto-plus==1.22.3
#9 365.0 protobuf==4.24.3
#9 365.0 psycopg2-binary==2.9.7
#9 365.0 pyarrow==11.0.0
#9 365.0 pyasn1==0.5.0
#9 365.0 pyasn1-modules==0.3.0
#9 365.0 pycparser==2.21
#9 365.0 pydot==1.4.2
#9 365.0 PyHamcrest==2.0.4
#9 365.0 pyjsparser==2.7.1
#9 365.0 pymongo==4.5.0
#9 365.0 PyMySQL==1.1.0
#9 365.0 pyparsing==3.1.1
#9 365.0 pytest==7.4.2
#9 365.0 pytest-timeout==2.1.0
#9 365.0 pytest-xdist==3.3.1
#9 365.0 python-dateutil==2.8.2
#9 365.0 python-snappy==0.6.1
#9 365.0 pytz==2023.3.post1
#9 365.0 PyYAML==6.0.1
#9 365.0 regex==2023.8.8
#9 365.0 requests==2.31.0
#9 365.0 requests-mock==1.11.0
#9 365.0 rsa==4.9
#9 365.0 scikit-learn==1.3.1
#9 365.0 scipy==1.10.1
#9 365.0 setuptools==68.2.2
#9 365.0 Shapely==1.8.5.post1
#9 365.0 six==1.16.0
#9 365.0 sortedcontainers==2.4.0
#9 365.0 soupsieve==2.5
#9 365.0 SQLAlchemy==1.4.49
#9 365.0 sqlparse==0.4.4
#9 365.0 tenacity==8.2.3
#9 365.0 testcontainers==3.7.1
#9 365.0 threadpoolctl==3.2.0
#9 365.0 tomli==2.0.1
#9 365.0 tqdm==4.66.1
#9 365.0 typing_extensions==4.8.0
#9 365.0 tzlocal==5.0.1
#9 365.0 uritemplate==4.1.1
#9 365.0 urllib3==1.26.17
#9 365.0 websocket-client==1.6.3
#9 365.0 wheel==0.41.2
#9 365.0 wrapt==1.15.0
#9 365.0 zstandard==0.21.0
#9 DONE 365.9s

#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s

#11 [third_party_licenses 2/4] COPY  target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s

#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s

#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then       pip install 'pip-licenses<5' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
#13 1.029 Collecting pip-licenses<5
#13 1.098   Downloading pip_licenses-4.3.3-py3-none-any.whl (20 kB)
#13 1.107 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.107 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.3)
#13 1.169 Collecting prettytable>=2.3.0
#13 1.184   Downloading prettytable-3.9.0-py3-none-any.whl (27 kB)
#13 1.241 Collecting wcwidth
#13 1.255   Downloading wcwidth-0.2.8-py2.py3-none-any.whl (31 kB)
#13 2.550 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.712 Successfully installed pip-licenses-4.3.3 prettytable-3.9.0 wcwidth-0.2.8
#13 2.712 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.864 
#13 2.864 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.864 [notice] To update, run: pip install --upgrade pip
#13 16.14 INFO:root:Successfully pulled licenses for 118 dependencies
#13 16.14 Skip pulling license for  bs4
#13 DONE 16.2s

#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s

#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then       rm -rf /opt/apache/beam/third_party_licenses ;     fi
#15 DONE 0.4s

#16 exporting to image
#16 exporting layers
#16 exporting layers 13.9s done
#16 writing image sha256:d61b0c9df26df7b036c6b46373c83438729ca45ab46fedc8cffd9c6b9b692f5d done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.52.0.dev done
#16 DONE 13.9s

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerSetup

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava
go1.21.2: already downloaded in /home/jenkins/sdk/go1.21.2
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.70kB done
#1 DONE 0.0s

#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s

#3 [internal] load metadata for docker.io/library/debian:bullseye
#3 DONE 0.3s

#4 [1/7] FROM docker.io/library/debian:bullseye@sha256:54d33aaad0bc936a9a40d856764c7bc35c0afaa9cab51f88bb95f6cd8004438d
#4 CACHED

#5 [internal] load build context
#5 transferring context: 22.34MB 0.2s done
#5 DONE 0.2s

#6 [2/7] RUN apt-get update &&     DEBIAN_FRONTEND=noninteractive apt-get install -y         ca-certificates         &&     rm -rf /var/lib/apt/lists/*
#6 0.414 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]
#6 0.512 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]
#6 0.550 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]
#6 0.660 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB]
#6 0.906 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [254 kB]
#6 0.941 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.4 kB]
#6 2.203 Fetched 8542 kB in 2s (4564 kB/s)
#6 2.203 Reading package lists...
#6 2.856 Reading package lists...
#6 3.511 Building dependency tree...
#6 3.672 Reading state information...
#6 3.836 The following additional packages will be installed:
#6 3.836   openssl
#6 3.881 The following NEW packages will be installed:
#6 3.882   ca-certificates openssl
#6 3.977 0 upgraded, 2 newly installed, 0 to remove and 13 not upgraded.
#6 3.977 Need to get 1017 kB of archives.
#6 3.977 After this operation, 1897 kB of additional disk space will be used.
#6 3.977 Get:1 http://deb.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1w-0+deb11u1 [859 kB]
#6 4.178 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
#6 4.331 debconf: delaying package configuration, since apt-utils is not installed
#6 4.366 Fetched 1017 kB in 0s (3477 kB/s)
#6 4.390 Selecting previously unselected package openssl.
#6 4.390 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 4.397 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ...
#6 4.401 Unpacking openssl (1.1.1w-0+deb11u1) ...
#6 4.513 Selecting previously unselected package ca-certificates.
#6 4.514 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 4.518 Unpacking ca-certificates (20210119) ...
#6 4.581 Setting up openssl (1.1.1w-0+deb11u1) ...
#6 4.597 Setting up ca-certificates (20210119) ...
#6 5.174 Updating certificates in /etc/ssl/certs...
#6 5.872 129 added, 0 removed; done.
#6 5.914 Processing triggers for ca-certificates (20210119) ...
#6 5.922 Updating certificates in /etc/ssl/certs...
#6 6.491 0 added, 0 removed; done.
#6 6.491 Running hooks in /etc/ca-certificates/update.d...
#6 6.492 done.
#6 DONE 6.9s

#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 0.2s

#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 0.1s

#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.1s

#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.1s

#11 [7/7] RUN if [ "false" = "false" ] ; then     rm -rf /opt/apache/beam/third_party_licenses ;    fi
#11 DONE 0.3s

#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:ac3b7dbf9dd247f16ba2fec1756227d45832720d6c4783d31059134483f1c9d9 done
#12 naming to docker.io/apache/beam_go_sdk:dev done
#12 DONE 0.2s
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.0
go1.21.0: already downloaded in /home/jenkins/sdk/go1.21.0
/home/jenkins/go/bin/go1.21.0 test -v ./test/integration/xlang ./test/integration/io/xlang/... -p 3 -v -timeout 3h --runner=portable --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test11118 --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test11118 --endpoint=localhost:43145 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.52.0-SNAPSHOT.jar> --expansion_jar=io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.52.0-SNAPSHOT.jar> --bq_dataset=apache-beam-testing.beam_bigquery_io_test_temp --bt_instance=projects/apache-beam-testing/instances/beam-test --expansion_addr=test:localhost:35871
# github.com/apache/beam/sdks/v2/go/test/integration
test/integration/integration.go:41:2: "os" imported and not used
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/xlang [build failed]
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery [build failed]
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigtable [build failed]
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium [build failed]
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc [build failed]
FAIL	github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka [build failed]
FAIL

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 34687
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0rc1-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp63xq3jgu/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 38459
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 34m 14s
259 actionable tasks: 172 executed, 77 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/qigdpxy4q4ij2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #4700

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4700/display/redirect>

Changes:


------------------------------------------
[...truncated 951.22 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_write:v1
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:47455.
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:47455.
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:47455.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:10 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:11 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:11 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:15 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:15 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:16 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:317 No image given, using default Python SDK image
INFO     root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fd199d710d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fd199d71160> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fd199d718b0> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO     root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f4583fe8ca0> ====================
INFO     root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f4583fe8dc0> ====================
INFO     root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f4583fe9310> ====================
INFO     root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f4583fe93a0> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f4583fe9550> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f4583fe95e0> ====================
INFO     root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f4583fe9700> ====================
INFO     root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f4583fe9790> ====================
INFO     root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f4583fe9820> ====================
INFO     root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f4583fe98b0> ====================
INFO     root:portable_runner.py:542 ==================== <function sort_stages at 0x7f4583fe9af0> ====================
INFO     root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f4583fe9c10> ====================
INFO     root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f4583fe9a60> ====================
INFO     root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f4583fe9b80> ====================
INFO     root:portable_runner.py:542 starting control server on port 36901
INFO     root:portable_runner.py:542 starting data server on port 36655
INFO     root:portable_runner.py:542 starting state server on port 35979
INFO     root:portable_runner.py:542 starting logging server on port 36057
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f45b82cb070> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'd0e6753b211c017237a0a78c68a5caa5093597be20361f3414ba902d4920fcd8', worker_id = worker_60
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f45b82eedf0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'9ee906ec017355b509545643ada8f841d7f59071385b2eecaba07cc2d720e441', worker_id = worker_61
INFO     root:portable_runner.py:542 Completed job in 31.67606806755066 seconds with state DONE.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED                                                                   [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data 
-------------------------------- live log call ---------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO     root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '48827' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:48827
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:48827.
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:48827.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:08 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:48827.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_write:v1
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:48827.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:11 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:16 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:18 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:317 No image given, using default Python SDK image
INFO     root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fd199d710d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fd199d71160> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fd199d718b0> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO     root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f4583fe8ca0> ====================
INFO     root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f4583fe8dc0> ====================
INFO     root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f4583fe9310> ====================
INFO     root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f4583fe93a0> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f4583fe9550> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f4583fe95e0> ====================
INFO     root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f4583fe9700> ====================
INFO     root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f4583fe9790> ====================
INFO     root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f4583fe9820> ====================
INFO     root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f4583fe98b0> ====================
INFO     root:portable_runner.py:542 ==================== <function sort_stages at 0x7f4583fe9af0> ====================
INFO     root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f4583fe9c10> ====================
INFO     root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f4583fe9a60> ====================
INFO     root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f4583fe9b80> ====================
INFO     root:portable_runner.py:542 starting control server on port 34453
INFO     root:portable_runner.py:542 starting data server on port 40727
INFO     root:portable_runner.py:542 starting state server on port 34445
INFO     root:portable_runner.py:542 starting logging server on port 35753
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f45b82fed90> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'b0a3361947d391aac9949ac4cbd7fe2566bf38d02ad7d7a9a7ef7cb5543a1359', worker_id = worker_62
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f458069c9a0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'908f5e953543827a92e59eafb31d190037c84ae450de3b43fb8d89c9f006b9aa', worker_id = worker_63
INFO     root:portable_runner.py:542 Completed job in 26.674621105194092 seconds with state DONE.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED                                                                   [100%]

=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 18 skipped, 7190 deselected, 1 warning in 319.29s (0:05:19) =====

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2955206

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2967013.
Stopping expansion service pid: 2967014.

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 28m 26s
259 actionable tasks: 171 executed, 78 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/pwtms67bvbbw6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #4699

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4699/display/redirect>

Changes:


------------------------------------------
[...truncated 931.34 KB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_write:v1
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:48789.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:36:58 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:36:58 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:36:58 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:00 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:00 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:01 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:317 No image given, using default Python SDK image
INFO     root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f12c45be160> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f12c45be1f0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f12c45be940> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO     root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7fbbe9fbad30> ====================
INFO     root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7fbbe9fbae50> ====================
INFO     root:portable_runner.py:542 ==================== <function pack_combiners at 0x7fbbe9fbd3a0> ====================
INFO     root:portable_runner.py:542 ==================== <function lift_combiners at 0x7fbbe9fbd430> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_sdf at 0x7fbbe9fbd5e0> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_gbk at 0x7fbbe9fbd670> ====================
INFO     root:portable_runner.py:542 ==================== <function sink_flattens at 0x7fbbe9fbd790> ====================
INFO     root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7fbbe9fbd820> ====================
INFO     root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7fbbe9fbd8b0> ====================
INFO     root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7fbbe9fbd940> ====================
INFO     root:portable_runner.py:542 ==================== <function sort_stages at 0x7fbbe9fbdb80> ====================
INFO     root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7fbbe9fbdca0> ====================
INFO     root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7fbbe9fbdaf0> ====================
INFO     root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7fbbe9fbdc10> ====================
INFO     root:portable_runner.py:542 starting control server on port 42511
INFO     root:portable_runner.py:542 starting data server on port 38141
INFO     root:portable_runner.py:542 starting state server on port 41371
INFO     root:portable_runner.py:542 starting logging server on port 44501
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbc1fc23f70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'e549ef08850812edb112abc63e78bee6c5321b64fbbd9a7a75e7a4a1191c48aa', worker_id = worker_60
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbc1fc277f0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'8763f874f6ef15c96ec8ab19dafd7d05c7a0aea8781bbe3f56017d72eb290178', worker_id = worker_61
INFO     root:portable_runner.py:542 Completed job in 31.403474807739258 seconds with state DONE.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED                                                                   [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data 
-------------------------------- live log call ---------------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO     root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar> 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '35439' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:35439
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:35439.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:50 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:spanner_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:kafka_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	schematransform:org.apache.beam:sql_transform:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsub_write:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:bigtable_read:v1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	beam:schematransform:org.apache.beam:pubsublite_write:v1
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:35439.
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:35439.
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:35439.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:54 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:55 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:56 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:38:03 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:38:14 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126   BeamValuesRel(tuples=[[{ 0 }]])
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     root:environments.py:317 No image given, using default Python SDK image
INFO     root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f12c45be160> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f12c45be1f0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f12c45be940> ====================
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO     root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7fbbe9fbad30> ====================
INFO     root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7fbbe9fbae50> ====================
INFO     root:portable_runner.py:542 ==================== <function pack_combiners at 0x7fbbe9fbd3a0> ====================
INFO     root:portable_runner.py:542 ==================== <function lift_combiners at 0x7fbbe9fbd430> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_sdf at 0x7fbbe9fbd5e0> ====================
INFO     root:portable_runner.py:542 ==================== <function expand_gbk at 0x7fbbe9fbd670> ====================
INFO     root:portable_runner.py:542 ==================== <function sink_flattens at 0x7fbbe9fbd790> ====================
INFO     root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7fbbe9fbd820> ====================
INFO     root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7fbbe9fbd8b0> ====================
INFO     root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7fbbe9fbd940> ====================
INFO     root:portable_runner.py:542 ==================== <function sort_stages at 0x7fbbe9fbdb80> ====================
INFO     root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7fbbe9fbdca0> ====================
INFO     root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7fbbe9fbdaf0> ====================
INFO     root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7fbbe9fbdc10> ====================
INFO     root:portable_runner.py:542 starting control server on port 45875
INFO     root:portable_runner.py:542 starting data server on port 42811
INFO     root:portable_runner.py:542 starting state server on port 39209
INFO     root:portable_runner.py:542 starting logging server on port 35175
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbc1fd6d280> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'51e9d5058249ba34e4cca2ab75bc516a2b26353562243c31fbea55ef048a0eef', worker_id = worker_62
INFO     root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbc1fd21880> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO     root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO     root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO     root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO     root:portable_runner.py:542 Docker container is running. container_id = b'b1dc438d9851b0a3ef60eeedbd5c6885db1d455611aedb9e49d36625704f1b41', worker_id = worker_63
INFO     root:portable_runner.py:542 Completed job in 21.192819833755493 seconds with state DONE.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED                                                                   [100%]

=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 18 skipped, 7190 deselected, 1 warning in 333.13s (0:05:33) =====

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2802068

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2808229.
Stopping expansion service pid: 2808230.

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 28m 47s
259 actionable tasks: 175 executed, 74 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/giwvmbqg5r7d2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #4698

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4698/display/redirect?page=changes>

Changes:

[noreply] Bump golang.org/x/sync from 0.3.0 to 0.4.0 in /sdks (#28856)


------------------------------------------
[...truncated 170.81 KB...]
  Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting scipy>=1.5.0 (from scikit-learn>=0.20.0->apache-beam==2.52.0.dev0)
  Using cached scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
Collecting threadpoolctl>=2.0.0 (from scikit-learn>=0.20.0->apache-beam==2.52.0.dev0)
  Obtaining dependency information for threadpoolctl>=2.0.0 from https://files.pythonhosted.org/packages/81/12/fd4dea011af9d69e1cad05c75f3f7202cdcbeac9b712eea58ca779a72865/threadpoolctl-3.2.0-py3-none-any.whl.metadata
  Using cached threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB)
Collecting greenlet!=0.4.17 (from sqlalchemy<2.0,>=1.3->apache-beam==2.52.0.dev0)
  Obtaining dependency information for greenlet!=0.4.17 from https://files.pythonhosted.org/packages/75/5a/4ecc17749c54882dd3422befcd35fec5128ae2a72138844899322af0b55a/greenlet-3.0.0-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata
  Using cached greenlet-3.0.0-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (3.8 kB)
Collecting docker>=4.0.0 (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.52.0.dev0)
  Obtaining dependency information for docker>=4.0.0 from https://files.pythonhosted.org/packages/db/be/3032490fa33b36ddc8c4b1da3252c6f974e7133f1a50de00c6b85cca203a/docker-6.1.3-py3-none-any.whl.metadata
  Using cached docker-6.1.3-py3-none-any.whl.metadata (3.5 kB)
Collecting wrapt (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.52.0.dev0)
  Obtaining dependency information for wrapt from https://files.pythonhosted.org/packages/a6/48/c52023d1446741268a35c60d7f1bfc23060e8683ec581121049f4183507a/wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
  Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB)
Collecting deprecation (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.52.0.dev0)
  Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.52.0.dev0)
  Obtaining dependency information for pymysql from https://files.pythonhosted.org/packages/e5/30/20467e39523d0cfc2b6227902d3687a16364307260c75e6a1cb4422b0c62/PyMySQL-1.1.0-py3-none-any.whl.metadata
  Using cached PyMySQL-1.1.0-py3-none-any.whl.metadata (4.4 kB)
Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0->apache-beam==2.52.0.dev0)
  Obtaining dependency information for urllib3<3,>=1.21.1 from https://files.pythonhosted.org/packages/48/fe/a5c6cc46e9fe9171d7ecf0f33ee7aae14642f8d74baa7af4d7840f9358be/urllib3-1.26.17-py2.py3-none-any.whl.metadata
  Using cached urllib3-1.26.17-py2.py3-none-any.whl.metadata (48 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=41.0.2->apache-beam==2.52.0.dev0)
  Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0 (from docker>=4.0.0->testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.52.0.dev0)
  Obtaining dependency information for websocket-client>=0.32.0 from https://files.pythonhosted.org/packages/c4/3c/1892ce394828c43d4f65248ebdee3854114266b75d1f5915cb211155ad7b/websocket_client-1.6.4-py3-none-any.whl.metadata
  Using cached websocket_client-1.6.4-py3-none-any.whl.metadata (7.7 kB)
Collecting google-crc32c<2.0dev,>=1.0 (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=2.0.0->apache-beam==2.52.0.dev0)
  Using cached google_crc32c-1.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (32 kB)
Collecting PyJWT[crypto]<3,>=1.0.0 (from msal<2.0.0,>=1.20.0->azure-identity<2,>=1.12.0->apache-beam==2.52.0.dev0)
  Obtaining dependency information for PyJWT[crypto]<3,>=1.0.0 from https://files.pythonhosted.org/packages/2b/4f/e04a8067c7c96c364cef7ef73906504e2f40d690811c021e1a1901473a19/PyJWT-2.8.0-py3-none-any.whl.metadata
  Using cached PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB)
Collecting portalocker<3,>=1.0 (from msal-extensions<2.0.0,>=0.3.0->azure-identity<2,>=1.12.0->apache-beam==2.52.0.dev0)
  Obtaining dependency information for portalocker<3,>=1.0 from https://files.pythonhosted.org/packages/17/9e/87671efcca80ba6203811540ed1f9c0462c1609d2281d7b7f53cef05da3d/portalocker-2.8.2-py3-none-any.whl.metadata
  Using cached portalocker-2.8.2-py3-none-any.whl.metadata (8.5 kB)
Collecting pyasn1>=0.1.7 (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam==2.52.0.dev0)
  Using cached pyasn1-0.5.0-py2.py3-none-any.whl (83 kB)
Collecting backports.zoneinfo (from tzlocal>=1.2->js2py<1,>=0.74->apache-beam==2.52.0.dev0)
  Using cached backports.zoneinfo-0.2.1-cp38-cp38-manylinux1_x86_64.whl (74 kB)
Using cached azure_core-1.29.4-py3-none-any.whl (192 kB)
Using cached azure_identity-1.15.0b1-py3-none-any.whl (162 kB)
Using cached azure_storage_blob-12.18.2-py3-none-any.whl (392 kB)
Using cached boto3-1.28.62-py3-none-any.whl (135 kB)
Using cached cryptography-41.0.4-cp37-abi3-manylinux_2_28_x86_64.whl (4.4 MB)
Using cached fastavro-1.8.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Using cached fasteners-0.19-py3-none-any.whl (18 kB)
Using cached google_api_core-2.12.0-py3-none-any.whl (121 kB)
Using cached google_auth-2.23.2-py2.py3-none-any.whl (181 kB)
Using cached google_auth_httplib2-0.1.1-py2.py3-none-any.whl (9.3 kB)
Using cached google_cloud_aiplatform-1.34.0-py2.py3-none-any.whl (3.1 MB)
Using cached google_cloud_bigquery-3.12.0-py2.py3-none-any.whl (220 kB)
Using cached google_cloud_bigquery_storage-2.22.0-py2.py3-none-any.whl (190 kB)
Using cached google_cloud_bigtable-2.21.0-py2.py3-none-any.whl (293 kB)
Using cached google_cloud_core-2.3.3-py2.py3-none-any.whl (29 kB)
Using cached google_cloud_datastore-2.18.0-py2.py3-none-any.whl (177 kB)
Using cached google_cloud_dlp-3.12.3-py2.py3-none-any.whl (143 kB)
Using cached google_cloud_language-2.11.1-py2.py3-none-any.whl (138 kB)
Using cached google_cloud_pubsub-2.18.4-py2.py3-none-any.whl (265 kB)
Using cached google_cloud_pubsublite-1.8.3-py2.py3-none-any.whl (288 kB)
Using cached google_cloud_recommendations_ai-0.10.5-py2.py3-none-any.whl (173 kB)
Using cached google_cloud_spanner-3.40.1-py2.py3-none-any.whl (332 kB)
Using cached google_cloud_videointelligence-2.11.4-py2.py3-none-any.whl (229 kB)
Using cached google_cloud_vision-3.4.4-py2.py3-none-any.whl (444 kB)
Using cached hypothesis-6.87.3-py3-none-any.whl (420 kB)
Using cached joblib-1.3.2-py3-none-any.whl (302 kB)
Using cached mock-5.1.0-py3-none-any.whl (30 kB)
Using cached orjson-3.9.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB)
Using cached proto_plus-1.22.3-py3-none-any.whl (48 kB)
Using cached psycopg2_binary-2.9.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Using cached pymongo-4.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (687 kB)
Using cached pytest-7.4.2-py3-none-any.whl (324 kB)
Using cached pytest_timeout-2.2.0-py3-none-any.whl (13 kB)
Using cached pytest_xdist-3.3.1-py3-none-any.whl (41 kB)
Using cached pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached regex-2023.10.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (776 kB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached requests_mock-1.11.0-py2.py3-none-any.whl (28 kB)
Using cached scikit_learn-1.3.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.1 MB)
Using cached SQLAlchemy-1.4.49-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Using cached botocore-1.31.62-py3-none-any.whl (11.2 MB)
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Using cached cffi-1.16.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (444 kB)
Using cached charset_normalizer-3.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (137 kB)
Using cached dnspython-2.4.2-py3-none-any.whl (300 kB)
Using cached docker-6.1.3-py3-none-any.whl (148 kB)
Using cached exceptiongroup-1.1.3-py3-none-any.whl (14 kB)
Using cached execnet-2.0.2-py3-none-any.whl (37 kB)
Using cached google_cloud_resource_manager-1.10.4-py2.py3-none-any.whl (320 kB)
Using cached google_cloud_storage-2.11.0-py2.py3-none-any.whl (118 kB)
Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl (80 kB)
Using cached googleapis_common_protos-1.60.0-py2.py3-none-any.whl (227 kB)
Using cached greenlet-3.0.0-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (617 kB)
Using cached grpcio_status-1.59.0-py3-none-any.whl (14 kB)
Using cached msal-1.24.1-py2.py3-none-any.whl (95 kB)
Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB)
Using cached s3transfer-0.7.0-py3-none-any.whl (79 kB)
Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Using cached tzlocal-5.1-py3-none-any.whl (21 kB)
Using cached urllib3-1.26.17-py2.py3-none-any.whl (143 kB)
Using cached PyMySQL-1.1.0-py3-none-any.whl (44 kB)
Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (82 kB)
Using cached portalocker-2.8.2-py3-none-any.whl (17 kB)
Using cached websocket_client-1.6.4-py3-none-any.whl (57 kB)
Using cached PyJWT-2.8.0-py3-none-any.whl (22 kB)
Building wheels for collected packages: apache-beam
  Building wheel for apache-beam (setup.py): started

> Task :release:go-licenses:py:dockerRun
W1009 17:22:28.834660      85 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
+ chmod -R a+w /output/licenses

> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py38:copyGolangLicenses
> Task :sdks:python:container:py38:dockerPrepare

> Task :sdks:go:container:docker
#6 11.46 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
#6 13.95 debconf: delaying package configuration, since apt-utils is not installed
#6 14.06 Fetched 1017 kB in 0s (2992 kB/s)
#6 14.80 Selecting previously unselected package openssl.
#6 14.80 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 15.20 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ...
#6 15.29 Unpacking openssl (1.1.1w-0+deb11u1) ...
#6 15.65 Selecting previously unselected package ca-certificates.
#6 15.67 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 15.67 Unpacking ca-certificates (20210119) ...
#6 16.01 Setting up openssl (1.1.1w-0+deb11u1) ...
#6 16.20 Setting up ca-certificates (20210119) ...
#6 17.20 Updating certificates in /etc/ssl/certs...
#6 18.28 129 added, 0 removed; done.
#6 18.33 Processing triggers for ca-certificates (20210119) ...
#6 18.34 Updating certificates in /etc/ssl/certs...
#6 18.94 0 added, 0 removed; done.
#6 18.94 Running hooks in /etc/ca-certificates/update.d...
#6 18.94 done.
#6 DONE 20.5s

#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 1.4s

#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 1.9s

#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.2s

#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.2s

#11 [7/7] RUN if [ "true" = "false" ] ; then     rm -rf /opt/apache/beam/third_party_licenses ;    fi
#11 DONE 0.6s

#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:330ddc164dfa5adf9b6d6ae50d408ad388ba2635ee9c5700a10c25ce8adff5d1 done
#12 naming to docker.io/apache/beam_go_sdk:latest done
#12 DONE 0.2s

> Task :sdks:java:extensions:sql:expansion-service:shadowJar FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeClassesDependencies FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeTestClassesDependencies SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeDependencies UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleTest NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:javadoc NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsTest SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:test NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:check UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:build

> Task :sdks:python:container:py38:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 4.99kB done
#1 DONE 0.0s

#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s

#3 [internal] load metadata for docker.io/library/python:3.8-bullseye
#3 DONE 0.3s

#4 [beam 1/5] FROM docker.io/library/python:3.8-bullseye@sha256:8d742d4588683dd228042ffc042fc86799c414457821eaa959dc0f9af8ce43af
#4 CACHED

#5 [internal] load build context
#5 transferring context: 2.48MB 0.0s done
#5 DONE 0.0s

#6 [beam 2/5] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
#6 CACHED

#7 [beam 3/5] COPY target/apache-beam.tar.gz /opt/apache/beam/tars/
#7 CACHED

#8 [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/
#8 ERROR: "/target/launcher/linux_amd64/boot" not found: not found

#6 [beam 2/5] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
#6 CANCELED
------
 > [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/:
------
ERROR: failed to solve: failed to compute cache key: "/target/launcher/linux_amd64/boot" not found: not found

> Task :sdks:python:container:py38:docker FAILED

> Task :sdks:python:installGcpTest
Successfully installed PyJWT-2.8.0 apache-beam-2.52.0.dev0 attrs-23.1.0 azure-core-1.29.4 azure-identity-1.15.0b1 azure-storage-blob-12.18.2 backports.zoneinfo-0.2.1 boto3-1.28.62 botocore-1.31.62 certifi-2023.7.22 cffi-1.16.0 charset-normalizer-3.3.0 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.4 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-6.1.3 docopt-0.6.2 exceptiongroup-1.1.3 execnet-2.0.2 fastavro-1.8.4 fasteners-0.19 freezegun-1.2.2 google-api-core-2.12.0 google-apitools-0.5.31 google-auth-2.23.2 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.34.0 google-cloud-bigquery-3.12.0 google-cloud-bigquery-storage-2.22.0 google-cloud-bigtable-2.21.0 google-cloud-core-2.3.3 google-cloud-datastore-2.18.0 google-cloud-dlp-3.12.3 google-cloud-language-2.11.1 google-cloud-pubsub-2.18.4 google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.5 google-cloud-resource-manager-1.10.4 google-cloud-spanner-3.40.1 google-cloud-storage-2.11.0 google-cloud-videointelligence-2.11.4 google-cloud-vision-3.4.4 google-crc32c-1.5.0 google-resumable-media-2.6.0 googleapis-common-protos-1.60.0 greenlet-3.0.0 grpc-google-iam-v1-0.12.6 grpcio-status-1.59.0 hdfs-2.7.2 httplib2-0.22.0 hypothesis-6.87.3 idna-3.4 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 js2py-0.74 mock-5.1.0 msal-1.24.1 msal-extensions-1.0.0 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.7 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 portalocker-2.8.2 proto-plus-1.22.3 psycopg2-binary-2.9.9 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.0.4 pyjsparser-2.7.1 pymongo-4.5.0 pymysql-1.1.0 pyparsing-3.1.1 pytest-7.4.2 pytest-timeout-2.2.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3.post1 pyyaml-6.0.1 regex-2023.10.3 requests-2.31.0 requests_mock-1.11.0 rsa-4.9 s3transfer-0.7.0 scikit-learn-1.3.1 scipy-1.10.1 shapely-1.8.5.post1 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.49 sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 typing-extensions-4.8.0 tzlocal-5.1 urllib3-1.26.17 websocket-client-1.6.4 wrapt-1.16.0rc1 zstandard-0.21.0

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
Waiting for server to start up...
Server started at port 37489

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 852746

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 2m 33s
246 actionable tasks: 160 executed, 76 from cache, 10 up-to-date

Publishing build scan...
https://ge.apache.org/s/zgp5pvaleq2se

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org