You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/10/09 11:46:44 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4697
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4697/display/redirect>
Changes:
------------------------------------------
[...truncated 1.57 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:47 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:47 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:47 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:49 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:49 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:45:49 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc6a0940e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc6a0940ee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc6a093e670> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7fdf2244da60> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7fdf2244db80> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7fdf224520d0> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7fdf22452160> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7fdf22452310> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7fdf224523a0> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7fdf224524c0> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7fdf22452550> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7fdf224525e0> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7fdf22452670> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7fdf224528b0> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7fdf224529d0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7fdf22452820> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7fdf22452940> ====================
INFO root:portable_runner.py:542 starting control server on port 40275
INFO root:portable_runner.py:542 starting data server on port 33241
INFO root:portable_runner.py:542 starting state server on port 33329
INFO root:portable_runner.py:542 starting logging server on port 43943
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdf20b479a0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'cb1a463480a349fe340aac7fac8a1b9a843c7a9174e39d4540defd796e7f8c92', worker_id = worker_85
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdf57b67c70> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'86f0bc9a2c70cee3356fed0d0b27eb77ce811cafd5a4241e223e36c8b551ed4b', worker_id = worker_86
INFO root:portable_runner.py:542 Completed job in 13.38246202468872 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '55853' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:55853
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:11 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:12 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:13 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:15 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:46:16 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fc6a0940e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fc6a0940ee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fc6a093e670> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7fdf2244da60> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7fdf2244db80> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7fdf224520d0> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7fdf22452160> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7fdf22452310> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7fdf224523a0> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7fdf224524c0> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7fdf22452550> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7fdf224525e0> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7fdf22452670> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7fdf224528b0> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7fdf224529d0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7fdf22452820> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7fdf22452940> ====================
INFO root:portable_runner.py:542 starting control server on port 38213
INFO root:portable_runner.py:542 starting data server on port 43889
INFO root:portable_runner.py:542 starting state server on port 43803
INFO root:portable_runner.py:542 starting logging server on port 44903
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdf56fa3850> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'8a6038cdda7c7775200a48894865f4bfdc53765adaf84d3373f7d778c9d9dab1', worker_id = worker_87
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fdf56f82b50> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'd1e7e488f6843faf07375ac6b1d64a937f8a8ed7012b4ca15c4b41f7d8e2bb52', worker_id = worker_88
INFO root:portable_runner.py:542 Completed job in 15.16543459892273 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 18 skipped, 7190 deselected, 1 warning in 252.55s (0:04:12) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3106141
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3108708.
Stopping expansion service pid: 3108709.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 36m 17s
253 actionable tasks: 167 executed, 76 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/dv5ud6ymbahpo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Direct #4703
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4703/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4702
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4702/display/redirect>
Changes:
------------------------------------------
[...truncated 1.58 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:53 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:53 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:42:55 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa6685ade50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa6685adee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa6685af670> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f94e0d1ea60> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f94e0d1eb80> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f94e0d200d0> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f94e0d20160> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f94e0d20310> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f94e0d203a0> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f94e0d204c0> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f94e0d20550> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f94e0d205e0> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f94e0d20670> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7f94e0d208b0> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f94e0d209d0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f94e0d20820> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f94e0d20940> ====================
INFO root:portable_runner.py:542 starting control server on port 35513
INFO root:portable_runner.py:542 starting data server on port 45623
INFO root:portable_runner.py:542 starting state server on port 42207
INFO root:portable_runner.py:542 starting logging server on port 33431
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9515d65cd0> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'e2d449f2527d5f0a4321f077e3cf932d1e9d7b37de5e478c748deedbe3fb8ccc', worker_id = worker_85
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9515d22a00> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'e4a4b145a86d43d8ec097e76a2c4325567b7a834371d784d431571e4927512ba', worker_id = worker_86
INFO root:portable_runner.py:542 Completed job in 15.82540512084961 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '40337' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:40337
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:22 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:25 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:25 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:25 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:27 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:43:29 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fa6685ade50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fa6685adee0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fa6685af670> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f94e0d1ea60> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f94e0d1eb80> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f94e0d200d0> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f94e0d20160> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f94e0d20310> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f94e0d203a0> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f94e0d204c0> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f94e0d20550> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f94e0d205e0> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f94e0d20670> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7f94e0d208b0> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f94e0d209d0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f94e0d20820> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f94e0d20940> ====================
INFO root:portable_runner.py:542 starting control server on port 43859
INFO root:portable_runner.py:542 starting data server on port 39413
INFO root:portable_runner.py:542 starting state server on port 46631
INFO root:portable_runner.py:542 starting logging server on port 36493
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f94e0c16040> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'31e91c9a02363b1b1d50c6cfb45df7d3311082b49ad0beb7c9289c8e7e143e12', worker_id = worker_87
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f9515d49ee0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'ecc0d1bbcde342c333e9f0ababa3ab0461f34c305499f80731f5d4524969dc23', worker_id = worker_88
INFO root:portable_runner.py:542 Completed job in 17.50827693939209 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 18 skipped, 7190 deselected, 1 warning in 294.73s (0:04:54) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 430597
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 431456.
Stopping expansion service pid: 431457.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 31m 16s
259 actionable tasks: 175 executed, 74 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/fxp3fh4etu2b6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4701
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4701/display/redirect>
Changes:
------------------------------------------
[...truncated 675.03 KB...]
#9 365.0 Js2Py==0.74
#9 365.0 mmh3==4.0.1
#9 365.0 mock==5.1.0
#9 365.0 nltk==3.8.1
#9 365.0 nose==1.3.7
#9 365.0 numpy==1.24.4
#9 365.0 oauth2client==4.1.3
#9 365.0 objsize==0.6.1
#9 365.0 orjson==3.9.7
#9 365.0 overrides==6.5.0
#9 365.0 packaging==23.1
#9 365.0 pandas==1.5.3
#9 365.0 parameterized==0.9.0
#9 365.0 pip==23.0.1
#9 365.0 pluggy==1.3.0
#9 365.0 proto-plus==1.22.3
#9 365.0 protobuf==4.24.3
#9 365.0 psycopg2-binary==2.9.7
#9 365.0 pyarrow==11.0.0
#9 365.0 pyasn1==0.5.0
#9 365.0 pyasn1-modules==0.3.0
#9 365.0 pycparser==2.21
#9 365.0 pydot==1.4.2
#9 365.0 PyHamcrest==2.0.4
#9 365.0 pyjsparser==2.7.1
#9 365.0 pymongo==4.5.0
#9 365.0 PyMySQL==1.1.0
#9 365.0 pyparsing==3.1.1
#9 365.0 pytest==7.4.2
#9 365.0 pytest-timeout==2.1.0
#9 365.0 pytest-xdist==3.3.1
#9 365.0 python-dateutil==2.8.2
#9 365.0 python-snappy==0.6.1
#9 365.0 pytz==2023.3.post1
#9 365.0 PyYAML==6.0.1
#9 365.0 regex==2023.8.8
#9 365.0 requests==2.31.0
#9 365.0 requests-mock==1.11.0
#9 365.0 rsa==4.9
#9 365.0 scikit-learn==1.3.1
#9 365.0 scipy==1.10.1
#9 365.0 setuptools==68.2.2
#9 365.0 Shapely==1.8.5.post1
#9 365.0 six==1.16.0
#9 365.0 sortedcontainers==2.4.0
#9 365.0 soupsieve==2.5
#9 365.0 SQLAlchemy==1.4.49
#9 365.0 sqlparse==0.4.4
#9 365.0 tenacity==8.2.3
#9 365.0 testcontainers==3.7.1
#9 365.0 threadpoolctl==3.2.0
#9 365.0 tomli==2.0.1
#9 365.0 tqdm==4.66.1
#9 365.0 typing_extensions==4.8.0
#9 365.0 tzlocal==5.0.1
#9 365.0 uritemplate==4.1.1
#9 365.0 urllib3==1.26.17
#9 365.0 websocket-client==1.6.3
#9 365.0 wheel==0.41.2
#9 365.0 wrapt==1.15.0
#9 365.0 zstandard==0.21.0
#9 DONE 365.9s
#10 [third_party_licenses 1/4] COPY target/license_scripts /tmp/license_scripts/
#10 DONE 0.1s
#11 [third_party_licenses 2/4] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#11 DONE 0.1s
#12 [third_party_licenses 3/4] COPY target/license_scripts /tmp/license_scripts/
#12 DONE 0.1s
#13 [third_party_licenses 4/4] RUN if [ "true" = "true" ] ; then pip install 'pip-licenses<5' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
#13 1.029 Collecting pip-licenses<5
#13 1.098 Downloading pip_licenses-4.3.3-py3-none-any.whl (20 kB)
#13 1.107 Requirement already satisfied: pyyaml in /usr/local/lib/python3.8/site-packages (6.0.1)
#13 1.107 Requirement already satisfied: tenacity in /usr/local/lib/python3.8/site-packages (8.2.3)
#13 1.169 Collecting prettytable>=2.3.0
#13 1.184 Downloading prettytable-3.9.0-py3-none-any.whl (27 kB)
#13 1.241 Collecting wcwidth
#13 1.255 Downloading wcwidth-0.2.8-py2.py3-none-any.whl (31 kB)
#13 2.550 Installing collected packages: wcwidth, prettytable, pip-licenses
#13 2.712 Successfully installed pip-licenses-4.3.3 prettytable-3.9.0 wcwidth-0.2.8
#13 2.712 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
#13 2.864
#13 2.864 [notice] A new release of pip is available: 23.0.1 -> 23.2.1
#13 2.864 [notice] To update, run: pip install --upgrade pip
#13 16.14 INFO:root:Successfully pulled licenses for 118 dependencies
#13 16.14 Skip pulling license for bs4
#13 DONE 16.2s
#14 [stage-2 1/2] COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
#14 DONE 0.1s
#15 [stage-2 2/2] RUN if [ "true" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#15 DONE 0.4s
#16 exporting to image
#16 exporting layers
#16 exporting layers 13.9s done
#16 writing image sha256:d61b0c9df26df7b036c6b46373c83438729ca45ab46fedc8cffd9c6b9b692f5d done
#16 naming to docker.io/apache/beam_python3.8_sdk:2.52.0.dev done
#16 DONE 13.9s
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerSetup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava
go1.21.2: already downloaded in /home/jenkins/sdk/go1.21.2
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 1.70kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/debian:bullseye
#3 DONE 0.3s
#4 [1/7] FROM docker.io/library/debian:bullseye@sha256:54d33aaad0bc936a9a40d856764c7bc35c0afaa9cab51f88bb95f6cd8004438d
#4 CACHED
#5 [internal] load build context
#5 transferring context: 22.34MB 0.2s done
#5 DONE 0.2s
#6 [2/7] RUN apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y ca-certificates && rm -rf /var/lib/apt/lists/*
#6 0.414 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]
#6 0.512 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]
#6 0.550 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]
#6 0.660 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB]
#6 0.906 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [254 kB]
#6 0.941 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [17.4 kB]
#6 2.203 Fetched 8542 kB in 2s (4564 kB/s)
#6 2.203 Reading package lists...
#6 2.856 Reading package lists...
#6 3.511 Building dependency tree...
#6 3.672 Reading state information...
#6 3.836 The following additional packages will be installed:
#6 3.836 openssl
#6 3.881 The following NEW packages will be installed:
#6 3.882 ca-certificates openssl
#6 3.977 0 upgraded, 2 newly installed, 0 to remove and 13 not upgraded.
#6 3.977 Need to get 1017 kB of archives.
#6 3.977 After this operation, 1897 kB of additional disk space will be used.
#6 3.977 Get:1 http://deb.debian.org/debian bullseye/main amd64 openssl amd64 1.1.1w-0+deb11u1 [859 kB]
#6 4.178 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
#6 4.331 debconf: delaying package configuration, since apt-utils is not installed
#6 4.366 Fetched 1017 kB in 0s (3477 kB/s)
#6 4.390 Selecting previously unselected package openssl.
#6 4.390 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 4.397 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ...
#6 4.401 Unpacking openssl (1.1.1w-0+deb11u1) ...
#6 4.513 Selecting previously unselected package ca-certificates.
#6 4.514 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 4.518 Unpacking ca-certificates (20210119) ...
#6 4.581 Setting up openssl (1.1.1w-0+deb11u1) ...
#6 4.597 Setting up ca-certificates (20210119) ...
#6 5.174 Updating certificates in /etc/ssl/certs...
#6 5.872 129 added, 0 removed; done.
#6 5.914 Processing triggers for ca-certificates (20210119) ...
#6 5.922 Updating certificates in /etc/ssl/certs...
#6 6.491 0 added, 0 removed; done.
#6 6.491 Running hooks in /etc/ca-certificates/update.d...
#6 6.492 done.
#6 DONE 6.9s
#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 0.2s
#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 0.1s
#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.1s
#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.1s
#11 [7/7] RUN if [ "false" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#11 DONE 0.3s
#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:ac3b7dbf9dd247f16ba2fec1756227d45832720d6c4783d31059134483f1c9d9 done
#12 naming to docker.io/apache/beam_go_sdk:dev done
#12 DONE 0.2s
System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.21.0
go1.21.0: already downloaded in /home/jenkins/sdk/go1.21.0
/home/jenkins/go/bin/go1.21.0 test -v ./test/integration/xlang ./test/integration/io/xlang/... -p 3 -v -timeout 3h --runner=portable --project=apache-beam-testing --region=us-central1 --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test11118 --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test11118 --endpoint=localhost:43145 --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.52.0-SNAPSHOT.jar> --expansion_jar=io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.52.0-SNAPSHOT.jar> --expansion_jar=gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.52.0-SNAPSHOT.jar> --bq_dataset=apache-beam-testing.beam_bigquery_io_test_temp --bt_instance=projects/apache-beam-testing/instances/beam-test --expansion_addr=test:localhost:35871
# github.com/apache/beam/sdks/v2/go/test/integration
test/integration/integration.go:41:2: "os" imported and not used
FAIL github.com/apache/beam/sdks/v2/go/test/integration/xlang [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigtable [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc [build failed]
FAIL github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka [build failed]
FAIL
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 34687
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
INFO:apache_beam.runners.portability.stager:Executing command: ['/home/jenkins/.apache_beam/cache/venvs/py-3.8-beam-2.51.0rc1-743bdccef67087512a7a190820e727aab7bdcb14/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', '/tmp/tmp63xq3jgu/tmp_requirements.txt', '--exists-action', 'i', '--no-deps', '--implementation', 'cp', '--abi', 'cp38', '--platform', 'manylinux2014_x86_64']
INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.51.0rc1" for Docker environment
INFO:__main__:Listening for expansion requests at 38459
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 34m 14s
259 actionable tasks: 172 executed, 77 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/qigdpxy4q4ij2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4700
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4700/display/redirect>
Changes:
------------------------------------------
[...truncated 951.22 KB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:47455.
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:47455.
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:47455.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:10 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:11 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:11 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:15 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:15 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:37:16 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fd199d710d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fd199d71160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fd199d718b0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f4583fe8ca0> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f4583fe8dc0> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f4583fe9310> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f4583fe93a0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f4583fe9550> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f4583fe95e0> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f4583fe9700> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f4583fe9790> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f4583fe9820> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f4583fe98b0> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7f4583fe9af0> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f4583fe9c10> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f4583fe9a60> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f4583fe9b80> ====================
INFO root:portable_runner.py:542 starting control server on port 36901
INFO root:portable_runner.py:542 starting data server on port 36655
INFO root:portable_runner.py:542 starting state server on port 35979
INFO root:portable_runner.py:542 starting logging server on port 36057
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f45b82cb070> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'd0e6753b211c017237a0a78c68a5caa5093597be20361f3414ba902d4920fcd8', worker_id = worker_60
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f45b82eedf0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'9ee906ec017355b509545643ada8f841d7f59071385b2eecaba07cc2d720e441', worker_id = worker_61
INFO root:portable_runner.py:542 Completed job in 31.67606806755066 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '48827' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:48827
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:48827.
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:48827.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:08 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:48827.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:48827.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:11 AM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:12 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:16 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2023 5:38:18 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7fd199d710d0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7fd199d71160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7fd199d718b0> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7f4583fe8ca0> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7f4583fe8dc0> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7f4583fe9310> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7f4583fe93a0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7f4583fe9550> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7f4583fe95e0> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7f4583fe9700> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7f4583fe9790> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7f4583fe9820> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7f4583fe98b0> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7f4583fe9af0> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7f4583fe9c10> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7f4583fe9a60> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7f4583fe9b80> ====================
INFO root:portable_runner.py:542 starting control server on port 34453
INFO root:portable_runner.py:542 starting data server on port 40727
INFO root:portable_runner.py:542 starting state server on port 34445
INFO root:portable_runner.py:542 starting logging server on port 35753
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f45b82fed90> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'b0a3361947d391aac9949ac4cbd7fe2566bf38d02ad7d7a9a7ef7cb5543a1359', worker_id = worker_62
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7f458069c9a0> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'908f5e953543827a92e59eafb31d190037c84ae450de3b43fb8d89c9f006b9aa', worker_id = worker_63
INFO root:portable_runner.py:542 Completed job in 26.674621105194092 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 18 skipped, 7190 deselected, 1 warning in 319.29s (0:05:19) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2955206
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2967013.
Stopping expansion service pid: 2967014.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 26s
259 actionable tasks: 171 executed, 78 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/pwtms67bvbbw6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4699
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4699/display/redirect>
Changes:
------------------------------------------
[...truncated 931.34 KB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:48789.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:36:58 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:36:58 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:36:58 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:00 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQL:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 SELECT COUNT(*) AS `count`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:00 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: SQLPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 LogicalAggregate(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:01 PM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamAggregationRel(group=[{}], count=[COUNT()])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamIOSourceRel(table=[[beam, PCOLLECTION]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f12c45be160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f12c45be1f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f12c45be940> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7fbbe9fbad30> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7fbbe9fbae50> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7fbbe9fbd3a0> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7fbbe9fbd430> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7fbbe9fbd5e0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7fbbe9fbd670> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7fbbe9fbd790> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7fbbe9fbd820> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7fbbe9fbd8b0> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7fbbe9fbd940> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7fbbe9fbdb80> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7fbbe9fbdca0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7fbbe9fbdaf0> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7fbbe9fbdc10> ====================
INFO root:portable_runner.py:542 starting control server on port 42511
INFO root:portable_runner.py:542 starting data server on port 38141
INFO root:portable_runner.py:542 starting state server on port 41371
INFO root:portable_runner.py:542 starting logging server on port 44501
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbc1fc23f70> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'e549ef08850812edb112abc63e78bee6c5321b64fbbd9a7a75e7a4a1191c48aa', worker_id = worker_60
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbc1fc277f0> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'8763f874f6ef15c96ec8ab19dafd7d05c7a0aea8781bbe3f56017d72eb290178', worker_id = worker_61
INFO root:portable_runner.py:542 Completed job in 31.403474807739258 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [ 88%]
apache_beam/transforms/sql_test.py::SqlTransformTest::test_zetasql_generate_data
-------------------------------- live log call ---------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:239 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO root:external.py:978 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar'> '35439' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.52.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Starting expansion service at localhost:35439
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:35439.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:50 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1, beam:transform:pubsub_read:v1, beam:transform:pubsub_write:v1, beam:transform:pubsub_write:v2, beam:transform:combine_globally:v1, beam:transform:combine_grouped_values:v1, beam:transform:combine_per_key:v1, beam:transform:create_view:v1, beam:transform:flatten:v1, beam:transform:group_by_key:v1, beam:transform:group_into_batches:v1, beam:transform:group_into_batches_with_sharded_key:v1, beam:transform:impulse:v1, beam:transform:reshuffle:v1, beam:transform:sdf_process_keyed_elements:v1, beam:transform:teststream:v1, beam:transform:window_into:v1, beam:transform:write_files:v1]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered transforms:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@ed7f8b4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4c309d4d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38102d01
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@37883b97
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6ab778a
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4e3958e7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77f80c04
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1dac5ef
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5c90e579
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58ea606c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6f45df59
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@38e79ae3
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@63070bab
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@68e5eea7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@291b4bf5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2d2ffcb7
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@762ef0ea
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:pubsub_write:v2: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@31f9b85e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_globally:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@424e1977
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_grouped_values:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@10d68fcd
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:combine_per_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@117e949d
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:create_view:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6db9f5a4
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:flatten:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@5f8edcc5
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_by_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7b02881e
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@1ebd319f
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:group_into_batches_with_sharded_key:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@3c0be339
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:impulse:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@15ca7889
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:reshuffle:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@7a675056
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:sdf_process_keyed_elements:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@d21a74c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:teststream:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@6e509ffa
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:window_into:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@2898ac89
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:transform:write_files:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$82/1199262943@683dbc2c
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Registered SchemaTransformProviders:
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_cdc_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:spanner_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_fileloads_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_export_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:kafka_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigquery_storage_write:v2
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 schematransform:org.apache.beam:sql_transform:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsub_write:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:bigtable_read:v1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 beam:schematransform:org.apache.beam:pubsublite_write:v1
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:35439.
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:35439.
WARNING root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:35439.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:54 PM org.apache.beam.sdk.expansion.service.ExpansionService expand
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Dependencies list: {}
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:55 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:37:56 PM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:38:03 PM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 09, 2023 11:38:14 PM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: BEAMPlan>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 BeamValuesRel(tuples=[[{ 0 }]])
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO root:environments.py:317 No image given, using default Python SDK image
INFO root:environments.py:320 Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function pack_combiners at 0x7f12c45be160> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function lift_combiners at 0x7f12c45be1f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:712 ==================== <function sort_stages at 0x7f12c45be940> ====================
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STOPPED
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to STARTING
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to RUNNING
INFO root:portable_runner.py:542 ==================== <function annotate_downstream_side_inputs at 0x7fbbe9fbad30> ====================
INFO root:portable_runner.py:542 ==================== <function fix_side_input_pcoll_coders at 0x7fbbe9fbae50> ====================
INFO root:portable_runner.py:542 ==================== <function pack_combiners at 0x7fbbe9fbd3a0> ====================
INFO root:portable_runner.py:542 ==================== <function lift_combiners at 0x7fbbe9fbd430> ====================
INFO root:portable_runner.py:542 ==================== <function expand_sdf at 0x7fbbe9fbd5e0> ====================
INFO root:portable_runner.py:542 ==================== <function expand_gbk at 0x7fbbe9fbd670> ====================
INFO root:portable_runner.py:542 ==================== <function sink_flattens at 0x7fbbe9fbd790> ====================
INFO root:portable_runner.py:542 ==================== <function greedily_fuse at 0x7fbbe9fbd820> ====================
INFO root:portable_runner.py:542 ==================== <function read_to_impulse at 0x7fbbe9fbd8b0> ====================
INFO root:portable_runner.py:542 ==================== <function impulse_to_input at 0x7fbbe9fbd940> ====================
INFO root:portable_runner.py:542 ==================== <function sort_stages at 0x7fbbe9fbdb80> ====================
INFO root:portable_runner.py:542 ==================== <function add_impulse_to_dangling_transforms at 0x7fbbe9fbdca0> ====================
INFO root:portable_runner.py:542 ==================== <function setup_timer_mapping at 0x7fbbe9fbdaf0> ====================
INFO root:portable_runner.py:542 ==================== <function populate_data_channel_coders at 0x7fbbe9fbdc10> ====================
INFO root:portable_runner.py:542 starting control server on port 45875
INFO root:portable_runner.py:542 starting data server on port 42811
INFO root:portable_runner.py:542 starting state server on port 39209
INFO root:portable_runner.py:542 starting logging server on port 35175
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbc1fd6d280> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_java8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_java8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'51e9d5058249ba34e4cca2ab75bc516a2b26353562243c31fbea55ef048a0eef', worker_id = worker_62
INFO root:portable_runner.py:542 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fbc1fd21880> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.8_sdk:2.52.0.dev')
INFO root:portable_runner.py:542 Attempting to pull image apache/beam_python3.8_sdk:2.52.0.dev
INFO root:portable_runner.py:542 Unable to pull image apache/beam_python3.8_sdk:2.52.0.dev, defaulting to local image if it exists
INFO root:portable_runner.py:542 Waiting for docker to start up. Current status is running
INFO root:portable_runner.py:542 Docker container is running. container_id = b'b1dc438d9851b0a3ef60eeedbd5c6885db1d455611aedb9e49d36625704f1b41', worker_id = worker_63
INFO root:portable_runner.py:542 Completed job in 21.192819833755493 seconds with state DONE.
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:549 Job state changed to DONE
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py:28
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
==== 9 passed, 18 skipped, 7190 deselected, 1 warning in 333.13s (0:05:33) =====
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 2802068
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 2808229.
Stopping expansion service pid: 2808230.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/go/test/build.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 28m 47s
259 actionable tasks: 175 executed, 74 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/giwvmbqg5r7d2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Direct #4698
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/4698/display/redirect?page=changes>
Changes:
[noreply] Bump golang.org/x/sync from 0.3.0 to 0.4.0 in /sdks (#28856)
------------------------------------------
[...truncated 170.81 KB...]
Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting scipy>=1.5.0 (from scikit-learn>=0.20.0->apache-beam==2.52.0.dev0)
Using cached scipy-1.10.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
Collecting threadpoolctl>=2.0.0 (from scikit-learn>=0.20.0->apache-beam==2.52.0.dev0)
Obtaining dependency information for threadpoolctl>=2.0.0 from https://files.pythonhosted.org/packages/81/12/fd4dea011af9d69e1cad05c75f3f7202cdcbeac9b712eea58ca779a72865/threadpoolctl-3.2.0-py3-none-any.whl.metadata
Using cached threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB)
Collecting greenlet!=0.4.17 (from sqlalchemy<2.0,>=1.3->apache-beam==2.52.0.dev0)
Obtaining dependency information for greenlet!=0.4.17 from https://files.pythonhosted.org/packages/75/5a/4ecc17749c54882dd3422befcd35fec5128ae2a72138844899322af0b55a/greenlet-3.0.0-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata
Using cached greenlet-3.0.0-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl.metadata (3.8 kB)
Collecting docker>=4.0.0 (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.52.0.dev0)
Obtaining dependency information for docker>=4.0.0 from https://files.pythonhosted.org/packages/db/be/3032490fa33b36ddc8c4b1da3252c6f974e7133f1a50de00c6b85cca203a/docker-6.1.3-py3-none-any.whl.metadata
Using cached docker-6.1.3-py3-none-any.whl.metadata (3.5 kB)
Collecting wrapt (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.52.0.dev0)
Obtaining dependency information for wrapt from https://files.pythonhosted.org/packages/a6/48/c52023d1446741268a35c60d7f1bfc23060e8683ec581121049f4183507a/wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata
Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB)
Collecting deprecation (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.52.0.dev0)
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting pymysql (from testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.52.0.dev0)
Obtaining dependency information for pymysql from https://files.pythonhosted.org/packages/e5/30/20467e39523d0cfc2b6227902d3687a16364307260c75e6a1cb4422b0c62/PyMySQL-1.1.0-py3-none-any.whl.metadata
Using cached PyMySQL-1.1.0-py3-none-any.whl.metadata (4.4 kB)
Collecting urllib3<3,>=1.21.1 (from requests<3.0.0,>=2.24.0->apache-beam==2.52.0.dev0)
Obtaining dependency information for urllib3<3,>=1.21.1 from https://files.pythonhosted.org/packages/48/fe/a5c6cc46e9fe9171d7ecf0f33ee7aae14642f8d74baa7af4d7840f9358be/urllib3-1.26.17-py2.py3-none-any.whl.metadata
Using cached urllib3-1.26.17-py2.py3-none-any.whl.metadata (48 kB)
Collecting pycparser (from cffi>=1.12->cryptography>=41.0.2->apache-beam==2.52.0.dev0)
Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting websocket-client>=0.32.0 (from docker>=4.0.0->testcontainers[mysql]<4.0.0,>=3.0.3->apache-beam==2.52.0.dev0)
Obtaining dependency information for websocket-client>=0.32.0 from https://files.pythonhosted.org/packages/c4/3c/1892ce394828c43d4f65248ebdee3854114266b75d1f5915cb211155ad7b/websocket_client-1.6.4-py3-none-any.whl.metadata
Using cached websocket_client-1.6.4-py3-none-any.whl.metadata (7.7 kB)
Collecting google-crc32c<2.0dev,>=1.0 (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=2.0.0->apache-beam==2.52.0.dev0)
Using cached google_crc32c-1.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (32 kB)
Collecting PyJWT[crypto]<3,>=1.0.0 (from msal<2.0.0,>=1.20.0->azure-identity<2,>=1.12.0->apache-beam==2.52.0.dev0)
Obtaining dependency information for PyJWT[crypto]<3,>=1.0.0 from https://files.pythonhosted.org/packages/2b/4f/e04a8067c7c96c364cef7ef73906504e2f40d690811c021e1a1901473a19/PyJWT-2.8.0-py3-none-any.whl.metadata
Using cached PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB)
Collecting portalocker<3,>=1.0 (from msal-extensions<2.0.0,>=0.3.0->azure-identity<2,>=1.12.0->apache-beam==2.52.0.dev0)
Obtaining dependency information for portalocker<3,>=1.0 from https://files.pythonhosted.org/packages/17/9e/87671efcca80ba6203811540ed1f9c0462c1609d2281d7b7f53cef05da3d/portalocker-2.8.2-py3-none-any.whl.metadata
Using cached portalocker-2.8.2-py3-none-any.whl.metadata (8.5 kB)
Collecting pyasn1>=0.1.7 (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam==2.52.0.dev0)
Using cached pyasn1-0.5.0-py2.py3-none-any.whl (83 kB)
Collecting backports.zoneinfo (from tzlocal>=1.2->js2py<1,>=0.74->apache-beam==2.52.0.dev0)
Using cached backports.zoneinfo-0.2.1-cp38-cp38-manylinux1_x86_64.whl (74 kB)
Using cached azure_core-1.29.4-py3-none-any.whl (192 kB)
Using cached azure_identity-1.15.0b1-py3-none-any.whl (162 kB)
Using cached azure_storage_blob-12.18.2-py3-none-any.whl (392 kB)
Using cached boto3-1.28.62-py3-none-any.whl (135 kB)
Using cached cryptography-41.0.4-cp37-abi3-manylinux_2_28_x86_64.whl (4.4 MB)
Using cached fastavro-1.8.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.1 MB)
Using cached fasteners-0.19-py3-none-any.whl (18 kB)
Using cached google_api_core-2.12.0-py3-none-any.whl (121 kB)
Using cached google_auth-2.23.2-py2.py3-none-any.whl (181 kB)
Using cached google_auth_httplib2-0.1.1-py2.py3-none-any.whl (9.3 kB)
Using cached google_cloud_aiplatform-1.34.0-py2.py3-none-any.whl (3.1 MB)
Using cached google_cloud_bigquery-3.12.0-py2.py3-none-any.whl (220 kB)
Using cached google_cloud_bigquery_storage-2.22.0-py2.py3-none-any.whl (190 kB)
Using cached google_cloud_bigtable-2.21.0-py2.py3-none-any.whl (293 kB)
Using cached google_cloud_core-2.3.3-py2.py3-none-any.whl (29 kB)
Using cached google_cloud_datastore-2.18.0-py2.py3-none-any.whl (177 kB)
Using cached google_cloud_dlp-3.12.3-py2.py3-none-any.whl (143 kB)
Using cached google_cloud_language-2.11.1-py2.py3-none-any.whl (138 kB)
Using cached google_cloud_pubsub-2.18.4-py2.py3-none-any.whl (265 kB)
Using cached google_cloud_pubsublite-1.8.3-py2.py3-none-any.whl (288 kB)
Using cached google_cloud_recommendations_ai-0.10.5-py2.py3-none-any.whl (173 kB)
Using cached google_cloud_spanner-3.40.1-py2.py3-none-any.whl (332 kB)
Using cached google_cloud_videointelligence-2.11.4-py2.py3-none-any.whl (229 kB)
Using cached google_cloud_vision-3.4.4-py2.py3-none-any.whl (444 kB)
Using cached hypothesis-6.87.3-py3-none-any.whl (420 kB)
Using cached joblib-1.3.2-py3-none-any.whl (302 kB)
Using cached mock-5.1.0-py3-none-any.whl (30 kB)
Using cached orjson-3.9.7-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (138 kB)
Using cached proto_plus-1.22.3-py3-none-any.whl (48 kB)
Using cached psycopg2_binary-2.9.9-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Using cached pymongo-4.5.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (687 kB)
Using cached pytest-7.4.2-py3-none-any.whl (324 kB)
Using cached pytest_timeout-2.2.0-py3-none-any.whl (13 kB)
Using cached pytest_xdist-3.3.1-py3-none-any.whl (41 kB)
Using cached pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
Using cached PyYAML-6.0.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (736 kB)
Using cached regex-2023.10.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (776 kB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached requests_mock-1.11.0-py2.py3-none-any.whl (28 kB)
Using cached scikit_learn-1.3.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.1 MB)
Using cached SQLAlchemy-1.4.49-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
Using cached tenacity-8.2.3-py3-none-any.whl (24 kB)
Using cached typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Using cached botocore-1.31.62-py3-none-any.whl (11.2 MB)
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Using cached cffi-1.16.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (444 kB)
Using cached charset_normalizer-3.3.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (137 kB)
Using cached dnspython-2.4.2-py3-none-any.whl (300 kB)
Using cached docker-6.1.3-py3-none-any.whl (148 kB)
Using cached exceptiongroup-1.1.3-py3-none-any.whl (14 kB)
Using cached execnet-2.0.2-py3-none-any.whl (37 kB)
Using cached google_cloud_resource_manager-1.10.4-py2.py3-none-any.whl (320 kB)
Using cached google_cloud_storage-2.11.0-py2.py3-none-any.whl (118 kB)
Using cached google_resumable_media-2.6.0-py2.py3-none-any.whl (80 kB)
Using cached googleapis_common_protos-1.60.0-py2.py3-none-any.whl (227 kB)
Using cached greenlet-3.0.0-cp38-cp38-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (617 kB)
Using cached grpcio_status-1.59.0-py3-none-any.whl (14 kB)
Using cached msal-1.24.1-py2.py3-none-any.whl (95 kB)
Using cached pyparsing-3.1.1-py3-none-any.whl (103 kB)
Using cached s3transfer-0.7.0-py3-none-any.whl (79 kB)
Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Using cached tzlocal-5.1-py3-none-any.whl (21 kB)
Using cached urllib3-1.26.17-py2.py3-none-any.whl (143 kB)
Using cached PyMySQL-1.1.0-py3-none-any.whl (44 kB)
Using cached wrapt-1.16.0rc1-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (82 kB)
Using cached portalocker-2.8.2-py3-none-any.whl (17 kB)
Using cached websocket_client-1.6.4-py3-none-any.whl (57 kB)
Using cached PyJWT-2.8.0-py3-none-any.whl (22 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
> Task :release:go-licenses:py:dockerRun
W1009 17:22:28.834660 85 library.go:101] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.11.0/unix/asm_linux_amd64.s
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py38:copyGolangLicenses
> Task :sdks:python:container:py38:dockerPrepare
> Task :sdks:go:container:docker
#6 11.46 Get:2 http://deb.debian.org/debian bullseye/main amd64 ca-certificates all 20210119 [158 kB]
#6 13.95 debconf: delaying package configuration, since apt-utils is not installed
#6 14.06 Fetched 1017 kB in 0s (2992 kB/s)
#6 14.80 Selecting previously unselected package openssl.
#6 14.80 (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 6664 files and directories currently installed.)
#6 15.20 Preparing to unpack .../openssl_1.1.1w-0+deb11u1_amd64.deb ...
#6 15.29 Unpacking openssl (1.1.1w-0+deb11u1) ...
#6 15.65 Selecting previously unselected package ca-certificates.
#6 15.67 Preparing to unpack .../ca-certificates_20210119_all.deb ...
#6 15.67 Unpacking ca-certificates (20210119) ...
#6 16.01 Setting up openssl (1.1.1w-0+deb11u1) ...
#6 16.20 Setting up ca-certificates (20210119) ...
#6 17.20 Updating certificates in /etc/ssl/certs...
#6 18.28 129 added, 0 removed; done.
#6 18.33 Processing triggers for ca-certificates (20210119) ...
#6 18.34 Updating certificates in /etc/ssl/certs...
#6 18.94 0 added, 0 removed; done.
#6 18.94 Running hooks in /etc/ca-certificates/update.d...
#6 18.94 done.
#6 DONE 20.5s
#7 [3/7] ADD target/linux_amd64/boot /opt/apache/beam/
#7 DONE 1.4s
#8 [4/7] COPY target/LICENSE /opt/apache/beam/
#8 DONE 1.9s
#9 [5/7] COPY target/NOTICE /opt/apache/beam/
#9 DONE 0.2s
#10 [6/7] COPY target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
#10 DONE 0.2s
#11 [7/7] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#11 DONE 0.6s
#12 exporting to image
#12 exporting layers
#12 exporting layers 0.2s done
#12 writing image sha256:330ddc164dfa5adf9b6d6ae50d408ad388ba2635ee9c5700a10c25ce8adff5d1 done
#12 naming to docker.io/apache/beam_go_sdk:latest done
#12 DONE 0.2s
> Task :sdks:java:extensions:sql:expansion-service:shadowJar FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeClassesDependencies FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeTestClassesDependencies SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:analyzeDependencies UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:checkstyleTest NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:javadoc NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsMain NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:spotbugsTest SKIPPED
> Task :sdks:java:io:google-cloud-platform:expansion-service:test NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:expansion-service:check UP-TO-DATE
> Task :sdks:java:io:google-cloud-platform:expansion-service:build
> Task :sdks:python:container:py38:docker
#1 [internal] load build definition from Dockerfile
#1 transferring dockerfile: 4.99kB done
#1 DONE 0.0s
#2 [internal] load .dockerignore
#2 transferring context: 2B done
#2 DONE 0.0s
#3 [internal] load metadata for docker.io/library/python:3.8-bullseye
#3 DONE 0.3s
#4 [beam 1/5] FROM docker.io/library/python:3.8-bullseye@sha256:8d742d4588683dd228042ffc042fc86799c414457821eaa959dc0f9af8ce43af
#4 CACHED
#5 [internal] load build context
#5 transferring context: 2.48MB 0.0s done
#5 DONE 0.0s
#6 [beam 2/5] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
#6 CACHED
#7 [beam 3/5] COPY target/apache-beam.tar.gz /opt/apache/beam/tars/
#7 CACHED
#8 [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/
#8 ERROR: "/target/launcher/linux_amd64/boot" not found: not found
#6 [beam 2/5] COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
#6 CANCELED
------
> [beam 4/5] COPY target/launcher/linux_amd64/boot target/LICENSE target/NOTICE target/LICENSE.python /opt/apache/beam/:
------
ERROR: failed to solve: failed to compute cache key: "/target/launcher/linux_amd64/boot" not found: not found
> Task :sdks:python:container:py38:docker FAILED
> Task :sdks:python:installGcpTest
Successfully installed PyJWT-2.8.0 apache-beam-2.52.0.dev0 attrs-23.1.0 azure-core-1.29.4 azure-identity-1.15.0b1 azure-storage-blob-12.18.2 backports.zoneinfo-0.2.1 boto3-1.28.62 botocore-1.31.62 certifi-2023.7.22 cffi-1.16.0 charset-normalizer-3.3.0 cloudpickle-2.2.1 crcmod-1.7 cryptography-41.0.4 deprecation-2.1.0 dill-0.3.1.1 dnspython-2.4.2 docker-6.1.3 docopt-0.6.2 exceptiongroup-1.1.3 execnet-2.0.2 fastavro-1.8.4 fasteners-0.19 freezegun-1.2.2 google-api-core-2.12.0 google-apitools-0.5.31 google-auth-2.23.2 google-auth-httplib2-0.1.1 google-cloud-aiplatform-1.34.0 google-cloud-bigquery-3.12.0 google-cloud-bigquery-storage-2.22.0 google-cloud-bigtable-2.21.0 google-cloud-core-2.3.3 google-cloud-datastore-2.18.0 google-cloud-dlp-3.12.3 google-cloud-language-2.11.1 google-cloud-pubsub-2.18.4 google-cloud-pubsublite-1.8.3 google-cloud-recommendations-ai-0.10.5 google-cloud-resource-manager-1.10.4 google-cloud-spanner-3.40.1 google-cloud-storage-2.11.0 google-cloud-videointelligence-2.11.4 google-cloud-vision-3.4.4 google-crc32c-1.5.0 google-resumable-media-2.6.0 googleapis-common-protos-1.60.0 greenlet-3.0.0 grpc-google-iam-v1-0.12.6 grpcio-status-1.59.0 hdfs-2.7.2 httplib2-0.22.0 hypothesis-6.87.3 idna-3.4 iniconfig-2.0.0 isodate-0.6.1 jmespath-1.0.1 joblib-1.3.2 js2py-0.74 mock-5.1.0 msal-1.24.1 msal-extensions-1.0.0 oauth2client-4.1.3 objsize-0.6.1 orjson-3.9.7 overrides-6.5.0 pandas-1.5.3 parameterized-0.9.0 portalocker-2.8.2 proto-plus-1.22.3 psycopg2-binary-2.9.9 pyarrow-11.0.0 pyasn1-0.5.0 pyasn1-modules-0.3.0 pycparser-2.21 pydot-1.4.2 pyhamcrest-2.0.4 pyjsparser-2.7.1 pymongo-4.5.0 pymysql-1.1.0 pyparsing-3.1.1 pytest-7.4.2 pytest-timeout-2.2.0 pytest-xdist-3.3.1 python-dateutil-2.8.2 pytz-2023.3.post1 pyyaml-6.0.1 regex-2023.10.3 requests-2.31.0 requests_mock-1.11.0 rsa-4.9 s3transfer-0.7.0 scikit-learn-1.3.1 scipy-1.10.1 shapely-1.8.5.post1 six-1.16.0 sortedcontainers-2.4.0 sqlalchemy-1.4.49 sqlparse-0.4.4 tenacity-8.2.3 testcontainers-3.7.1 threadpoolctl-3.2.0 typing-extensions-4.8.0 tzlocal-5.1 urllib3-1.26.17 websocket-client-1.6.4 wrapt-1.16.0rc1 zstandard-0.21.0
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup
Waiting for server to start up...
Server started at port 37489
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 852746
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py38:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.
BUILD FAILED in 2m 33s
246 actionable tasks: 160 executed, 76 from cache, 10 up-to-date
Publishing build scan...
https://ge.apache.org/s/zgp5pvaleq2se
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org